2023-08-31T01:47:22.516 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T01:47:22.517 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123 --owner scheduled_pdonnell@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/orig.config.yaml 2023-08-31T01:47:22.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T01:47:22.660 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123 branch: wip-batrick-testing-20230830.165602 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} email: pdonnell@redhat.com first_in_suite: false job_id: '7385123' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20230830.165602 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20230830.165602 sha1: 833faa571491534dcb6bc6b25a578499081113d8 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6543 sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 sleep_before_teardown: 0 subset: 131/512 suite: fs suite_branch: wip-batrick-testing-20230830.165602 suite_path: /home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 833faa571491534dcb6bc6b25a578499081113d8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: f9a8556d5e989d27b6626a0b75ef595991f83d20 timestamp: 2023-08-30_23:48:03 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-08-31T01:47:22.660 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa; will attempt to use it 2023-08-31T01:47:22.661 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks 2023-08-31T01:47:22.661 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-31T01:47:22.665 INFO:teuthology.task.internal:Checking packages... 2023-08-31T01:47:22.692 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'cc14fc8aa878d09ac353379f17aec3b92248b995' 2023-08-31T01:47:22.692 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-31T01:47:22.693 INFO:teuthology.packaging:ref: None 2023-08-31T01:47:22.693 INFO:teuthology.packaging:tag: None 2023-08-31T01:47:22.694 INFO:teuthology.packaging:branch: wip-batrick-testing-20230830.165602 2023-08-31T01:47:22.694 INFO:teuthology.packaging:sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T01:47:22.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20230830.165602 2023-08-31T01:47:22.918 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5814.gcc14fc8a 2023-08-31T01:47:22.919 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-31T01:47:22.927 INFO:teuthology.task.internal:no buildpackages task found 2023-08-31T01:47:22.928 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-31T01:47:22.970 INFO:teuthology.task.internal:Saving configuration 2023-08-31T01:47:22.989 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-31T01:47:23.009 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T01:47:23.035 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 01:42:15.129205', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-31T01:47:23.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 01:42:15.127768', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-31T01:47:23.058 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-31T01:47:23.064 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-31T01:47:23.064 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-31T01:47:23.064 INFO:teuthology.run_tasks:Running task console_log... 2023-08-31T01:47:23.162 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc771811c10>, signals=[15]) 2023-08-31T01:47:23.163 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-31T01:47:23.169 INFO:teuthology.task.internal:Opening connections... 2023-08-31T01:47:23.169 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T01:47:23.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:47:23.245 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T01:47:23.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:47:23.316 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-31T01:47:23.324 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-08-31T01:47:23.347 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-08-31T01:47:23.347 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-08-31T01:47:23.406 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T01:47:23.406 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T01:47:23.406 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2023-08-31T01:47:23.407 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2023-08-31T01:47:23.407 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6" 2023-08-31T01:47:23.407 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-08-31T01:47:23.407 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T01:47:23.408 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-08-31T01:47:23.408 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T01:47:23.408 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T01:47:23.408 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T01:47:23.408 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T01:47:23.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:47:23.409 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T01:47:23.409 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T01:47:23.409 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T01:47:23.409 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T01:47:23.410 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-08-31T01:47:23.429 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-08-31T01:47:23.449 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-08-31T01:47:23.450 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-08-31T01:47:23.509 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T01:47:23.509 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T01:47:23.509 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-08-31T01:47:23.509 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-08-31T01:47:23.510 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6" 2023-08-31T01:47:23.510 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-08-31T01:47:23.510 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T01:47:23.510 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-08-31T01:47:23.511 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T01:47:23.511 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T01:47:23.511 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T01:47:23.511 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T01:47:23.511 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:47:23.512 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T01:47:23.512 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T01:47:23.512 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T01:47:23.512 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T01:47:23.513 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-08-31T01:47:23.537 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-31T01:47:23.548 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-31T01:47:23.596 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-31T01:47:23.598 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2023-08-31T01:47:23.600 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2023-08-31T01:47:23.619 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-31T01:47:23.628 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-31T01:47:23.629 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2023-08-31T01:47:23.660 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2023-08-31T01:47:23.689 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-31T01:47:23.748 INFO:teuthology.run_tasks:Running task kernel... 2023-08-31T01:47:23.763 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-08-31T01:47:23.764 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-08-31T01:47:23.764 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-31T01:47:23.765 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-31T01:47:23.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T01:47:23.785 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-08-31T01:47:23.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T01:47:23.786 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2023-08-31T01:47:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-31T01:47:23.845 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.18.0-372.9.1.el8.x86_64 2023-08-31T01:47:23.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2023-08-31T01:47:23.848 INFO:teuthology.orchestra.run.smithi170.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-31T01:47:23.848 INFO:teuthology.task.kernel:Running kernel on smithi170: 4.18.0-372.9.1.el8.x86_64 2023-08-31T01:47:23.849 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2023-08-31T01:47:25.002 INFO:teuthology.orchestra.run.smithi170.stdout:Updating Subscription Management repositories. 2023-08-31T01:47:25.002 INFO:teuthology.orchestra.run.smithi170.stdout:Unable to read consumer identity 2023-08-31T01:47:25.050 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-08-31T01:47:25.050 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-08-31T01:47:26.413 INFO:teuthology.orchestra.run.smithi170.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-31T01:47:26.518 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-31T01:47:27.080 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-08-31T01:47:27.785 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-08-31T01:47:30.589 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 425 kB/s | 24 kB 00:00 2023-08-31T01:47:31.244 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 448 kB/s | 24 kB 00:00 2023-08-31T01:47:31.266 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-31T01:47:31.324 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2023-08-31T01:47:31.325 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2023-08-31T01:47:31.325 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2023-08-31T01:47:31.468 DEBUG:teuthology.orchestra.run.smithi170:> echo no | sudo yum reinstall kernel || true 2023-08-31T01:47:31.799 INFO:teuthology.orchestra.run.smithi170.stdout:Updating Subscription Management repositories. 2023-08-31T01:47:31.800 INFO:teuthology.orchestra.run.smithi170.stdout:Unable to read consumer identity 2023-08-31T01:47:31.954 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-31T01:47:32.013 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-08-31T01:47:32.014 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2023-08-31T01:47:32.014 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-08-31T01:47:32.054 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:02 ago on Thu 31 Aug 2023 01:47:30 AM UTC. 2023-08-31T01:47:32.097 INFO:teuthology.orchestra.run.smithi170.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T01:47:32.129 INFO:teuthology.orchestra.run.smithi170.stderr:Error: No packages marked for reinstall. 2023-08-31T01:47:32.130 DEBUG:teuthology.orchestra.run.smithi084:> echo no | sudo yum reinstall kernel || true 2023-08-31T01:47:32.176 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum reinstall -y kernel || true 2023-08-31T01:47:32.499 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-08-31T01:47:32.499 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-08-31T01:47:32.506 INFO:teuthology.orchestra.run.smithi170.stdout:Updating Subscription Management repositories. 2023-08-31T01:47:32.507 INFO:teuthology.orchestra.run.smithi170.stdout:Unable to read consumer identity 2023-08-31T01:47:32.752 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:01 ago on Thu 31 Aug 2023 01:47:31 AM UTC. 2023-08-31T01:47:32.763 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:02 ago on Thu 31 Aug 2023 01:47:30 AM UTC. 2023-08-31T01:47:32.793 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T01:47:32.803 INFO:teuthology.orchestra.run.smithi170.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T01:47:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:Error: No packages marked for reinstall. 2023-08-31T01:47:32.832 INFO:teuthology.orchestra.run.smithi084.stderr:Error: No packages marked for reinstall. 2023-08-31T01:47:32.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum reinstall -y kernel || true 2023-08-31T01:47:32.883 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2023-08-31T01:47:32.963 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-31T01:47:32.964 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-31T01:47:32.964 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-31T01:47:32.964 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-08-31T01:47:32.965 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-31T01:47:33.010 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2023-08-31T01:47:33.022 DEBUG:teuthology.parallel:result is None 2023-08-31T01:47:33.207 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-08-31T01:47:33.207 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-08-31T01:47:33.454 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:02 ago on Thu 31 Aug 2023 01:47:31 AM UTC. 2023-08-31T01:47:33.493 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T01:47:33.514 INFO:teuthology.orchestra.run.smithi084.stderr:Error: No packages marked for reinstall. 2023-08-31T01:47:33.560 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2023-08-31T01:47:33.639 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-31T01:47:33.640 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-31T01:47:33.640 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-31T01:47:33.640 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-31T01:47:33.641 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-31T01:47:33.675 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2023-08-31T01:47:33.691 DEBUG:teuthology.parallel:result is None 2023-08-31T01:47:33.692 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-31T01:47:33.698 INFO:teuthology.task.internal:Creating test directory... 2023-08-31T01:47:33.699 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-31T01:47:33.734 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-31T01:47:33.752 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-31T01:47:33.760 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-31T01:47:33.806 INFO:teuthology.task.internal:Creating archive directory... 2023-08-31T01:47:33.807 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-31T01:47:33.810 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-31T01:47:33.835 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-31T01:47:33.845 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-31T01:47:33.845 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-31T01:47:33.868 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-31T01:47:33.907 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T01:47:33.916 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T01:47:33.917 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T01:47:33.927 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T01:47:33.928 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-31T01:47:33.937 INFO:teuthology.task.internal:Configuring sudo... 2023-08-31T01:47:33.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-31T01:47:33.961 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-31T01:47:33.997 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-31T01:47:34.015 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-31T01:47:34.015 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-31T01:47:34.028 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-31T01:47:34.055 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T01:47:34.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T01:47:34.176 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T01:47:34.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T01:47:34.303 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:47:34.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-31T01:47:34.370 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T01:47:34.418 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T01:47:34.470 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T01:47:34.557 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T01:47:34.601 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:47:34.602 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-31T01:47:34.669 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2023-08-31T01:47:34.672 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2023-08-31T01:47:34.732 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T01:47:34.779 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T01:47:35.033 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-31T01:47:35.042 INFO:teuthology.task.internal:Starting timer... 2023-08-31T01:47:35.042 INFO:teuthology.run_tasks:Running task pcp... 2023-08-31T01:47:35.075 INFO:teuthology.run_tasks:Running task selinux... 2023-08-31T01:47:35.111 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-31T01:47:35.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2023-08-31T01:47:35.173 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2023-08-31T01:47:35.174 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2023-08-31T01:47:35.246 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2023-08-31T01:47:35.248 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-31T01:47:35.248 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2023-08-31T01:47:35.278 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2023-08-31T01:47:35.278 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2023-08-31T01:47:35.302 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2023-08-31T01:47:35.303 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2023-08-31T01:47:35.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T01:47:35.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T01:47:35.346 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T01:47:35.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T01:47:35.374 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-31T01:47:35.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2023-08-31T01:47:35.414 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2023-08-31T01:47:35.441 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-31T01:47:35.456 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-31T01:47:35.464 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-31T01:47:35.571 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-31T01:47:35.587 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-31T01:47:35.588 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-31T01:56:38.399 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2023-08-31T01:56:38.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-08-31T01:56:38.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:56:38.471 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-08-31T01:56:38.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-08-31T01:56:38.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-08-31T01:56:38.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:56:38.614 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-08-31T01:56:38.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-08-31T01:56:38.684 INFO:teuthology.run_tasks:Running task clock... 2023-08-31T01:56:38.699 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-31T01:56:38.700 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-31T01:56:38.701 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T01:56:38.703 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-31T01:56:38.704 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T01:56:38.734 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-31T01:56:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-31T01:56:38.756 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-31T01:56:38.771 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-31T01:56:38.815 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2023-08-31T01:56:38.827 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2023-08-31T01:56:38.841 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-31T01:56:38.852 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2023-08-31T01:56:38.855 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-31T01:56:38.864 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2023-08-31T01:56:38.878 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-31T01:56:38.896 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-31T01:56:38.938 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-08-31T01:56:38.942 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T01:56:38.942 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-08-31T01:56:38.942 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T01:56:38.943 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T01:56:38.943 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T01:56:38.943 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T01:56:38.972 INFO:teuthology.orchestra.run.smithi170.stderr:bash: ntpq: command not found 2023-08-31T01:56:38.975 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T01:56:38.975 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2023-08-31T01:56:38.975 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T01:56:38.975 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T01:56:38.976 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T01:56:38.976 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T01:56:38.977 INFO:teuthology.run_tasks:Running task install... 2023-08-31T01:56:38.986 DEBUG:teuthology.task.install:project ceph 2023-08-31T01:56:38.986 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}} 2023-08-31T01:56:38.987 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'} 2023-08-31T01:56:38.987 INFO:teuthology.task.install:Using flavor: default 2023-08-31T01:56:38.993 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-31T01:56:38.993 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-31T01:56:38.994 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'tag': None, 'wait_for_package': False} 2023-08-31T01:56:38.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T01:56:38.998 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'tag': None, 'wait_for_package': False} 2023-08-31T01:56:38.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T01:56:39.142 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/ 2023-08-31T01:56:39.142 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5814.gcc14fc8a 2023-08-31T01:56:39.216 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/ 2023-08-31T01:56:39.217 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5814.gcc14fc8a 2023-08-31T01:56:39.252 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-31T01:56:39.252 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:56:39.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-31T01:56:39.280 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-31T01:56:39.281 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cc14fc8aa878d09ac353379f17aec3b92248b995/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-31T01:56:39.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-31T01:56:39.383 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-31T01:56:39.383 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:56:39.383 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-31T01:56:39.414 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-31T01:56:39.414 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cc14fc8aa878d09ac353379f17aec3b92248b995/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-31T01:56:39.424 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-31T01:56:39.483 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-31T01:56:39.490 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2023-08-31T01:56:39.491 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2023-08-31T01:56:39.563 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-31T01:56:39.631 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2023-08-31T01:56:39.633 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2023-08-31T01:56:39.862 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-08-31T01:56:40.005 INFO:teuthology.orchestra.run.smithi170.stdout:Updating Subscription Management repositories. 2023-08-31T01:56:40.114 INFO:teuthology.orchestra.run.smithi084.stdout:44 files removed 2023-08-31T01:56:40.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-31T01:56:40.374 INFO:teuthology.orchestra.run.smithi170.stdout:44 files removed 2023-08-31T01:56:40.423 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-31T01:56:40.490 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-08-31T01:56:40.759 INFO:teuthology.orchestra.run.smithi170.stdout:Updating Subscription Management repositories. 2023-08-31T01:56:41.537 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 123 kB/s | 81 kB 00:00 2023-08-31T01:56:41.778 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 128 kB/s | 81 kB 00:00 2023-08-31T01:56:41.969 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 23 kB/s | 9.4 kB 00:00 2023-08-31T01:56:42.110 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-08-31T01:56:42.277 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2023-08-31T01:56:42.361 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-08-31T01:56:42.445 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-08-31T01:56:42.511 INFO:teuthology.orchestra.run.smithi170.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-08-31T01:56:43.079 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-08-31T01:56:43.287 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-08-31T01:56:46.513 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 413 kB/s | 24 kB 00:00 2023-08-31T01:56:46.779 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 326 kB/s | 24 kB 00:00 2023-08-31T01:56:47.423 INFO:teuthology.orchestra.run.smithi170.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-08-31T01:56:47.597 INFO:teuthology.orchestra.run.smithi084.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 63 MB/s | 47 MB 00:00 2023-08-31T01:56:55.414 INFO:teuthology.orchestra.run.smithi084.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-08-31T01:56:55.466 INFO:teuthology.orchestra.run.smithi170.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-08-31T01:57:06.478 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T01:57:06.479 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T01:57:06.494 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-31T01:57:06.494 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-31T01:57:06.496 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-31T01:57:06.497 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T01:57:06.499 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T01:57:06.502 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T01:57:06.503 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T01:57:06.636 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-08-31T01:57:06.648 INFO:teuthology.orchestra.run.smithi084.stdout:=========================================================================================================================== 2023-08-31T01:57:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2023-08-31T01:57:06.649 INFO:teuthology.orchestra.run.smithi084.stdout:=========================================================================================================================== 2023-08-31T01:57:06.649 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2023-08-31T01:57:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-31T01:57:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-31T01:57:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.4 k 2023-08-31T01:57:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 5.4 M 2023-08-31T01:57:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 861 k 2023-08-31T01:57:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 167 k 2023-08-31T01:57:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 1.6 M 2023-08-31T01:57:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 132 k 2023-08-31T01:57:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 1.7 M 2023-08-31T01:57:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 7.4 M 2023-08-31T01:57:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 47 k 2023-08-31T01:57:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 14 M 2023-08-31T01:57:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 48 M 2023-08-31T01:57:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 261 k 2023-08-31T01:57:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 171 k 2023-08-31T01:57:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 260 k 2023-08-31T01:57:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 18 k 2023-08-31T01:57:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-31T01:57:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-31T01:57:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-31T01:57:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 31 k 2023-08-31T01:57:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 784 k 2023-08-31T01:57:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T01:57:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-31T01:57:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-31T01:57:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-31T01:57:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-31T01:57:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-31T01:57:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-31T01:57:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 196 k 2023-08-31T01:57:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 370 k 2023-08-31T01:57:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 364 k 2023-08-31T01:57:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 107 k 2023-08-31T01:57:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 94 k 2023-08-31T01:57:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.5 M 2023-08-31T01:57:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 179 k 2023-08-31T01:57:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-31T01:57:06.657 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-08-31T01:57:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-31T01:57:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.7 M 2023-08-31T01:57:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.6 M 2023-08-31T01:57:06.658 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2023-08-31T01:57:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-31T01:57:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 22 M 2023-08-31T01:57:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 23 k 2023-08-31T01:57:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 2.3 M 2023-08-31T01:57:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 242 k 2023-08-31T01:57:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 4.6 M 2023-08-31T01:57:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 18 M 2023-08-31T01:57:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 15 k 2023-08-31T01:57:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 24 k 2023-08-31T01:57:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-31T01:57:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-31T01:57:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-31T01:57:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-31T01:57:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-31T01:57:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T01:57:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-31T01:57:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-31T01:57:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-31T01:57:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-31T01:57:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-31T01:57:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-31T01:57:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 472 k 2023-08-31T01:57:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-31T01:57:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.8 M 2023-08-31T01:57:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-31T01:57:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-31T01:57:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-31T01:57:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-31T01:57:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-31T01:57:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-31T01:57:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-31T01:57:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-31T01:57:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-31T01:57:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-31T01:57:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-31T01:57:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-31T01:57:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-31T01:57:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-31T01:57:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-31T01:57:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-31T01:57:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 45 k 2023-08-31T01:57:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 125 k 2023-08-31T01:57:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-31T01:57:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-31T01:57:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-31T01:57:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-31T01:57:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-31T01:57:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-31T01:57:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-31T01:57:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-31T01:57:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-31T01:57:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-31T01:57:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-31T01:57:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T01:57:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-31T01:57:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-31T01:57:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-31T01:57:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-31T01:57:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-31T01:57:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-31T01:57:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-31T01:57:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-31T01:57:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-31T01:57:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-31T01:57:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-31T01:57:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-31T01:57:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-31T01:57:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-31T01:57:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-31T01:57:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-31T01:57:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-31T01:57:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-31T01:57:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T01:57:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-31T01:57:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-31T01:57:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-31T01:57:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-31T01:57:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-31T01:57:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-31T01:57:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-31T01:57:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-31T01:57:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-31T01:57:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-31T01:57:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-31T01:57:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-31T01:57:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-31T01:57:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-31T01:57:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-31T01:57:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-31T01:57:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-31T01:57:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-31T01:57:06.677 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling module streams: 2023-08-31T01:57:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql 10 2023-08-31T01:57:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:57:06.677 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-08-31T01:57:06.678 INFO:teuthology.orchestra.run.smithi084.stdout:=========================================================================================================================== 2023-08-31T01:57:06.678 INFO:teuthology.orchestra.run.smithi084.stdout:Install 128 Packages 2023-08-31T01:57:06.678 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 3 Packages 2023-08-31T01:57:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:57:06.679 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 206 M 2023-08-31T01:57:06.679 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-08-31T01:57:06.764 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T01:57:06.765 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T01:57:06.780 INFO:teuthology.orchestra.run.smithi170.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-31T01:57:06.781 INFO:teuthology.orchestra.run.smithi170.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-31T01:57:06.782 INFO:teuthology.orchestra.run.smithi170.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-31T01:57:06.783 INFO:teuthology.orchestra.run.smithi170.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T01:57:06.786 INFO:teuthology.orchestra.run.smithi170.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T01:57:06.789 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T01:57:06.790 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T01:57:06.919 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2023-08-31T01:57:06.931 INFO:teuthology.orchestra.run.smithi170.stdout:=========================================================================================================================== 2023-08-31T01:57:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2023-08-31T01:57:06.932 INFO:teuthology.orchestra.run.smithi170.stdout:=========================================================================================================================== 2023-08-31T01:57:06.932 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2023-08-31T01:57:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-31T01:57:06.933 INFO:teuthology.orchestra.run.smithi170.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-31T01:57:06.933 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.4 k 2023-08-31T01:57:06.933 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 5.4 M 2023-08-31T01:57:06.933 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 861 k 2023-08-31T01:57:06.934 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 167 k 2023-08-31T01:57:06.934 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 1.6 M 2023-08-31T01:57:06.934 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 132 k 2023-08-31T01:57:06.934 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 1.7 M 2023-08-31T01:57:06.934 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 7.4 M 2023-08-31T01:57:06.935 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 47 k 2023-08-31T01:57:06.935 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 14 M 2023-08-31T01:57:06.935 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 48 M 2023-08-31T01:57:06.935 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 261 k 2023-08-31T01:57:06.935 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 171 k 2023-08-31T01:57:06.936 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 260 k 2023-08-31T01:57:06.936 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 18 k 2023-08-31T01:57:06.936 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-31T01:57:06.936 INFO:teuthology.orchestra.run.smithi170.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-31T01:57:06.937 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-31T01:57:06.937 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 31 k 2023-08-31T01:57:06.937 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 784 k 2023-08-31T01:57:06.937 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T01:57:06.937 INFO:teuthology.orchestra.run.smithi170.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-31T01:57:06.938 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-31T01:57:06.938 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-31T01:57:06.938 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-31T01:57:06.938 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-31T01:57:06.939 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-31T01:57:06.939 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 196 k 2023-08-31T01:57:06.939 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 370 k 2023-08-31T01:57:06.939 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 364 k 2023-08-31T01:57:06.940 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 107 k 2023-08-31T01:57:06.940 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 94 k 2023-08-31T01:57:06.940 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.5 M 2023-08-31T01:57:06.940 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 179 k 2023-08-31T01:57:06.940 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-31T01:57:06.941 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2023-08-31T01:57:06.941 INFO:teuthology.orchestra.run.smithi170.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-31T01:57:06.941 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.7 M 2023-08-31T01:57:06.941 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.6 M 2023-08-31T01:57:06.942 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2023-08-31T01:57:06.942 INFO:teuthology.orchestra.run.smithi170.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-31T01:57:06.942 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 22 M 2023-08-31T01:57:06.942 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 23 k 2023-08-31T01:57:06.942 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 2.3 M 2023-08-31T01:57:06.943 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 242 k 2023-08-31T01:57:06.943 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 4.6 M 2023-08-31T01:57:06.943 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 18 M 2023-08-31T01:57:06.943 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 15 k 2023-08-31T01:57:06.943 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 24 k 2023-08-31T01:57:06.944 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-31T01:57:06.944 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-31T01:57:06.944 INFO:teuthology.orchestra.run.smithi170.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-31T01:57:06.944 INFO:teuthology.orchestra.run.smithi170.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-31T01:57:06.944 INFO:teuthology.orchestra.run.smithi170.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-31T01:57:06.945 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T01:57:06.945 INFO:teuthology.orchestra.run.smithi170.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-31T01:57:06.945 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-31T01:57:06.945 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-31T01:57:06.945 INFO:teuthology.orchestra.run.smithi170.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-31T01:57:06.946 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-31T01:57:06.946 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-31T01:57:06.946 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 472 k 2023-08-31T01:57:06.946 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-31T01:57:06.946 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.8 M 2023-08-31T01:57:06.947 INFO:teuthology.orchestra.run.smithi170.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-31T01:57:06.947 INFO:teuthology.orchestra.run.smithi170.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-31T01:57:06.947 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-31T01:57:06.947 INFO:teuthology.orchestra.run.smithi170.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-31T01:57:06.947 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-31T01:57:06.948 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-31T01:57:06.948 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-31T01:57:06.948 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-31T01:57:06.948 INFO:teuthology.orchestra.run.smithi170.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-31T01:57:06.948 INFO:teuthology.orchestra.run.smithi170.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-31T01:57:06.949 INFO:teuthology.orchestra.run.smithi170.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-31T01:57:06.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-31T01:57:06.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-31T01:57:06.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-31T01:57:06.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-31T01:57:06.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-31T01:57:06.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 45 k 2023-08-31T01:57:06.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 125 k 2023-08-31T01:57:06.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-31T01:57:06.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-31T01:57:06.951 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-31T01:57:06.951 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-31T01:57:06.951 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-31T01:57:06.951 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-31T01:57:06.951 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-31T01:57:06.952 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-31T01:57:06.952 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-31T01:57:06.952 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-31T01:57:06.952 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-31T01:57:06.952 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T01:57:06.953 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-31T01:57:06.953 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-31T01:57:06.953 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-31T01:57:06.953 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-31T01:57:06.953 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-31T01:57:06.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-31T01:57:06.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-31T01:57:06.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-31T01:57:06.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-31T01:57:06.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-31T01:57:06.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-31T01:57:06.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-31T01:57:06.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-31T01:57:06.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-31T01:57:06.956 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-31T01:57:06.956 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-31T01:57:06.956 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-31T01:57:06.956 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-31T01:57:06.956 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T01:57:06.957 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-31T01:57:06.957 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-31T01:57:06.957 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-31T01:57:06.957 INFO:teuthology.orchestra.run.smithi170.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-31T01:57:06.958 INFO:teuthology.orchestra.run.smithi170.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-31T01:57:06.958 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-31T01:57:06.958 INFO:teuthology.orchestra.run.smithi170.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-31T01:57:06.958 INFO:teuthology.orchestra.run.smithi170.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-31T01:57:06.958 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-31T01:57:06.959 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-31T01:57:06.959 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-31T01:57:06.959 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-31T01:57:06.959 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-31T01:57:06.960 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-31T01:57:06.960 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-31T01:57:06.960 INFO:teuthology.orchestra.run.smithi170.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-31T01:57:06.960 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-31T01:57:06.960 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-31T01:57:06.961 INFO:teuthology.orchestra.run.smithi170.stdout:Enabling module streams: 2023-08-31T01:57:06.961 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql 10 2023-08-31T01:57:06.961 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:57:06.961 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2023-08-31T01:57:06.962 INFO:teuthology.orchestra.run.smithi170.stdout:=========================================================================================================================== 2023-08-31T01:57:06.962 INFO:teuthology.orchestra.run.smithi170.stdout:Install 128 Packages 2023-08-31T01:57:06.962 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 3 Packages 2023-08-31T01:57:06.962 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:57:06.963 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 206 M 2023-08-31T01:57:06.963 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2023-08-31T01:57:06.997 INFO:teuthology.orchestra.run.smithi084.stdout:(1/131): ceph-18.0.0-5814.gcc14fc8a.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2023-08-31T01:57:07.615 INFO:teuthology.orchestra.run.smithi170.stdout:(1/131): ceph-18.0.0-5814.gcc14fc8a.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-08-31T01:57:07.630 INFO:teuthology.orchestra.run.smithi084.stdout:(2/131): ceph-fuse-18.0.0-5814.gcc14fc8a.el8.x8 1.3 MB/s | 861 kB 00:00 2023-08-31T01:57:07.830 INFO:teuthology.orchestra.run.smithi084.stdout:(3/131): ceph-immutable-object-cache-18.0.0-581 836 kB/s | 167 kB 00:00 2023-08-31T01:57:08.022 INFO:teuthology.orchestra.run.smithi084.stdout:(4/131): ceph-base-18.0.0-5814.gcc14fc8a.el8.x8 4.4 MB/s | 5.4 MB 00:01 2023-08-31T01:57:08.265 INFO:teuthology.orchestra.run.smithi084.stdout:(5/131): ceph-common-18.0.0-5814.gcc14fc8a.el8. 15 MB/s | 22 MB 00:01 2023-08-31T01:57:08.306 INFO:teuthology.orchestra.run.smithi084.stdout:(6/131): ceph-mgr-18.0.0-5814.gcc14fc8a.el8.x86 5.5 MB/s | 1.6 MB 00:00 2023-08-31T01:57:08.832 INFO:teuthology.orchestra.run.smithi084.stdout:(7/131): ceph-mon-18.0.0-5814.gcc14fc8a.el8.x86 8.1 MB/s | 4.6 MB 00:00 2023-08-31T01:57:09.016 INFO:teuthology.orchestra.run.smithi084.stdout:(8/131): ceph-mds-18.0.0-5814.gcc14fc8a.el8.x86 1.9 MB/s | 2.3 MB 00:01 2023-08-31T01:57:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:(2/131): ceph-fuse-18.0.0-5814.gcc14fc8a.el8.x8 591 kB/s | 861 kB 00:01 2023-08-31T01:57:09.115 INFO:teuthology.orchestra.run.smithi084.stdout:(9/131): ceph-selinux-18.0.0-5814.gcc14fc8a.el8 243 kB/s | 24 kB 00:00 2023-08-31T01:57:09.324 INFO:teuthology.orchestra.run.smithi170.stdout:(3/131): ceph-immutable-object-cache-18.0.0-581 669 kB/s | 167 kB 00:00 2023-08-31T01:57:10.133 INFO:teuthology.orchestra.run.smithi170.stdout:(4/131): ceph-common-18.0.0-5814.gcc14fc8a.el8. 7.9 MB/s | 22 MB 00:02 2023-08-31T01:57:10.325 INFO:teuthology.orchestra.run.smithi170.stdout:(5/131): ceph-mgr-18.0.0-5814.gcc14fc8a.el8.x86 8.2 MB/s | 1.6 MB 00:00 2023-08-31T01:57:10.549 INFO:teuthology.orchestra.run.smithi084.stdout:(10/131): ceph-radosgw-18.0.0-5814.gcc14fc8a.el 7.9 MB/s | 14 MB 00:01 2023-08-31T01:57:10.641 INFO:teuthology.orchestra.run.smithi084.stdout:(11/131): cephfs-mirror-18.0.0-5814.gcc14fc8a.e 2.8 MB/s | 260 kB 00:00 2023-08-31T01:57:10.691 INFO:teuthology.orchestra.run.smithi084.stdout:(12/131): libcephfs-devel-18.0.0-5814.gcc14fc8a 624 kB/s | 31 kB 00:00 2023-08-31T01:57:10.717 INFO:teuthology.orchestra.run.smithi170.stdout:(6/131): ceph-mon-18.0.0-5814.gcc14fc8a.el8.x86 12 MB/s | 4.6 MB 00:00 2023-08-31T01:57:10.875 INFO:teuthology.orchestra.run.smithi084.stdout:(13/131): ceph-osd-18.0.0-5814.gcc14fc8a.el8.x8 6.9 MB/s | 18 MB 00:02 2023-08-31T01:57:10.917 INFO:teuthology.orchestra.run.smithi084.stdout:(14/131): libcephfs2-18.0.0-5814.gcc14fc8a.el8. 3.4 MB/s | 784 kB 00:00 2023-08-31T01:57:10.942 INFO:teuthology.orchestra.run.smithi084.stdout:(15/131): libcephsqlite-18.0.0-5814.gcc14fc8a.e 2.0 MB/s | 139 kB 00:00 2023-08-31T01:57:10.950 INFO:teuthology.orchestra.run.smithi170.stdout:(7/131): ceph-mds-18.0.0-5814.gcc14fc8a.el8.x86 1.4 MB/s | 2.3 MB 00:01 2023-08-31T01:57:10.967 INFO:teuthology.orchestra.run.smithi084.stdout:(16/131): librados-devel-18.0.0-5814.gcc14fc8a. 2.7 MB/s | 139 kB 00:00 2023-08-31T01:57:11.018 INFO:teuthology.orchestra.run.smithi084.stdout:(17/131): libradosstriper1-18.0.0-5814.gcc14fc8 6.1 MB/s | 472 kB 00:00 2023-08-31T01:57:11.109 INFO:teuthology.orchestra.run.smithi084.stdout:(18/131): python3-ceph-argparse-18.0.0-5814.gcc 487 kB/s | 45 kB 00:00 2023-08-31T01:57:11.210 INFO:teuthology.orchestra.run.smithi084.stdout:(19/131): python3-ceph-common-18.0.0-5814.gcc14 1.2 MB/s | 125 kB 00:00 2023-08-31T01:57:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:(20/131): python3-cephfs-18.0.0-5814.gcc14fc8a. 1.9 MB/s | 196 kB 00:00 2023-08-31T01:57:11.418 INFO:teuthology.orchestra.run.smithi084.stdout:(21/131): python3-rados-18.0.0-5814.gcc14fc8a.e 3.3 MB/s | 370 kB 00:00 2023-08-31T01:57:11.527 INFO:teuthology.orchestra.run.smithi084.stdout:(22/131): python3-rbd-18.0.0-5814.gcc14fc8a.el8 3.3 MB/s | 364 kB 00:00 2023-08-31T01:57:11.636 INFO:teuthology.orchestra.run.smithi084.stdout:(23/131): python3-rgw-18.0.0-5814.gcc14fc8a.el8 983 kB/s | 107 kB 00:00 2023-08-31T01:57:11.753 INFO:teuthology.orchestra.run.smithi084.stdout:(24/131): librgw2-18.0.0-5814.gcc14fc8a.el8.x86 8.7 MB/s | 6.8 MB 00:00 2023-08-31T01:57:11.778 INFO:teuthology.orchestra.run.smithi084.stdout:(25/131): rbd-fuse-18.0.0-5814.gcc14fc8a.el8.x8 658 kB/s | 94 kB 00:00 2023-08-31T01:57:11.879 INFO:teuthology.orchestra.run.smithi084.stdout:(26/131): rbd-nbd-18.0.0-5814.gcc14fc8a.el8.x86 1.7 MB/s | 179 kB 00:00 2023-08-31T01:57:11.987 INFO:teuthology.orchestra.run.smithi084.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5814.g 213 kB/s | 23 kB 00:00 2023-08-31T01:57:12.087 INFO:teuthology.orchestra.run.smithi084.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5814.gcc14fc8 1.3 MB/s | 132 kB 00:00 2023-08-31T01:57:12.196 INFO:teuthology.orchestra.run.smithi084.stdout:(29/131): rbd-mirror-18.0.0-5814.gcc14fc8a.el8. 8.0 MB/s | 3.5 MB 00:00 2023-08-31T01:57:12.309 INFO:teuthology.orchestra.run.smithi170.stdout:(8/131): ceph-osd-18.0.0-5814.gcc14fc8a.el8.x86 11 MB/s | 18 MB 00:01 2023-08-31T01:57:12.323 INFO:teuthology.orchestra.run.smithi084.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5814.gcc14f 7.5 MB/s | 1.7 MB 00:00 2023-08-31T01:57:12.369 INFO:teuthology.orchestra.run.smithi170.stdout:(9/131): ceph-selinux-18.0.0-5814.gcc14fc8a.el8 420 kB/s | 24 kB 00:00 2023-08-31T01:57:12.405 INFO:teuthology.orchestra.run.smithi084.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5814.gcc 2.8 MB/s | 242 kB 00:00 2023-08-31T01:57:12.522 INFO:teuthology.orchestra.run.smithi084.stdout:(32/131): ceph-mgr-rook-18.0.0-5814.gcc14fc8a.e 406 kB/s | 47 kB 00:00 2023-08-31T01:57:12.622 INFO:teuthology.orchestra.run.smithi084.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5814.gc 145 kB/s | 15 kB 00:00 2023-08-31T01:57:12.739 INFO:teuthology.orchestra.run.smithi084.stdout:(34/131): ceph-volume-18.0.0-5814.gcc14fc8a.el8 2.2 MB/s | 261 kB 00:00 2023-08-31T01:57:12.848 INFO:teuthology.orchestra.run.smithi084.stdout:(35/131): cephadm-18.0.0-5814.gcc14fc8a.el8.noa 1.5 MB/s | 171 kB 00:00 2023-08-31T01:57:12.956 INFO:teuthology.orchestra.run.smithi084.stdout:(36/131): ceph-mgr-diskprediction-local-18.0.0- 9.7 MB/s | 7.4 MB 00:00 2023-08-31T01:57:12.981 INFO:teuthology.orchestra.run.smithi084.stdout:(37/131): cephfs-top-18.0.0-5814.gcc14fc8a.el8. 134 kB/s | 18 kB 00:00 2023-08-31T01:57:13.340 INFO:teuthology.orchestra.run.smithi084.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 164 kB/s | 59 kB 00:00 2023-08-31T01:57:13.540 INFO:teuthology.orchestra.run.smithi084.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 375 kB/s | 75 kB 00:00 2023-08-31T01:57:13.601 INFO:teuthology.orchestra.run.smithi084.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 477 kB/s | 306 kB 00:00 2023-08-31T01:57:13.716 INFO:teuthology.orchestra.run.smithi084.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-08-31T01:57:13.851 INFO:teuthology.orchestra.run.smithi084.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-08-31T01:57:13.875 INFO:teuthology.orchestra.run.smithi084.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-08-31T01:57:13.959 INFO:teuthology.orchestra.run.smithi084.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2023-08-31T01:57:13.984 INFO:teuthology.orchestra.run.smithi084.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-08-31T01:57:14.043 INFO:teuthology.orchestra.run.smithi170.stdout:(10/131): ceph-base-18.0.0-5814.gcc14fc8a.el8.x 821 kB/s | 5.4 MB 00:06 2023-08-31T01:57:14.076 INFO:teuthology.orchestra.run.smithi084.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-08-31T01:57:14.151 INFO:teuthology.orchestra.run.smithi084.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.3 MB/s | 384 kB 00:00 2023-08-31T01:57:14.202 INFO:teuthology.orchestra.run.smithi084.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 649 kB/s | 81 kB 00:00 2023-08-31T01:57:14.218 INFO:teuthology.orchestra.run.smithi170.stdout:(11/131): cephfs-mirror-18.0.0-5814.gcc14fc8a.e 1.5 MB/s | 260 kB 00:00 2023-08-31T01:57:14.252 INFO:teuthology.orchestra.run.smithi084.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 110 kB/s | 11 kB 00:00 2023-08-31T01:57:14.285 INFO:teuthology.orchestra.run.smithi170.stdout:(12/131): libcephfs-devel-18.0.0-5814.gcc14fc8a 467 kB/s | 31 kB 00:00 2023-08-31T01:57:14.302 INFO:teuthology.orchestra.run.smithi084.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-08-31T01:57:14.402 INFO:teuthology.orchestra.run.smithi084.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2023-08-31T01:57:14.511 INFO:teuthology.orchestra.run.smithi084.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2023-08-31T01:57:14.528 INFO:teuthology.orchestra.run.smithi084.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 469 kB/s | 59 kB 00:00 2023-08-31T01:57:14.604 INFO:teuthology.orchestra.run.smithi084.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 656 kB/s | 60 kB 00:00 2023-08-31T01:57:14.654 INFO:teuthology.orchestra.run.smithi084.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-08-31T01:57:14.696 INFO:teuthology.orchestra.run.smithi084.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-08-31T01:57:14.719 INFO:teuthology.orchestra.run.smithi170.stdout:(13/131): libcephfs2-18.0.0-5814.gcc14fc8a.el8. 1.8 MB/s | 784 kB 00:00 2023-08-31T01:57:14.746 INFO:teuthology.orchestra.run.smithi084.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2023-08-31T01:57:14.813 INFO:teuthology.orchestra.run.smithi084.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-08-31T01:57:14.835 INFO:teuthology.orchestra.run.smithi170.stdout:(14/131): libcephsqlite-18.0.0-5814.gcc14fc8a.e 1.2 MB/s | 139 kB 00:00 2023-08-31T01:57:14.846 INFO:teuthology.orchestra.run.smithi084.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 640 kB/s | 64 kB 00:00 2023-08-31T01:57:14.913 INFO:teuthology.orchestra.run.smithi084.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-08-31T01:57:14.953 INFO:teuthology.orchestra.run.smithi170.stdout:(15/131): librados-devel-18.0.0-5814.gcc14fc8a. 1.2 MB/s | 139 kB 00:00 2023-08-31T01:57:14.956 INFO:teuthology.orchestra.run.smithi084.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2023-08-31T01:57:15.014 INFO:teuthology.orchestra.run.smithi084.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 292 kB/s | 29 kB 00:00 2023-08-31T01:57:15.056 INFO:teuthology.orchestra.run.smithi084.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-08-31T01:57:15.115 INFO:teuthology.orchestra.run.smithi084.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-08-31T01:57:15.181 INFO:teuthology.orchestra.run.smithi084.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-08-31T01:57:15.215 INFO:teuthology.orchestra.run.smithi084.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 611 kB/s | 61 kB 00:00 2023-08-31T01:57:15.228 INFO:teuthology.orchestra.run.smithi170.stdout:(16/131): libradosstriper1-18.0.0-5814.gcc14fc8 1.7 MB/s | 472 kB 00:00 2023-08-31T01:57:15.290 INFO:teuthology.orchestra.run.smithi084.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 786 kB/s | 85 kB 00:00 2023-08-31T01:57:15.316 INFO:teuthology.orchestra.run.smithi084.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-08-31T01:57:15.341 INFO:teuthology.orchestra.run.smithi084.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-08-31T01:57:15.395 INFO:teuthology.orchestra.run.smithi170.stdout:(17/131): ceph-radosgw-18.0.0-5814.gcc14fc8a.el 3.1 MB/s | 14 MB 00:04 2023-08-31T01:57:15.649 INFO:teuthology.orchestra.run.smithi084.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 44 MB/s | 14 MB 00:00 2023-08-31T01:57:15.683 INFO:teuthology.orchestra.run.smithi084.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 4.4 MB/s | 1.7 MB 00:00 2023-08-31T01:57:15.709 INFO:teuthology.orchestra.run.smithi084.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-08-31T01:57:15.759 INFO:teuthology.orchestra.run.smithi084.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 719 kB/s | 54 kB 00:00 2023-08-31T01:57:15.784 INFO:teuthology.orchestra.run.smithi084.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.6 MB/s | 259 kB 00:00 2023-08-31T01:57:15.809 INFO:teuthology.orchestra.run.smithi084.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-08-31T01:57:15.834 INFO:teuthology.orchestra.run.smithi084.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 771 kB/s | 39 kB 00:00 2023-08-31T01:57:15.845 INFO:teuthology.orchestra.run.smithi170.stdout:(18/131): ceph-test-18.0.0-5814.gcc14fc8a.el8.x 14 MB/s | 48 MB 00:03 2023-08-31T01:57:15.868 INFO:teuthology.orchestra.run.smithi084.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-08-31T01:57:15.870 INFO:teuthology.orchestra.run.smithi170.stdout:(19/131): python3-ceph-argparse-18.0.0-5814.gcc 94 kB/s | 45 kB 00:00 2023-08-31T01:57:15.896 INFO:teuthology.orchestra.run.smithi170.stdout:(20/131): python3-ceph-common-18.0.0-5814.gcc14 2.5 MB/s | 125 kB 00:00 2023-08-31T01:57:15.901 INFO:teuthology.orchestra.run.smithi084.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-08-31T01:57:15.928 INFO:teuthology.orchestra.run.smithi084.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-08-31T01:57:15.952 INFO:teuthology.orchestra.run.smithi084.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-08-31T01:57:15.963 INFO:teuthology.orchestra.run.smithi170.stdout:(21/131): python3-cephfs-18.0.0-5814.gcc14fc8a. 2.1 MB/s | 196 kB 00:00 2023-08-31T01:57:15.986 INFO:teuthology.orchestra.run.smithi084.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-08-31T01:57:15.996 INFO:teuthology.orchestra.run.smithi170.stdout:(22/131): python3-rados-18.0.0-5814.gcc14fc8a.e 3.6 MB/s | 370 kB 00:00 2023-08-31T01:57:16.028 INFO:teuthology.orchestra.run.smithi084.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 638 kB/s | 27 kB 00:00 2023-08-31T01:57:16.063 INFO:teuthology.orchestra.run.smithi170.stdout:(23/131): python3-rgw-18.0.0-5814.gcc14fc8a.el8 1.6 MB/s | 107 kB 00:00 2023-08-31T01:57:16.088 INFO:teuthology.orchestra.run.smithi170.stdout:(24/131): python3-rbd-18.0.0-5814.gcc14fc8a.el8 2.8 MB/s | 364 kB 00:00 2023-08-31T01:57:16.112 INFO:teuthology.orchestra.run.smithi084.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 30 MB/s | 4.8 MB 00:00 2023-08-31T01:57:16.122 INFO:teuthology.orchestra.run.smithi170.stdout:(25/131): rbd-fuse-18.0.0-5814.gcc14fc8a.el8.x8 1.6 MB/s | 94 kB 00:00 2023-08-31T01:57:16.137 INFO:teuthology.orchestra.run.smithi084.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.9 MB/s | 320 kB 00:00 2023-08-31T01:57:16.162 INFO:teuthology.orchestra.run.smithi084.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 875 kB/s | 44 kB 00:00 2023-08-31T01:57:16.181 INFO:teuthology.orchestra.run.smithi170.stdout:(26/131): rbd-nbd-18.0.0-5814.gcc14fc8a.el8.x86 3.0 MB/s | 179 kB 00:00 2023-08-31T01:57:16.229 INFO:teuthology.orchestra.run.smithi084.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2023-08-31T01:57:16.239 INFO:teuthology.orchestra.run.smithi170.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5814.g 396 kB/s | 23 kB 00:00 2023-08-31T01:57:16.288 INFO:teuthology.orchestra.run.smithi084.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 25 MB/s | 3.7 MB 00:00 2023-08-31T01:57:16.298 INFO:teuthology.orchestra.run.smithi170.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5814.gcc14fc8 2.2 MB/s | 132 kB 00:00 2023-08-31T01:57:16.313 INFO:teuthology.orchestra.run.smithi084.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.6 MB/s | 225 kB 00:00 2023-08-31T01:57:16.338 INFO:teuthology.orchestra.run.smithi084.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-08-31T01:57:16.363 INFO:teuthology.orchestra.run.smithi084.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-08-31T01:57:16.381 INFO:teuthology.orchestra.run.smithi084.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 475 kB/s | 20 kB 00:00 2023-08-31T01:57:16.406 INFO:teuthology.orchestra.run.smithi084.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-08-31T01:57:16.448 INFO:teuthology.orchestra.run.smithi084.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-08-31T01:57:16.481 INFO:teuthology.orchestra.run.smithi170.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5814.gcc14f 9.5 MB/s | 1.7 MB 00:00 2023-08-31T01:57:16.498 INFO:teuthology.orchestra.run.smithi084.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-08-31T01:57:16.582 INFO:teuthology.orchestra.run.smithi084.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 28 MB/s | 4.9 MB 00:00 2023-08-31T01:57:16.682 INFO:teuthology.orchestra.run.smithi084.stdout:(96/131): openblas-0.3.15-3.el8.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2023-08-31T01:57:16.707 INFO:teuthology.orchestra.run.smithi084.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2023-08-31T01:57:16.800 INFO:teuthology.orchestra.run.smithi084.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.9 MB/s | 354 kB 00:00 2023-08-31T01:57:16.807 INFO:teuthology.orchestra.run.smithi170.stdout:(30/131): rbd-mirror-18.0.0-5814.gcc14fc8a.el8. 4.9 MB/s | 3.5 MB 00:00 2023-08-31T01:57:16.899 INFO:teuthology.orchestra.run.smithi170.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5814.gcc 2.6 MB/s | 242 kB 00:00 2023-08-31T01:57:16.899 INFO:teuthology.orchestra.run.smithi084.stdout:(99/131): postgresql-server-10.21-2.module+el8. 26 MB/s | 5.1 MB 00:00 2023-08-31T01:57:16.933 INFO:teuthology.orchestra.run.smithi084.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.0 MB/s | 808 kB 00:00 2023-08-31T01:57:16.949 INFO:teuthology.orchestra.run.smithi170.stdout:(32/131): ceph-mgr-rook-18.0.0-5814.gcc14fc8a.e 951 kB/s | 47 kB 00:00 2023-08-31T01:57:16.984 INFO:teuthology.orchestra.run.smithi084.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-08-31T01:57:17.034 INFO:teuthology.orchestra.run.smithi084.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 467 kB/s | 47 kB 00:00 2023-08-31T01:57:17.050 INFO:teuthology.orchestra.run.smithi170.stdout:(33/131): ceph-mgr-diskprediction-local-18.0.0- 13 MB/s | 7.4 MB 00:00 2023-08-31T01:57:17.075 INFO:teuthology.orchestra.run.smithi170.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5814.gc 116 kB/s | 15 kB 00:00 2023-08-31T01:57:17.092 INFO:teuthology.orchestra.run.smithi084.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.8 MB/s | 200 kB 00:00 2023-08-31T01:57:17.134 INFO:teuthology.orchestra.run.smithi084.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 425 kB/s | 43 kB 00:00 2023-08-31T01:57:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:(35/131): ceph-volume-18.0.0-5814.gcc14fc8a.el8 2.5 MB/s | 261 kB 00:00 2023-08-31T01:57:17.160 INFO:teuthology.orchestra.run.smithi084.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-08-31T01:57:17.176 INFO:teuthology.orchestra.run.smithi170.stdout:(36/131): cephadm-18.0.0-5814.gcc14fc8a.el8.noa 1.7 MB/s | 171 kB 00:00 2023-08-31T01:57:17.193 INFO:teuthology.orchestra.run.smithi084.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 821 kB/s | 48 kB 00:00 2023-08-31T01:57:17.201 INFO:teuthology.orchestra.run.smithi170.stdout:(37/131): cephfs-top-18.0.0-5814.gcc14fc8a.el8. 358 kB/s | 18 kB 00:00 2023-08-31T01:57:17.210 INFO:teuthology.orchestra.run.smithi084.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-08-31T01:57:17.327 INFO:teuthology.orchestra.run.smithi084.stdout:(108/131): python3-pycparser-2.14-14.el8.noarch 932 kB/s | 109 kB 00:00 2023-08-31T01:57:17.353 INFO:teuthology.orchestra.run.smithi084.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 268 kB/s | 43 kB 00:00 2023-08-31T01:57:17.420 INFO:teuthology.orchestra.run.smithi084.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-08-31T01:57:17.470 INFO:teuthology.orchestra.run.smithi084.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.7 MB/s | 560 kB 00:00 2023-08-31T01:57:17.497 INFO:teuthology.orchestra.run.smithi084.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 248 kB/s | 19 kB 00:00 2023-08-31T01:57:17.520 INFO:teuthology.orchestra.run.smithi084.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-08-31T01:57:17.562 INFO:teuthology.orchestra.run.smithi084.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 8.2 MB/s | 559 kB 00:00 2023-08-31T01:57:17.568 INFO:teuthology.orchestra.run.smithi170.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 160 kB/s | 59 kB 00:00 2023-08-31T01:57:17.588 INFO:teuthology.orchestra.run.smithi084.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 268 kB/s | 18 kB 00:00 2023-08-31T01:57:17.621 INFO:teuthology.orchestra.run.smithi084.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-08-31T01:57:17.646 INFO:teuthology.orchestra.run.smithi084.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-08-31T01:57:17.727 INFO:teuthology.orchestra.run.smithi170.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 556 kB/s | 306 kB 00:00 2023-08-31T01:57:17.805 INFO:teuthology.orchestra.run.smithi084.stdout:(118/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2023-08-31T01:57:17.822 INFO:teuthology.orchestra.run.smithi084.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 412 kB/s | 72 kB 00:00 2023-08-31T01:57:17.835 INFO:teuthology.orchestra.run.smithi170.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 281 kB/s | 75 kB 00:00 2023-08-31T01:57:17.881 INFO:teuthology.orchestra.run.smithi084.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-08-31T01:57:17.914 INFO:teuthology.orchestra.run.smithi084.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 651 kB/s | 60 kB 00:00 2023-08-31T01:57:17.965 INFO:teuthology.orchestra.run.smithi084.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.1 MB/s | 98 kB 00:00 2023-08-31T01:57:17.982 INFO:teuthology.orchestra.run.smithi084.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 859 kB/s | 58 kB 00:00 2023-08-31T01:57:18.011 INFO:teuthology.orchestra.run.smithi170.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.6 MB/s | 476 kB 00:00 2023-08-31T01:57:18.036 INFO:teuthology.orchestra.run.smithi170.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 218 kB/s | 44 kB 00:00 2023-08-31T01:57:18.107 INFO:teuthology.orchestra.run.smithi084.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 272 kB/s | 39 kB 00:00 2023-08-31T01:57:18.111 INFO:teuthology.orchestra.run.smithi170.stdout:(43/131): librgw2-18.0.0-5814.gcc14fc8a.el8.x86 2.4 MB/s | 6.8 MB 00:02 2023-08-31T01:57:18.137 INFO:teuthology.orchestra.run.smithi170.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-08-31T01:57:18.149 INFO:teuthology.orchestra.run.smithi084.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.8 MB/s | 644 kB 00:00 2023-08-31T01:57:18.154 INFO:teuthology.orchestra.run.smithi170.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-08-31T01:57:18.233 INFO:teuthology.orchestra.run.smithi084.stdout:(126/131): NetworkManager-initscripts-updown-1. 1.6 MB/s | 138 kB 00:00 2023-08-31T01:57:18.246 INFO:teuthology.orchestra.run.smithi170.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-08-31T01:57:18.258 INFO:teuthology.orchestra.run.smithi084.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.1 MB/s | 171 kB 00:00 2023-08-31T01:57:18.362 INFO:teuthology.orchestra.run.smithi170.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 697 kB/s | 81 kB 00:00 2023-08-31T01:57:18.380 INFO:teuthology.orchestra.run.smithi170.stdout:(48/131): python3-certifi-2018.10.15-7.el8.noar 61 kB/s | 16 kB 00:00 2023-08-31T01:57:18.430 INFO:teuthology.orchestra.run.smithi170.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.4 MB/s | 384 kB 00:00 2023-08-31T01:57:18.471 INFO:teuthology.orchestra.run.smithi170.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-08-31T01:57:18.497 INFO:teuthology.orchestra.run.smithi170.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 150 kB/s | 18 kB 00:00 2023-08-31T01:57:18.580 INFO:teuthology.orchestra.run.smithi170.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 448 kB/s | 49 kB 00:00 2023-08-31T01:57:18.616 INFO:teuthology.orchestra.run.smithi084.stdout:(128/131): librbd1-18.0.0-5814.gcc14fc8a.el8.x8 10 MB/s | 3.6 MB 00:00 2023-08-31T01:57:18.689 INFO:teuthology.orchestra.run.smithi170.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 306 kB/s | 59 kB 00:00 2023-08-31T01:57:18.714 INFO:teuthology.orchestra.run.smithi170.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 451 kB/s | 60 kB 00:00 2023-08-31T01:57:18.748 INFO:teuthology.orchestra.run.smithi170.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 3.7 MB/s | 1.2 MB 00:00 2023-08-31T01:57:18.823 INFO:teuthology.orchestra.run.smithi170.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-08-31T01:57:18.833 INFO:teuthology.orchestra.run.smithi084.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 3.6 MB/s | 798 kB 00:00 2023-08-31T01:57:18.857 INFO:teuthology.orchestra.run.smithi170.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 310 kB/s | 34 kB 00:00 2023-08-31T01:57:18.892 INFO:teuthology.orchestra.run.smithi084.stdout:(130/131): librados2-18.0.0-5814.gcc14fc8a.el8. 5.6 MB/s | 3.7 MB 00:00 2023-08-31T01:57:18.932 INFO:teuthology.orchestra.run.smithi170.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-08-31T01:57:18.968 INFO:teuthology.orchestra.run.smithi170.stdout:(59/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-08-31T01:57:19.000 INFO:teuthology.orchestra.run.smithi170.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 451 kB/s | 64 kB 00:00 2023-08-31T01:57:19.042 INFO:teuthology.orchestra.run.smithi170.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 171 kB/s | 19 kB 00:00 2023-08-31T01:57:19.076 INFO:teuthology.orchestra.run.smithi170.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 219 kB/s | 24 kB 00:00 2023-08-31T01:57:19.109 INFO:teuthology.orchestra.run.smithi170.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 268 kB/s | 29 kB 00:00 2023-08-31T01:57:19.151 INFO:teuthology.orchestra.run.smithi170.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2023-08-31T01:57:19.184 INFO:teuthology.orchestra.run.smithi170.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-08-31T01:57:19.218 INFO:teuthology.orchestra.run.smithi170.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-08-31T01:57:19.270 INFO:teuthology.orchestra.run.smithi170.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 522 kB/s | 61 kB 00:00 2023-08-31T01:57:19.293 INFO:teuthology.orchestra.run.smithi170.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 783 kB/s | 85 kB 00:00 2023-08-31T01:57:19.319 INFO:teuthology.orchestra.run.smithi170.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-08-31T01:57:19.336 INFO:teuthology.orchestra.run.smithi170.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 195 kB/s | 23 kB 00:00 2023-08-31T01:57:19.487 INFO:teuthology.orchestra.run.smithi170.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 734 kB/s | 110 kB 00:00 2023-08-31T01:57:19.578 INFO:teuthology.orchestra.run.smithi170.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 592 kB/s | 54 kB 00:00 2023-08-31T01:57:19.653 INFO:teuthology.orchestra.run.smithi170.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-08-31T01:57:19.720 INFO:teuthology.orchestra.run.smithi170.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 3.8 MB/s | 1.7 MB 00:00 2023-08-31T01:57:19.796 INFO:teuthology.orchestra.run.smithi170.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-08-31T01:57:19.909 INFO:teuthology.orchestra.run.smithi084.stdout:(131/131): ceph-test-18.0.0-5814.gcc14fc8a.el8. 4.5 MB/s | 48 MB 00:10 2023-08-31T01:57:19.912 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-08-31T01:57:19.912 INFO:teuthology.orchestra.run.smithi084.stdout:Total 16 MB/s | 206 MB 00:13 2023-08-31T01:57:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:(76/131): python3-scipy-1.0.0-21.module+el8.5.0 21 MB/s | 14 MB 00:00 2023-08-31T01:57:19.996 INFO:teuthology.orchestra.run.smithi170.stdout:(77/131): python3-markupsafe-0.23-19.el8.x86_64 141 kB/s | 39 kB 00:00 2023-08-31T01:57:20.038 INFO:teuthology.orchestra.run.smithi170.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 2.8 MB/s | 688 kB 00:00 2023-08-31T01:57:20.097 INFO:teuthology.orchestra.run.smithi170.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-08-31T01:57:20.130 INFO:teuthology.orchestra.run.smithi170.stdout:(80/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.3 MB/s | 538 kB 00:00 2023-08-31T01:57:20.156 INFO:teuthology.orchestra.run.smithi170.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-08-31T01:57:20.281 INFO:teuthology.orchestra.run.smithi170.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 3.8 MB/s | 713 kB 00:00 2023-08-31T01:57:20.306 INFO:teuthology.orchestra.run.smithi170.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 177 kB/s | 27 kB 00:00 2023-08-31T01:57:20.415 INFO:teuthology.orchestra.run.smithi170.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-08-31T01:57:20.434 INFO:teuthology.orchestra.run.smithi170.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 351 kB/s | 44 kB 00:00 2023-08-31T01:57:20.499 INFO:teuthology.orchestra.run.smithi170.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-08-31T01:57:20.532 INFO:teuthology.orchestra.run.smithi170.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2023-08-31T01:57:20.599 INFO:teuthology.orchestra.run.smithi170.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-08-31T01:57:20.625 INFO:teuthology.orchestra.run.smithi170.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 694 kB/s | 64 kB 00:00 2023-08-31T01:57:20.675 INFO:teuthology.orchestra.run.smithi170.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2023-08-31T01:57:20.700 INFO:teuthology.orchestra.run.smithi170.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 266 kB/s | 20 kB 00:00 2023-08-31T01:57:20.758 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-08-31T01:57:20.767 INFO:teuthology.orchestra.run.smithi170.stdout:(92/131): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2023-08-31T01:57:20.793 INFO:teuthology.orchestra.run.smithi170.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 883 kB/s | 103 kB 00:00 2023-08-31T01:57:20.826 INFO:teuthology.orchestra.run.smithi170.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-08-31T01:57:20.852 INFO:teuthology.orchestra.run.smithi170.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-08-31T01:57:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-08-31T01:57:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-08-31T01:57:20.918 INFO:teuthology.orchestra.run.smithi170.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-08-31T01:57:20.994 INFO:teuthology.orchestra.run.smithi170.stdout:(97/131): openblas-threads-0.3.15-3.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-08-31T01:57:21.035 INFO:teuthology.orchestra.run.smithi170.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-08-31T01:57:21.103 INFO:teuthology.orchestra.run.smithi170.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-08-31T01:57:21.136 INFO:teuthology.orchestra.run.smithi170.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-08-31T01:57:21.195 INFO:teuthology.orchestra.run.smithi170.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-08-31T01:57:21.220 INFO:teuthology.orchestra.run.smithi170.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 560 kB/s | 47 kB 00:00 2023-08-31T01:57:21.245 INFO:teuthology.orchestra.run.smithi170.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-08-31T01:57:21.279 INFO:teuthology.orchestra.run.smithi170.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 727 kB/s | 43 kB 00:00 2023-08-31T01:57:21.304 INFO:teuthology.orchestra.run.smithi170.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-08-31T01:57:21.330 INFO:teuthology.orchestra.run.smithi170.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 955 kB/s | 48 kB 00:00 2023-08-31T01:57:21.413 INFO:teuthology.orchestra.run.smithi170.stdout:(107/131): postgresql-server-10.21-2.module+el8 12 MB/s | 5.1 MB 00:00 2023-08-31T01:57:21.438 INFO:teuthology.orchestra.run.smithi170.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 393 kB/s | 43 kB 00:00 2023-08-31T01:57:21.464 INFO:teuthology.orchestra.run.smithi170.stdout:(109/131): libsepol-devel-2.9-3.el8.x86_64.rpm 546 kB/s | 87 kB 00:00 2023-08-31T01:57:21.489 INFO:teuthology.orchestra.run.smithi170.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-08-31T01:57:21.514 INFO:teuthology.orchestra.run.smithi170.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-08-31T01:57:21.540 INFO:teuthology.orchestra.run.smithi170.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 371 kB/s | 19 kB 00:00 2023-08-31T01:57:21.565 INFO:teuthology.orchestra.run.smithi170.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-08-31T01:57:21.599 INFO:teuthology.orchestra.run.smithi170.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-08-31T01:57:21.624 INFO:teuthology.orchestra.run.smithi170.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 306 kB/s | 18 kB 00:00 2023-08-31T01:57:21.657 INFO:teuthology.orchestra.run.smithi170.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.6 MB/s | 559 kB 00:00 2023-08-31T01:57:21.710 INFO:teuthology.orchestra.run.smithi170.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-08-31T01:57:21.733 INFO:teuthology.orchestra.run.smithi170.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-08-31T01:57:21.759 INFO:teuthology.orchestra.run.smithi170.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-08-31T01:57:21.784 INFO:teuthology.orchestra.run.smithi170.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-08-31T01:57:21.801 INFO:teuthology.orchestra.run.smithi170.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-08-31T01:57:21.835 INFO:teuthology.orchestra.run.smithi170.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-08-31T01:57:21.860 INFO:teuthology.orchestra.run.smithi170.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 982 kB/s | 58 kB 00:00 2023-08-31T01:57:21.877 INFO:teuthology.orchestra.run.smithi170.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 923 kB/s | 39 kB 00:00 2023-08-31T01:57:21.919 INFO:teuthology.orchestra.run.smithi170.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-08-31T01:57:21.944 INFO:teuthology.orchestra.run.smithi170.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-08-31T01:57:21.969 INFO:teuthology.orchestra.run.smithi170.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-08-31T01:57:21.992 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-08-31T01:57:21.996 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-08-31T01:57:22.020 INFO:teuthology.orchestra.run.smithi170.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.4 MB/s | 2.3 MB 00:00 2023-08-31T01:57:22.095 INFO:teuthology.orchestra.run.smithi170.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-08-31T01:57:22.528 INFO:teuthology.orchestra.run.smithi170.stdout:(130/131): librados2-18.0.0-5814.gcc14fc8a.el8. 6.3 MB/s | 3.7 MB 00:00 2023-08-31T01:57:23.070 INFO:teuthology.orchestra.run.smithi170.stdout:(131/131): librbd1-18.0.0-5814.gcc14fc8a.el8.x8 3.3 MB/s | 3.6 MB 00:01 2023-08-31T01:57:23.073 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2023-08-31T01:57:23.074 INFO:teuthology.orchestra.run.smithi170.stdout:Total 13 MB/s | 206 MB 00:16 2023-08-31T01:57:23.924 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2023-08-31T01:57:24.044 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2023-08-31T01:57:24.044 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2023-08-31T01:57:25.164 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2023-08-31T01:57:25.168 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2023-08-31T01:57:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-08-31T01:57:27.257 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-31T01:57:27.423 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-31T01:57:27.615 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-31T01:57:27.759 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-31T01:57:27.868 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-31T01:57:28.059 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-31T01:57:28.456 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-31T01:57:28.684 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T01:57:29.079 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T01:57:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T01:57:29.419 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T01:57:29.708 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T01:57:29.807 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T01:57:30.001 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 9/134 2023-08-31T01:57:30.020 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2023-08-31T01:57:30.217 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-31T01:57:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-31T01:57:30.371 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-31T01:57:30.436 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-31T01:57:30.584 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-31T01:57:30.761 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-31T01:57:30.821 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-31T01:57:30.884 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-31T01:57:31.070 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-31T01:57:31.086 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-31T01:57:31.242 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T01:57:31.337 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T01:57:31.491 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-31T01:57:31.499 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T01:57:31.579 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T01:57:31.699 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-31T01:57:31.711 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T01:57:31.838 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-31T01:57:31.966 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-31T01:57:32.112 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T01:57:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T01:57:32.404 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T01:57:32.577 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-31T01:57:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T01:57:32.708 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T01:57:32.741 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-31T01:57:32.894 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 9/134 2023-08-31T01:57:33.139 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-31T01:57:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-31T01:57:33.372 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-31T01:57:33.525 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-31T01:57:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-31T01:57:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-31T01:57:34.217 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-31T01:57:34.394 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T01:57:34.481 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-31T01:57:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T01:57:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T01:57:34.752 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T01:57:34.901 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-31T01:57:34.913 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-31T01:57:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-31T01:57:35.103 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-31T01:57:35.202 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-31T01:57:35.271 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-31T01:57:35.473 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-31T01:57:35.693 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-31T01:57:35.806 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-31T01:57:35.880 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 26/134 2023-08-31T01:57:35.977 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-31T01:57:36.024 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 27/134 2023-08-31T01:57:36.571 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-31T01:57:36.760 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-31T01:57:36.960 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 28/134 2023-08-31T01:57:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-31T01:57:37.453 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-31T01:57:37.533 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-31T01:57:37.750 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-31T01:57:37.779 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-31T01:57:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-31T01:57:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-31T01:57:38.214 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-31T01:57:38.425 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-31T01:57:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-31T01:57:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-31T01:57:39.049 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 26/134 2023-08-31T01:57:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 27/134 2023-08-31T01:57:39.711 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-31T01:57:40.049 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-31T01:57:40.101 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 28/134 2023-08-31T01:57:40.433 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-31T01:57:40.612 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-31T01:57:40.720 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-31T01:57:40.800 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-31T01:57:40.978 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 36/134 2023-08-31T01:57:40.979 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-31T01:57:41.134 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 37/134 2023-08-31T01:57:41.217 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-31T01:57:41.306 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-31T01:57:41.498 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-31T01:57:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-31T01:57:41.792 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-31T01:57:42.004 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-31T01:57:42.211 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-31T01:57:42.553 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-31T01:57:42.843 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-31T01:57:42.981 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-31T01:57:43.040 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-31T01:57:43.252 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-31T01:57:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-31T01:57:43.460 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-31T01:57:43.512 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-31T01:57:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-31T01:57:43.756 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-31T01:57:43.900 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 36/134 2023-08-31T01:57:43.988 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-31T01:57:44.079 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 37/134 2023-08-31T01:57:44.206 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-31T01:57:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-31T01:57:44.423 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-31T01:57:44.451 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-31T01:57:44.619 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-31T01:57:44.678 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-31T01:57:44.766 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-31T01:57:44.828 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-31T01:57:45.038 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-31T01:57:45.057 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-31T01:57:45.253 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-31T01:57:45.344 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-31T01:57:45.576 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-31T01:57:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-31T01:57:45.794 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-31T01:57:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-31T01:57:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-31T01:57:46.132 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-31T01:57:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-31T01:57:46.329 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-31T01:57:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-31T01:57:46.399 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-31T01:57:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-31T01:57:46.633 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-31T01:57:46.824 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-31T01:57:46.928 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-31T01:57:46.979 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-31T01:57:47.061 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-31T01:57:47.183 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-31T01:57:47.250 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-31T01:57:47.351 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-31T01:57:47.430 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-31T01:57:47.579 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-31T01:57:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-31T01:57:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-31T01:57:47.796 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-31T01:57:47.961 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-31T01:57:48.067 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-31T01:57:48.294 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-31T01:57:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-31T01:57:48.442 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-31T01:57:48.565 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-31T01:57:48.599 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-31T01:57:48.796 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-31T01:57:48.807 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-31T01:57:49.026 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-31T01:57:49.031 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-31T01:57:49.199 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-31T01:57:49.206 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-31T01:57:49.372 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-31T01:57:49.382 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-31T01:57:49.518 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-31T01:57:49.600 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-31T01:57:49.657 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-31T01:57:49.710 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-31T01:57:49.891 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-31T01:57:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-31T01:57:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-31T01:57:50.120 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-31T01:57:50.299 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-31T01:57:50.328 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-31T01:57:50.386 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-31T01:57:50.569 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-31T01:57:50.622 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-31T01:57:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-31T01:57:50.792 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-31T01:57:50.983 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-31T01:57:50.997 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-31T01:57:51.147 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-31T01:57:51.433 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-31T01:57:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-31T01:57:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-31T01:57:51.986 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-31T01:57:52.093 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-31T01:57:52.185 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-31T01:57:52.340 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-31T01:57:52.429 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-31T01:57:52.570 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-31T01:57:52.636 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-31T01:57:52.810 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-31T01:57:52.855 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-31T01:57:52.947 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-31T01:57:53.099 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-31T01:57:53.188 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-31T01:57:53.293 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-31T01:57:53.386 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-31T01:57:53.571 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-31T01:57:53.889 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-31T01:57:54.115 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-31T01:57:54.124 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-31T01:57:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T01:57:54.298 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-31T01:57:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T01:57:54.520 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 93/134 2023-08-31T01:57:54.539 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-31T01:57:55.631 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-31T01:57:55.860 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-31T01:57:56.090 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-31T01:57:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-31T01:57:56.698 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-31T01:57:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-31T01:57:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-31T01:57:57.857 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T01:57:57.929 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T01:57:58.123 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 93/134 2023-08-31T01:57:58.183 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T01:57:58.394 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T01:57:58.992 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T01:57:59.278 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T01:57:59.345 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T01:57:59.486 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T01:58:01.825 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T01:58:02.065 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T01:58:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T01:58:02.979 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T01:58:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T01:58:03.206 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T01:58:17.792 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T01:58:17.793 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2023-08-31T01:58:17.793 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2023-08-31T01:58:17.793 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-08-31T01:58:17.793 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2023-08-31T01:58:17.793 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2023-08-31T01:58:17.794 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2023-08-31T01:58:17.794 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2023-08-31T01:58:17.794 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2023-08-31T01:58:17.794 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-08-31T01:58:17.794 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T01:58:19.731 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T01:58:19.915 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T01:58:20.134 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T01:58:20.280 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T01:58:20.750 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T01:58:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T01:58:20.947 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T01:58:21.873 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T01:58:21.873 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2023-08-31T01:58:21.873 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2023-08-31T01:58:21.874 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /dev 2023-08-31T01:58:21.874 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /run 2023-08-31T01:58:21.874 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2023-08-31T01:58:21.874 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2023-08-31T01:58:21.874 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2023-08-31T01:58:21.875 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2023-08-31T01:58:21.875 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /dev 2023-08-31T01:58:21.875 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:22.261 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T01:58:22.629 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T01:58:22.800 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T01:58:22.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 102/134 2023-08-31T01:58:23.095 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 103/134 2023-08-31T01:58:23.322 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T01:58:23.539 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T01:58:23.844 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T01:58:23.847 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T01:58:24.000 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T01:58:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T01:58:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T01:58:24.807 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T01:58:24.861 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T01:58:24.987 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T01:58:25.052 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T01:58:25.069 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T01:58:25.078 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T01:58:25.435 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 107/134 2023-08-31T01:58:25.622 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T01:58:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T01:58:25.870 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T01:58:25.881 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T01:58:26.825 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T01:58:27.044 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T01:58:27.158 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 102/134 2023-08-31T01:58:27.183 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 110/134 2023-08-31T01:58:27.334 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 103/134 2023-08-31T01:58:27.413 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T01:58:27.447 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T01:58:27.535 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T01:58:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T01:58:27.637 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T01:58:27.757 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T01:58:27.787 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T01:58:28.074 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T01:58:28.138 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T01:58:28.295 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T01:58:29.035 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T01:58:29.234 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T01:58:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T01:58:29.704 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 107/134 2023-08-31T01:58:29.950 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T01:58:29.985 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T01:58:30.160 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T01:58:30.171 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T01:58:31.476 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 110/134 2023-08-31T01:58:31.697 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T01:58:31.731 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T01:58:31.934 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T01:58:31.976 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T01:58:32.118 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T01:58:32.470 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T01:58:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T01:58:32.836 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T01:58:33.129 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 115/134 2023-08-31T01:58:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-31T01:58:33.477 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-31T01:58:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-31T01:58:34.693 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-31T01:58:34.864 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 119/134 2023-08-31T01:58:35.056 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-31T01:58:35.231 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 121/134 2023-08-31T01:58:35.403 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-31T01:58:37.194 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T01:58:37.481 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 115/134 2023-08-31T01:58:37.620 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T01:58:37.666 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-31T01:58:37.860 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T01:58:37.860 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-31T01:58:37.877 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T01:58:38.027 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 124/134 2023-08-31T01:58:38.292 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 125/134 2023-08-31T01:58:38.568 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 126/134 2023-08-31T01:58:38.757 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-31T01:58:38.920 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-31T01:58:39.084 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-31T01:58:39.093 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-31T01:58:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-31T01:58:39.275 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 119/134 2023-08-31T01:58:39.277 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-31T01:58:39.454 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-31T01:58:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-31T01:58:39.545 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-31T01:58:39.654 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 121/134 2023-08-31T01:58:39.735 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-31T01:58:39.747 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-31T01:58:39.747 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T01:58:39.809 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-31T01:58:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T01:58:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T01:58:40.131 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T01:58:40.332 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T01:58:40.832 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T01:58:40.833 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 1/134 2023-08-31T01:58:40.833 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2/134 2023-08-31T01:58:40.833 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 3/134 2023-08-31T01:58:40.834 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 4/134 2023-08-31T01:58:40.834 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 5/134 2023-08-31T01:58:40.834 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T01:58:40.834 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T01:58:40.834 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T01:58:40.835 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 9/134 2023-08-31T01:58:40.835 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 10/134 2023-08-31T01:58:40.835 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 11/134 2023-08-31T01:58:40.835 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 12/134 2023-08-31T01:58:40.835 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 13/134 2023-08-31T01:58:40.836 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 14/134 2023-08-31T01:58:40.836 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 15/134 2023-08-31T01:58:40.836 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 16/134 2023-08-31T01:58:40.836 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 17/134 2023-08-31T01:58:40.836 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 18/134 2023-08-31T01:58:40.837 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 19/134 2023-08-31T01:58:40.837 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 20/134 2023-08-31T01:58:40.837 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 21/134 2023-08-31T01:58:40.837 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 22/134 2023-08-31T01:58:40.837 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 23/134 2023-08-31T01:58:40.838 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 24/134 2023-08-31T01:58:40.838 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 25/134 2023-08-31T01:58:40.838 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 26/134 2023-08-31T01:58:40.838 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 27/134 2023-08-31T01:58:40.838 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 28/134 2023-08-31T01:58:40.839 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 29/134 2023-08-31T01:58:40.839 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 30/134 2023-08-31T01:58:40.848 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 31/134 2023-08-31T01:58:40.848 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 32/134 2023-08-31T01:58:40.849 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 33/134 2023-08-31T01:58:40.849 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 34/134 2023-08-31T01:58:40.849 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 35/134 2023-08-31T01:58:40.849 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 36/134 2023-08-31T01:58:40.850 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 37/134 2023-08-31T01:58:40.850 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 38/134 2023-08-31T01:58:40.850 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-31T01:58:40.850 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-31T01:58:40.850 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-31T01:58:40.851 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-31T01:58:40.851 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-31T01:58:40.851 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-31T01:58:40.851 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-31T01:58:40.853 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-31T01:58:40.853 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-31T01:58:40.853 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-31T01:58:40.853 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-31T01:58:40.854 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-31T01:58:40.854 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-31T01:58:40.854 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-31T01:58:40.854 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-31T01:58:40.854 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-31T01:58:40.855 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-31T01:58:40.855 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-31T01:58:40.855 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-31T01:58:40.855 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-31T01:58:40.855 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-31T01:58:40.856 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-31T01:58:40.856 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-31T01:58:40.856 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-31T01:58:40.856 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-31T01:58:40.856 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-31T01:58:40.857 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-31T01:58:40.857 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-31T01:58:40.857 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-31T01:58:40.857 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-31T01:58:40.857 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-31T01:58:40.858 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-31T01:58:40.858 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-31T01:58:40.858 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-31T01:58:40.858 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-31T01:58:40.858 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-31T01:58:40.859 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-31T01:58:40.859 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-31T01:58:40.859 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-31T01:58:40.859 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-31T01:58:40.859 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-31T01:58:40.860 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-31T01:58:40.860 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-31T01:58:40.860 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-31T01:58:40.860 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-31T01:58:40.860 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-31T01:58:40.861 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-31T01:58:40.861 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-31T01:58:40.861 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-31T01:58:40.861 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-31T01:58:40.861 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-31T01:58:40.862 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-31T01:58:40.862 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-31T01:58:40.862 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-31T01:58:40.862 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-31T01:58:40.862 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-31T01:58:40.863 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-31T01:58:40.863 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-31T01:58:40.863 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-31T01:58:40.863 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-31T01:58:40.863 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-31T01:58:40.864 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-31T01:58:40.864 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-31T01:58:40.864 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-31T01:58:40.864 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-31T01:58:40.864 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-31T01:58:40.865 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-31T01:58:40.865 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-31T01:58:40.865 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-31T01:58:40.865 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-31T01:58:40.865 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-31T01:58:40.866 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-31T01:58:40.866 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-31T01:58:40.866 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-31T01:58:40.866 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-31T01:58:40.866 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-31T01:58:40.867 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-31T01:58:40.867 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-31T01:58:40.867 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-31T01:58:40.867 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-31T01:58:40.867 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-31T01:58:40.868 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-31T01:58:40.868 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-31T01:58:40.868 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-31T01:58:40.868 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-31T01:58:40.868 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-31T01:58:40.869 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-31T01:58:40.869 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-31T01:58:40.869 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-31T01:58:40.869 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-31T01:58:40.869 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 129/134 2023-08-31T01:58:40.870 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-31T01:58:40.870 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 131/134 2023-08-31T01:58:40.870 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T01:58:40.870 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-31T01:58:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T01:58:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T01:58:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T01:58:42.466 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 124/134 2023-08-31T01:58:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 125/134 2023-08-31T01:58:43.097 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 126/134 2023-08-31T01:58:43.430 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T01:58:43.431 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:48 ago on Thu 31 Aug 2023 01:56:55 AM UTC. 2023-08-31T01:58:43.434 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-31T01:58:43.582 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-31T01:58:43.591 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-31T01:58:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-31T01:58:43.974 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-31T01:58:44.055 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-31T01:58:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-31T01:58:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-31T01:58:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T01:58:44.468 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T01:58:44.469 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T01:58:44.729 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T01:58:44.914 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T01:58:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T01:58:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 1/134 2023-08-31T01:58:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2/134 2023-08-31T01:58:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 3/134 2023-08-31T01:58:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 4/134 2023-08-31T01:58:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 5/134 2023-08-31T01:58:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T01:58:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T01:58:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T01:58:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 9/134 2023-08-31T01:58:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 10/134 2023-08-31T01:58:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 11/134 2023-08-31T01:58:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 12/134 2023-08-31T01:58:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 13/134 2023-08-31T01:58:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 14/134 2023-08-31T01:58:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 15/134 2023-08-31T01:58:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 16/134 2023-08-31T01:58:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 17/134 2023-08-31T01:58:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 18/134 2023-08-31T01:58:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 19/134 2023-08-31T01:58:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 20/134 2023-08-31T01:58:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 21/134 2023-08-31T01:58:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 22/134 2023-08-31T01:58:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 23/134 2023-08-31T01:58:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 24/134 2023-08-31T01:58:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 25/134 2023-08-31T01:58:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 26/134 2023-08-31T01:58:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 27/134 2023-08-31T01:58:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 28/134 2023-08-31T01:58:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 29/134 2023-08-31T01:58:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 30/134 2023-08-31T01:58:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 31/134 2023-08-31T01:58:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 32/134 2023-08-31T01:58:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 33/134 2023-08-31T01:58:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 34/134 2023-08-31T01:58:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 35/134 2023-08-31T01:58:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 36/134 2023-08-31T01:58:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 37/134 2023-08-31T01:58:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 38/134 2023-08-31T01:58:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-31T01:58:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-31T01:58:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-31T01:58:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-31T01:58:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-31T01:58:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-31T01:58:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-31T01:58:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-31T01:58:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-31T01:58:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-31T01:58:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-31T01:58:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-31T01:58:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-31T01:58:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-31T01:58:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-31T01:58:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-31T01:58:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-31T01:58:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-31T01:58:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-31T01:58:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-31T01:58:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-31T01:58:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-31T01:58:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-31T01:58:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-31T01:58:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-31T01:58:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-31T01:58:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-31T01:58:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-31T01:58:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-31T01:58:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-31T01:58:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-31T01:58:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-31T01:58:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-31T01:58:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-31T01:58:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-31T01:58:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-31T01:58:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-31T01:58:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-31T01:58:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-31T01:58:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-31T01:58:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-31T01:58:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-31T01:58:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-31T01:58:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-31T01:58:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-31T01:58:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-31T01:58:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-31T01:58:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-31T01:58:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-31T01:58:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-31T01:58:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-31T01:58:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-31T01:58:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-31T01:58:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-31T01:58:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-31T01:58:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-31T01:58:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-31T01:58:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-31T01:58:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-31T01:58:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-31T01:58:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-31T01:58:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-31T01:58:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-31T01:58:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-31T01:58:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-31T01:58:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-31T01:58:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-31T01:58:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-31T01:58:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-31T01:58:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-31T01:58:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-31T01:58:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-31T01:58:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-31T01:58:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-31T01:58:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-31T01:58:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-31T01:58:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-31T01:58:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-31T01:58:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-31T01:58:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-31T01:58:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-31T01:58:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-31T01:58:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-31T01:58:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-31T01:58:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-31T01:58:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-31T01:58:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-31T01:58:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-31T01:58:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-31T01:58:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-31T01:58:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 129/134 2023-08-31T01:58:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-31T01:58:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 131/134 2023-08-31T01:58:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T01:58:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-31T01:58:47.030 INFO:teuthology.orchestra.run.smithi084.stdout:Installed products updated. 2023-08-31T01:58:47.257 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:47.258 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-08-31T01:58:47.258 INFO:teuthology.orchestra.run.smithi084.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-31T01:58:47.258 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.258 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.259 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2023-08-31T01:58:47.259 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-31T01:58:47.259 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.1-7.el8.noarch 2023-08-31T01:58:47.259 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.0.4-10.el8.x86_64 2023-08-31T01:58:47.259 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.261 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.261 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.261 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.261 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.261 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.262 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.262 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.262 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.262 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.263 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.263 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.263 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.263 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.263 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.263 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.264 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:47.264 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-31T01:58:47.264 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.1-9.el8.x86_64 2023-08-31T01:58:47.264 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-31T01:58:47.264 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-31T01:58:47.265 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.6-3.el8.x86_64 2023-08-31T01:58:47.265 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-31T01:58:47.265 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-31T01:58:47.265 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-31T01:58:47.265 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.266 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.266 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.266 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-31T01:58:47.266 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-31T01:58:47.266 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-31T01:58:47.267 INFO:teuthology.orchestra.run.smithi084.stdout: libpq-13.5-1.el8.x86_64 2023-08-31T01:58:47.267 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-31T01:58:47.267 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-31T01:58:47.267 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.267 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.267 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-31T01:58:47.268 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.268 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-31T01:58:47.268 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-31T01:58:47.268 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-31T01:58:47.269 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-31T01:58:47.269 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-31T01:58:47.269 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-31T01:58:47.269 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-31T01:58:47.269 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-31T01:58:47.270 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-31T01:58:47.270 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-31T01:58:47.270 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-31T01:58:47.270 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-31T01:58:47.270 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-31T01:58:47.271 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-31T01:58:47.271 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T01:58:47.271 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T01:58:47.271 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T01:58:47.271 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-31T01:58:47.271 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-31T01:58:47.272 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-31T01:58:47.272 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-31T01:58:47.272 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-31T01:58:47.272 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.273 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.273 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.273 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-31T01:58:47.273 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-31T01:58:47.273 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-31T01:58:47.273 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-31T01:58:47.274 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-31T01:58:47.274 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-31T01:58:47.274 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-31T01:58:47.274 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-31T01:58:47.274 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-31T01:58:47.275 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-31T01:58:47.275 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-31T01:58:47.275 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-31T01:58:47.275 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-31T01:58:47.275 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-31T01:58:47.276 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-31T01:58:47.276 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-31T01:58:47.276 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-31T01:58:47.276 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-31T01:58:47.276 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-31T01:58:47.276 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-31T01:58:47.277 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-31T01:58:47.277 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-31T01:58:47.277 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2023-08-31T01:58:47.277 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-31T01:58:47.277 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-31T01:58:47.278 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-31T01:58:47.278 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-31T01:58:47.278 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-31T01:58:47.278 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-31T01:58:47.278 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.278 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.279 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-31T01:58:47.279 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-31T01:58:47.279 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.279 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-31T01:58:47.279 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-31T01:58:47.279 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-31T01:58:47.280 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-31T01:58:47.280 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-31T01:58:47.280 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-31T01:58:47.280 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-31T01:58:47.280 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-31T01:58:47.281 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-31T01:58:47.281 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-31T01:58:47.281 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-31T01:58:47.281 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-31T01:58:47.281 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-31T01:58:47.282 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.282 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.282 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:47.282 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-31T01:58:47.282 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-31T01:58:47.283 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-31T01:58:47.283 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-31T01:58:47.283 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-31T01:58:47.283 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-31T01:58:47.284 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:47.284 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-08-31T01:58:47.444 DEBUG:teuthology.parallel:result is None 2023-08-31T01:58:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T01:58:48.089 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:53 ago on Thu 31 Aug 2023 01:56:55 AM UTC. 2023-08-31T01:58:55.378 INFO:teuthology.orchestra.run.smithi170.stdout:Installed products updated. 2023-08-31T01:58:55.593 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:55.594 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2023-08-31T01:58:55.594 INFO:teuthology.orchestra.run.smithi170.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-31T01:58:55.594 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.594 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.595 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2023-08-31T01:58:55.595 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-31T01:58:55.595 INFO:teuthology.orchestra.run.smithi170.stdout: automake-1.16.1-7.el8.noarch 2023-08-31T01:58:55.595 INFO:teuthology.orchestra.run.smithi170.stdout: bison-3.0.4-10.el8.x86_64 2023-08-31T01:58:55.596 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.596 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.596 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.596 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.597 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.597 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.597 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.597 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.597 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.598 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.598 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.598 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.598 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.598 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.599 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.599 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.599 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.599 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.599 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.600 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.600 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.600 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.600 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T01:58:55.600 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-31T01:58:55.601 INFO:teuthology.orchestra.run.smithi170.stdout: flex-2.6.1-9.el8.x86_64 2023-08-31T01:58:55.601 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-31T01:58:55.601 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-31T01:58:55.601 INFO:teuthology.orchestra.run.smithi170.stdout: jq-1.6-3.el8.x86_64 2023-08-31T01:58:55.601 INFO:teuthology.orchestra.run.smithi170.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-31T01:58:55.602 INFO:teuthology.orchestra.run.smithi170.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-31T01:58:55.602 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-31T01:58:55.602 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.602 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.602 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.603 INFO:teuthology.orchestra.run.smithi170.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-31T01:58:55.603 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-31T01:58:55.603 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-31T01:58:55.603 INFO:teuthology.orchestra.run.smithi170.stdout: libpq-13.5-1.el8.x86_64 2023-08-31T01:58:55.603 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-31T01:58:55.604 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-31T01:58:55.604 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.604 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.604 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-31T01:58:55.604 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.605 INFO:teuthology.orchestra.run.smithi170.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-31T01:58:55.606 INFO:teuthology.orchestra.run.smithi170.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-31T01:58:55.606 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-31T01:58:55.606 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-31T01:58:55.606 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-31T01:58:55.607 INFO:teuthology.orchestra.run.smithi170.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-31T01:58:55.607 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-31T01:58:55.607 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-31T01:58:55.607 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-31T01:58:55.607 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-31T01:58:55.608 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-31T01:58:55.608 INFO:teuthology.orchestra.run.smithi170.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-31T01:58:55.608 INFO:teuthology.orchestra.run.smithi170.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-31T01:58:55.608 INFO:teuthology.orchestra.run.smithi170.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-31T01:58:55.609 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T01:58:55.609 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T01:58:55.609 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T01:58:55.609 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-31T01:58:55.609 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-31T01:58:55.610 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-31T01:58:55.610 INFO:teuthology.orchestra.run.smithi170.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-31T01:58:55.610 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-31T01:58:55.610 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.610 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.611 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.611 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-31T01:58:55.611 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-31T01:58:55.612 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-31T01:58:55.612 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-31T01:58:55.612 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-31T01:58:55.612 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-31T01:58:55.612 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-31T01:58:55.613 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-31T01:58:55.613 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-31T01:58:55.613 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-31T01:58:55.613 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-31T01:58:55.613 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-31T01:58:55.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-31T01:58:55.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-31T01:58:55.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-31T01:58:55.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-31T01:58:55.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-31T01:58:55.615 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-31T01:58:55.615 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-31T01:58:55.615 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-31T01:58:55.615 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-31T01:58:55.616 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-31T01:58:55.616 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-2.6-1.el8.noarch 2023-08-31T01:58:55.616 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-31T01:58:55.616 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-31T01:58:55.616 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-31T01:58:55.617 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-31T01:58:55.617 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-31T01:58:55.617 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-31T01:58:55.617 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.617 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-31T01:58:55.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-31T01:58:55.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-31T01:58:55.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-31T01:58:55.619 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-31T01:58:55.619 INFO:teuthology.orchestra.run.smithi170.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-31T01:58:55.619 INFO:teuthology.orchestra.run.smithi170.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-31T01:58:55.619 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-31T01:58:55.619 INFO:teuthology.orchestra.run.smithi170.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-31T01:58:55.620 INFO:teuthology.orchestra.run.smithi170.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-31T01:58:55.620 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-31T01:58:55.620 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-31T01:58:55.620 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-31T01:58:55.620 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-31T01:58:55.621 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-31T01:58:55.621 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.621 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.621 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T01:58:55.621 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-31T01:58:55.622 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-31T01:58:55.622 INFO:teuthology.orchestra.run.smithi170.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-31T01:58:55.622 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-31T01:58:55.622 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-31T01:58:55.623 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-31T01:58:55.623 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:55.623 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2023-08-31T01:58:55.788 DEBUG:teuthology.parallel:result is None 2023-08-31T01:58:55.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T01:58:56.008 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-31T01:58:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:18.0.0-5814.gcc14fc8a.el8 2023-08-31T01:58:56.037 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5814.gcc14fc8a.el8 2023-08-31T01:58:56.037 INFO:teuthology.task.install:The correct ceph version 18.0.0-5814.gcc14fc8a is installed. 2023-08-31T01:58:56.038 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T01:58:56.252 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-31T01:58:56.276 INFO:teuthology.orchestra.run.smithi170.stdout:18.0.0-5814.gcc14fc8a.el8 2023-08-31T01:58:56.277 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5814.gcc14fc8a.el8 2023-08-31T01:58:56.277 INFO:teuthology.task.install:The correct ceph version 18.0.0-5814.gcc14fc8a is installed. 2023-08-31T01:58:56.278 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-31T01:58:56.279 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:56.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-31T01:58:56.326 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:58:56.327 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-31T01:58:56.369 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-31T01:58:56.369 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:56.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2023-08-31T01:58:56.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-31T01:58:56.468 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:58:56.468 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2023-08-31T01:58:56.496 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-31T01:58:56.562 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-31T01:58:56.562 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:56.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-31T01:58:56.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-31T01:58:56.658 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:58:56.658 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-31T01:58:56.686 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-31T01:58:56.752 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-31T01:58:56.752 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:56.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2023-08-31T01:58:56.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-31T01:58:56.846 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:58:56.846 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2023-08-31T01:58:56.873 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-31T01:58:56.945 INFO:teuthology.run_tasks:Running task ceph... 2023-08-31T01:58:57.026 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-31T01:58:57.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2023-08-31T01:58:57.030 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2023-08-31T01:58:57.061 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-31T01:58:57.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-31T01:58:57.097 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-31T01:58:57.123 INFO:tasks.ceph:Creating extra log directories... 2023-08-31T01:58:57.124 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-31T01:58:57.164 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-31T01:58:57.196 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-31T01:58:57.196 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-31T01:58:57.197 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-31T01:58:57.197 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:57.197 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-31T01:58:57.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-31T01:58:57.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-31T01:58:57.422 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:58:57.422 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-31T01:58:57.440 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-31T01:58:57.676 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-31T01:58:57.712 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-31T01:58:57.712 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-31T01:58:57.713 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123', 'branch': 'wip-batrick-testing-20230830.165602', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7385123', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20230830.165602'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20230830.165602', 'sha1': '833faa571491534dcb6bc6b25a578499081113d8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6543, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'sleep_before_teardown': 0, 'subset': '131/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20230830.165602', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '833faa571491534dcb6bc6b25a578499081113d8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi084.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_quota']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f9a8556d5e989d27b6626a0b75ef595991f83d20', 'timestamp': '2023-08-30_23:48:03', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-08-31T01:58:57.714 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-31T01:58:57.716 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-31T01:58:57.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2023-08-31T01:58:57.774 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2023-08-31T01:58:57.828 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:57.829 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2023-08-31T01:58:57.857 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-31T01:58:57.858 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2023-08-31T01:58:57.914 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-31T01:58:57.914 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T01:58:57.915 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 389328 Links: 1 2023-08-31T01:58:57.915 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T01:58:57.915 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T01:58:57.915 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-08-31 01:58:40.544782550 +0000 2023-08-31T01:58:57.916 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-08-31 01:56:08.545037809 +0000 2023-08-31T01:58:57.916 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-08-31 01:56:08.545037809 +0000 2023-08-31T01:58:57.916 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-08-31T01:58:57.916 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-31T01:58:57.979 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-08-31T01:58:57.980 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-08-31T01:58:57.980 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000241812 s, 2.1 MB/s 2023-08-31T01:58:57.981 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-31T01:58:58.039 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2023-08-31T01:58:58.096 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-31T01:58:58.097 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T01:58:58.097 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 392621 Links: 1 2023-08-31T01:58:58.097 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T01:58:58.097 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T01:58:58.097 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-08-31 01:58:40.544782550 +0000 2023-08-31T01:58:58.098 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-08-31 01:56:09.075028387 +0000 2023-08-31T01:58:58.098 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-08-31 01:56:09.075028387 +0000 2023-08-31T01:58:58.098 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-08-31T01:58:58.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-31T01:58:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-08-31T01:58:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-08-31T01:58:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000215455 s, 2.4 MB/s 2023-08-31T01:58:58.163 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-31T01:58:58.221 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2023-08-31T01:58:58.278 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-31T01:58:58.279 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T01:58:58.279 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 389514 Links: 1 2023-08-31T01:58:58.279 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T01:58:58.279 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T01:58:58.279 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-08-31 01:58:40.544782550 +0000 2023-08-31T01:58:58.280 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-08-31 01:56:09.587019284 +0000 2023-08-31T01:58:58.280 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-08-31 01:56:09.587019284 +0000 2023-08-31T01:58:58.280 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-08-31T01:58:58.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-31T01:58:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-08-31T01:58:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-08-31T01:58:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000253407 s, 2.0 MB/s 2023-08-31T01:58:58.344 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-31T01:58:58.402 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2023-08-31T01:58:58.458 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-31T01:58:58.458 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T01:58:58.458 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 393214 Links: 1 2023-08-31T01:58:58.459 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T01:58:58.459 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T01:58:58.459 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-08-31 01:58:40.544782550 +0000 2023-08-31T01:58:58.459 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-08-31 01:56:10.098010200 +0000 2023-08-31T01:58:58.460 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-08-31 01:56:10.098010200 +0000 2023-08-31T01:58:58.460 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-08-31T01:58:58.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-31T01:58:58.523 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-08-31T01:58:58.523 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-08-31T01:58:58.523 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000228213 s, 2.2 MB/s 2023-08-31T01:58:58.524 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-31T01:58:58.582 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T01:58:58.582 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:58:58.583 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2023-08-31T01:58:58.601 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-31T01:58:58.602 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2023-08-31T01:58:58.660 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-31T01:58:58.661 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T01:58:58.661 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 387738 Links: 1 2023-08-31T01:58:58.661 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T01:58:58.662 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T01:58:58.662 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-08-31 01:58:45.130612888 +0000 2023-08-31T01:58:58.662 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-08-31 01:56:08.000337547 +0000 2023-08-31T01:58:58.662 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-08-31 01:56:08.000337547 +0000 2023-08-31T01:58:58.662 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2023-08-31T01:58:58.663 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-31T01:58:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-08-31T01:58:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-08-31T01:58:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000128982 s, 4.0 MB/s 2023-08-31T01:58:58.730 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-31T01:58:58.789 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2023-08-31T01:58:58.846 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-31T01:58:58.847 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T01:58:58.847 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 382526 Links: 1 2023-08-31T01:58:58.847 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T01:58:58.847 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T01:58:58.848 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-08-31 01:58:45.131612865 +0000 2023-08-31T01:58:58.848 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-08-31 01:56:08.509325950 +0000 2023-08-31T01:58:58.848 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-08-31 01:56:08.509325950 +0000 2023-08-31T01:58:58.848 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2023-08-31T01:58:58.849 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-31T01:58:58.914 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-08-31T01:58:58.914 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-08-31T01:58:58.914 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000100372 s, 5.1 MB/s 2023-08-31T01:58:58.915 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-31T01:58:58.974 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2023-08-31T01:58:59.033 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-31T01:58:59.033 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T01:58:59.033 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 391448 Links: 1 2023-08-31T01:58:59.033 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T01:58:59.034 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T01:58:59.034 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-08-31 01:58:45.131612865 +0000 2023-08-31T01:58:59.034 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-08-31 01:56:08.998314809 +0000 2023-08-31T01:58:59.034 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-08-31 01:56:08.998314809 +0000 2023-08-31T01:58:59.034 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2023-08-31T01:58:59.035 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-31T01:58:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-08-31T01:58:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-08-31T01:58:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000134862 s, 3.8 MB/s 2023-08-31T01:58:59.102 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-31T01:58:59.160 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2023-08-31T01:58:59.218 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-31T01:58:59.218 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T01:58:59.218 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 382653 Links: 1 2023-08-31T01:58:59.218 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T01:58:59.219 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T01:58:59.219 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-08-31 01:58:45.131612865 +0000 2023-08-31T01:58:59.219 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-08-31 01:56:09.494303509 +0000 2023-08-31T01:58:59.219 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-08-31 01:56:09.494303509 +0000 2023-08-31T01:58:59.219 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2023-08-31T01:58:59.220 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-31T01:58:59.284 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-08-31T01:58:59.284 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-08-31T01:58:59.284 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.6397e-05 s, 5.3 MB/s 2023-08-31T01:58:59.285 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-31T01:58:59.344 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T01:58:59.344 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-31T01:58:59.344 INFO:tasks.ceph:Generating config... 2023-08-31T01:58:59.346 INFO:tasks.ceph:[client] pid file = 2023-08-31T01:58:59.347 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-31T01:58:59.347 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-31T01:58:59.347 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-31T01:58:59.348 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-31T01:58:59.348 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-31T01:58:59.348 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-31T01:58:59.348 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-31T01:58:59.349 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-08-31T01:58:59.349 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-08-31T01:58:59.349 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-31T01:58:59.349 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-31T01:58:59.350 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-08-31T01:58:59.350 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-31T01:58:59.350 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-31T01:58:59.351 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-31T01:58:59.351 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-31T01:58:59.351 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-31T01:58:59.352 INFO:tasks.ceph:Setting up mon.a... 2023-08-31T01:58:59.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-31T01:58:59.411 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2023-08-31T01:58:59.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-31T01:58:59.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T01:58:59.487 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.170'), ('mon.c', '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]')] 2023-08-31T01:58:59.487 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2023-08-31T01:58:59.488 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:59.489 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-31T01:58:59.543 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.170 --addv c '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:58:59.630 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:58:59.631 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 3192a6ac-325f-4185-9b3a-d848f695e6dd 2023-08-31T01:58:59.631 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = pacific 2023-08-31T01:58:59.631 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2023-08-31T01:58:59.632 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 3192a6ac-325f-4185-9b3a-d848f695e6dd 2023-08-31T01:58:59.632 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2023-08-31T01:58:59.639076+0000 2023-08-31T01:58:59.632 INFO:teuthology.orchestra.run.smithi084.stdout:created 2023-08-31T01:58:59.639076+0000 2023-08-31T01:58:59.632 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 16 (pacific) 2023-08-31T01:58:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2023-08-31T01:58:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2023-08-31T01:58:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-08-31T01:58:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2023-08-31T01:58:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-31T01:58:59.635 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-31T01:58:59.651 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3192a6ac-325f-4185-9b3a-d848f695e6dd... 2023-08-31T01:58:59.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-31T01:58:59.694 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-31T01:58:59.736 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-08-31T01:58:59.736 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-08-31T01:58:59.737 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-31T01:58:59.737 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-08-31T01:58:59.737 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.737 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-08-31T01:58:59.738 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.738 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-08-31T01:58:59.738 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.738 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-08-31T01:58:59.739 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-08-31T01:58:59.739 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.739 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-08-31T01:58:59.739 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-08-31T01:58:59.739 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.740 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-31T01:58:59.740 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-08-31T01:58:59.740 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.740 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-08-31T01:58:59.741 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-31T01:58:59.741 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.741 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-08-31T01:58:59.741 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.741 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-08-31T01:58:59.742 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-08-31T01:58:59.742 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-08-31T01:58:59.742 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-08-31T01:58:59.742 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-08-31T01:58:59.743 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-08-31T01:58:59.743 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-08-31T01:58:59.743 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-31T01:58:59.743 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-31T01:58:59.743 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-08-31T01:58:59.744 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.744 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-31T01:58:59.744 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.744 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-08-31T01:58:59.745 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.745 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-08-31T01:58:59.745 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.746 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-08-31T01:58:59.746 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-08-31T01:58:59.746 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-08-31T01:58:59.746 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2023-08-31T01:58:59.747 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 3192a6ac-325f-4185-9b3a-d848f695e6dd 2023-08-31T01:58:59.747 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.747 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-08-31T01:58:59.747 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-08-31T01:58:59.748 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.748 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-08-31T01:58:59.748 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-08-31T01:58:59.748 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-08-31T01:58:59.748 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.749 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-08-31T01:58:59.749 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-08-31T01:58:59.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.749 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-08-31T01:58:59.750 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-08-31T01:58:59.750 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-08-31T01:58:59.750 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.750 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-08-31T01:58:59.751 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-08-31T01:58:59.751 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.751 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-08-31T01:58:59.751 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.751 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-08-31T01:58:59.752 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.752 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-08-31T01:58:59.752 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.752 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-08-31T01:58:59.752 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-08-31T01:58:59.753 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.753 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-08-31T01:58:59.753 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-08-31T01:58:59.753 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-08-31T01:58:59.753 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-08-31T01:58:59.754 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2023-08-31T01:58:59.754 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2023-08-31T01:58:59.754 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-08-31T01:58:59.754 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-08-31T01:58:59.754 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2023-08-31T01:58:59.755 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-08-31T01:58:59.755 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-08-31T01:58:59.755 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-08-31T01:58:59.755 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-08-31T01:58:59.755 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-08-31T01:58:59.756 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.756 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-08-31T01:58:59.756 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-08-31T01:58:59.756 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-08-31T01:58:59.756 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-08-31T01:58:59.757 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-08-31T01:58:59.757 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-08-31T01:58:59.757 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-08-31T01:58:59.757 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-08-31T01:58:59.757 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.758 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-08-31T01:58:59.758 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-08-31T01:58:59.758 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-08-31T01:58:59.759 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-08-31T01:58:59.759 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-08-31T01:58:59.759 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-08-31T01:58:59.760 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-08-31T01:58:59.760 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-08-31T01:58:59.760 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-08-31T01:58:59.761 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-08-31T01:58:59.761 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-08-31T01:58:59.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.762 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-31T01:58:59.762 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-08-31T01:58:59.763 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-08-31T01:58:59.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.763 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-08-31T01:58:59.764 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-31T01:58:59.764 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-31T01:58:59.764 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.765 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-08-31T01:58:59.765 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-08-31T01:58:59.765 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.766 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-08-31T01:58:59.766 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:58:59.766 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-08-31T01:58:59.767 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-08-31T01:58:59.767 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-08-31T01:58:59.768 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-08-31T01:58:59.768 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-31T01:58:59.768 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-31T01:58:59.768 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-08-31T01:58:59.769 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-08-31T01:58:59.769 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-08-31T01:58:59.769 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-08-31T01:58:59.769 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-08-31T01:58:59.770 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-08-31T01:58:59.770 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-08-31T01:58:59.770 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-08-31T01:58:59.772 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2023-08-31T01:58:59.772 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2023-08-31T01:58:59.773 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-31T01:58:59.773 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2023-08-31T01:58:59.773 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.774 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2023-08-31T01:58:59.774 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.774 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2023-08-31T01:58:59.775 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.775 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2023-08-31T01:58:59.776 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2023-08-31T01:58:59.776 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.776 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2023-08-31T01:58:59.776 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2023-08-31T01:58:59.777 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.777 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-31T01:58:59.777 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2023-08-31T01:58:59.778 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.778 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2023-08-31T01:58:59.778 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-31T01:58:59.778 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.779 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2023-08-31T01:58:59.779 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.779 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2023-08-31T01:58:59.780 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2023-08-31T01:58:59.780 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2023-08-31T01:58:59.780 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2023-08-31T01:58:59.780 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2023-08-31T01:58:59.781 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2023-08-31T01:58:59.781 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2023-08-31T01:58:59.781 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-31T01:58:59.781 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-31T01:58:59.781 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2023-08-31T01:58:59.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.782 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-31T01:58:59.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.782 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2023-08-31T01:58:59.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.783 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2023-08-31T01:58:59.783 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.783 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2023-08-31T01:58:59.783 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2023-08-31T01:58:59.783 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2023-08-31T01:58:59.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.84,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2023-08-31T01:58:59.784 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 3192a6ac-325f-4185-9b3a-d848f695e6dd 2023-08-31T01:58:59.784 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.784 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2023-08-31T01:58:59.785 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2023-08-31T01:58:59.785 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.785 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2023-08-31T01:58:59.785 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2023-08-31T01:58:59.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2023-08-31T01:58:59.786 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2023-08-31T01:58:59.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2023-08-31T01:58:59.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.787 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2023-08-31T01:58:59.787 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2023-08-31T01:58:59.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2023-08-31T01:58:59.788 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2023-08-31T01:58:59.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2023-08-31T01:58:59.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.789 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2023-08-31T01:58:59.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.790 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2023-08-31T01:58:59.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.790 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2023-08-31T01:58:59.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.791 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2023-08-31T01:58:59.791 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2023-08-31T01:58:59.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.792 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2023-08-31T01:58:59.792 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2023-08-31T01:58:59.792 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2023-08-31T01:58:59.792 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2023-08-31T01:58:59.792 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 20 2023-08-31T01:58:59.793 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 20 2023-08-31T01:58:59.793 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-08-31T01:58:59.793 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2023-08-31T01:58:59.793 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 10 2023-08-31T01:58:59.793 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2023-08-31T01:58:59.794 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2023-08-31T01:58:59.794 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2023-08-31T01:58:59.794 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2023-08-31T01:58:59.794 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2023-08-31T01:58:59.795 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.795 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2023-08-31T01:58:59.795 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-08-31T01:58:59.795 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2023-08-31T01:58:59.795 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2023-08-31T01:58:59.796 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2023-08-31T01:58:59.796 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2023-08-31T01:58:59.796 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2023-08-31T01:58:59.796 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2023-08-31T01:58:59.796 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.797 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2023-08-31T01:58:59.797 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-08-31T01:58:59.797 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2023-08-31T01:58:59.797 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2023-08-31T01:58:59.798 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2023-08-31T01:58:59.798 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2023-08-31T01:58:59.798 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2023-08-31T01:58:59.798 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2023-08-31T01:58:59.798 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2023-08-31T01:58:59.799 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2023-08-31T01:58:59.799 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2023-08-31T01:58:59.799 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.799 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-31T01:58:59.799 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2023-08-31T01:58:59.800 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2023-08-31T01:58:59.800 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.800 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2023-08-31T01:58:59.800 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-31T01:58:59.801 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-31T01:58:59.801 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.801 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2023-08-31T01:58:59.801 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2023-08-31T01:58:59.802 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.802 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2023-08-31T01:58:59.802 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-08-31T01:58:59.803 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2023-08-31T01:58:59.803 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2023-08-31T01:58:59.803 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2023-08-31T01:58:59.804 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2023-08-31T01:58:59.804 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-31T01:58:59.805 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-31T01:58:59.805 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2023-08-31T01:58:59.805 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2023-08-31T01:58:59.805 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2023-08-31T01:58:59.806 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2023-08-31T01:58:59.806 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2023-08-31T01:58:59.807 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2023-08-31T01:58:59.807 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2023-08-31T01:58:59.807 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2023-08-31T01:58:59.808 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-31T01:58:59.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-31T01:58:59.869 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-31T01:58:59.870 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:59.870 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-31T01:58:59.888 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:59.888 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-31T01:58:59.944 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T01:58:59.944 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:58:59.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-31T01:58:59.945 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T01:59:00.043 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:00.044 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:00.126 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T01:59:00.126 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:00.126 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-31T01:59:00.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T01:59:00.166 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:00.167 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:00.225 INFO:tasks.ceph:Setting up mon nodes... 2023-08-31T01:59:00.225 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-31T01:59:00.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-31T01:59:00.280 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-31T01:59:00.283 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-31T01:59:00.346 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-31T01:59:00.349 INFO:tasks.ceph:Setting up mds nodes... 2023-08-31T01:59:00.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-31T01:59:00.402 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-31T01:59:00.405 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-31T01:59:00.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-31T01:59:00.524 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-31T01:59:00.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-31T01:59:00.553 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-31T01:59:00.607 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-31T01:59:00.610 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-31T01:59:00.638 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-31T01:59:00.731 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-31T01:59:00.734 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-31T01:59:00.760 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-31T01:59:00.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-31T01:59:00.805 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-31T01:59:00.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-31T01:59:00.861 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-31T01:59:00.873 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-31T01:59:00.917 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-31T01:59:00.930 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-31T01:59:01.013 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-31T01:59:01.026 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-31T01:59:01.027 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-31T01:59:01.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-31T01:59:01.053 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T01:59:01.054 INFO:tasks.ceph:role: osd.0 2023-08-31T01:59:01.054 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T01:59:01.054 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-31T01:59:01.127 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T01:59:01.127 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T01:59:01.127 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T01:59:01.127 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T01:59:01.128 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T01:59:01.128 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-08-31T01:59:01.129 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T01:59:01.129 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T01:59:01.129 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T01:59:01.130 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T01:59:01.561 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-08-31T01:59:01.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-08-31T01:59:01.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-31T01:59:01.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-31T01:59:01.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-31T01:59:01.823 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T01:59:01.823 INFO:tasks.ceph:role: osd.1 2023-08-31T01:59:01.824 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T01:59:01.824 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-31T01:59:01.898 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T01:59:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T01:59:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T01:59:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T01:59:01.899 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T01:59:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-08-31T01:59:01.899 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T01:59:01.899 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T01:59:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T01:59:01.900 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T01:59:02.322 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-08-31T01:59:02.324 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-08-31T01:59:02.324 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-31T01:59:02.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-31T01:59:02.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-31T01:59:02.540 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T01:59:02.541 INFO:tasks.ceph:role: osd.2 2023-08-31T01:59:02.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T01:59:02.542 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-31T01:59:02.615 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T01:59:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T01:59:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T01:59:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T01:59:02.616 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T01:59:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-08-31T01:59:02.616 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T01:59:02.616 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T01:59:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T01:59:02.617 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T01:59:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-08-31T01:59:03.061 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-08-31T01:59:03.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-31T01:59:03.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-31T01:59:03.255 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-31T01:59:03.323 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T01:59:03.323 INFO:tasks.ceph:role: osd.3 2023-08-31T01:59:03.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T01:59:03.324 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-31T01:59:03.396 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T01:59:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T01:59:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T01:59:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T01:59:03.397 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T01:59:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-08-31T01:59:03.397 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T01:59:03.397 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T01:59:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T01:59:03.398 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T01:59:03.842 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-08-31T01:59:03.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-08-31T01:59:03.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-31T01:59:04.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-31T01:59:04.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:04.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:04.167+0000 7f0406393640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-31T01:59:04.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:04.167+0000 7f0406393640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-31T01:59:04.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:04.167+0000 7f0406393640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T01:59:04.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:04.167+0000 7f0406393640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T01:59:04.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:04.167+0000 7f0406393640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T01:59:04.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:04.167+0000 7f0406393640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-31T01:59:07.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-31T01:59:07.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:07.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:07.162+0000 7f2cf59fa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-31T01:59:07.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:07.162+0000 7f2cf59fa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-31T01:59:07.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:07.162+0000 7f2cf59fa640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T01:59:07.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:07.162+0000 7f2cf59fa640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T01:59:07.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:07.162+0000 7f2cf59fa640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T01:59:07.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:07.163+0000 7f2cf59fa640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-31T01:59:10.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-31T01:59:10.048 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:10.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:10.145+0000 7f8715238640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-31T01:59:10.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:10.146+0000 7f8715238640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-31T01:59:10.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:10.146+0000 7f8715238640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T01:59:10.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:10.146+0000 7f8715238640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T01:59:10.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:10.146+0000 7f8715238640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T01:59:10.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:10.146+0000 7f8715238640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-31T01:59:13.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-31T01:59:13.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:13.132+0000 7f2327886640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-31T01:59:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:13.133+0000 7f2327886640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-31T01:59:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:13.133+0000 7f2327886640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T01:59:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:13.133+0000 7f2327886640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T01:59:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:13.133+0000 7f2327886640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T01:59:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:13.133+0000 7f2327886640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-31T01:59:15.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-31T01:59:16.023 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-31T01:59:16.172 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T01:59:16.172 INFO:tasks.ceph:role: osd.4 2023-08-31T01:59:16.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T01:59:16.173 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-31T01:59:16.204 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T01:59:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T01:59:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T01:59:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T01:59:16.205 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T01:59:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-08-31T01:59:16.205 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T01:59:16.206 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T01:59:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T01:59:16.206 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T01:59:16.227 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-08-31T01:59:16.285 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-08-31T01:59:16.286 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-31T01:59:16.370 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-31T01:59:16.401 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-31T01:59:16.469 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T01:59:16.470 INFO:tasks.ceph:role: osd.5 2023-08-31T01:59:16.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T01:59:16.470 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-31T01:59:16.536 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T01:59:16.536 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T01:59:16.537 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T01:59:16.537 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T01:59:16.537 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T01:59:16.538 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-08-31T01:59:16.538 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T01:59:16.539 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T01:59:16.539 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T01:59:16.539 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T01:59:16.559 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-08-31T01:59:16.560 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-08-31T01:59:16.561 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-31T01:59:16.641 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-31T01:59:16.711 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-31T01:59:16.778 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T01:59:16.778 INFO:tasks.ceph:role: osd.6 2023-08-31T01:59:16.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T01:59:16.779 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-31T01:59:16.844 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T01:59:16.844 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T01:59:16.845 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T01:59:16.845 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T01:59:16.845 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T01:59:16.846 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-08-31T01:59:16.846 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T01:59:16.846 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T01:59:16.847 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T01:59:16.847 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T01:59:16.866 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-08-31T01:59:16.868 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-08-31T01:59:16.869 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-31T01:59:16.948 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-31T01:59:17.018 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-31T01:59:17.085 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T01:59:17.085 INFO:tasks.ceph:role: osd.7 2023-08-31T01:59:17.085 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T01:59:17.086 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-31T01:59:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T01:59:17.151 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T01:59:17.151 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T01:59:17.151 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T01:59:17.152 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T01:59:17.152 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-08-31T01:59:17.152 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T01:59:17.152 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T01:59:17.152 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T01:59:17.153 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T01:59:17.173 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-08-31T01:59:17.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-08-31T01:59:17.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-31T01:59:17.254 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-31T01:59:17.324 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:17.435+0000 7fa94534e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-31T01:59:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:17.435+0000 7fa94534e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-31T01:59:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:17.435+0000 7fa94534e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T01:59:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:17.435+0000 7fa94534e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T01:59:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:17.435+0000 7fa94534e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T01:59:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:17.435+0000 7fa94534e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-31T01:59:20.292 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-31T01:59:20.324 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:20.414 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:20.420+0000 7f4715867640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-31T01:59:20.414 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:20.420+0000 7f4715867640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-31T01:59:20.414 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:20.420+0000 7f4715867640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T01:59:20.415 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:20.420+0000 7f4715867640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T01:59:20.415 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:20.420+0000 7f4715867640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T01:59:20.415 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:20.421+0000 7f4715867640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-31T01:59:23.277 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-31T01:59:23.309 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:23.401 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:23.408+0000 7f304e043640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-31T01:59:23.402 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:23.408+0000 7f304e043640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-31T01:59:23.402 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:23.408+0000 7f304e043640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T01:59:23.402 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:23.408+0000 7f304e043640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T01:59:23.402 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:23.408+0000 7f304e043640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T01:59:23.402 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:23.408+0000 7f304e043640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-31T01:59:26.264 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-31T01:59:26.296 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:26.388 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:26.394+0000 7fdffb41f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-31T01:59:26.388 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:26.394+0000 7fdffb41f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-31T01:59:26.388 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:26.394+0000 7fdffb41f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T01:59:26.389 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:26.394+0000 7fdffb41f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T01:59:26.389 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:26.394+0000 7fdffb41f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T01:59:26.389 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:26.395+0000 7fdffb41f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-31T01:59:27.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:59:27.718 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:59:29.248 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-31T01:59:29.280 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-31T01:59:29.280 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:29.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-31T01:59:29.312 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:29.313 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-31T01:59:29.382 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:29.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-31T01:59:29.452 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:29.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-31T01:59:29.520 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:29.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-31T01:59:29.589 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:29.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-31T01:59:29.658 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:29.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-31T01:59:29.726 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:29.726 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-31T01:59:29.758 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:29.758 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-31T01:59:29.828 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:29.829 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-31T01:59:29.896 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:29.897 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-31T01:59:29.965 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:29.965 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-31T01:59:30.032 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:30.032 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-31T01:59:30.100 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:30.101 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-31T01:59:30.167 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:30.167 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-31T01:59:30.186 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:30.187 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-31T01:59:30.248 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:30.249 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-31T01:59:30.267 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:30.268 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-31T01:59:30.325 INFO:tasks.ceph:Adding keys to all mons... 2023-08-31T01:59:30.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-31T01:59:30.328 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-31T01:59:30.368 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2023-08-31T01:59:30.369 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kA1E3ERAAz9Pxqyp/TUMegLuyvj1+bg== 2023-08-31T01:59:30.369 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-08-31T01:59:30.369 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kcYqEGBAAT31yT0Two/HvnoRwqs1x7Q== 2023-08-31T01:59:30.370 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-08-31T01:59:30.370 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9k8azHHxAAbizcLL9oOOwyUybbQJdKTA== 2023-08-31T01:59:30.370 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2023-08-31T01:59:30.370 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDo8+9kpRAGChAArPBcizwhWLiV7r30xT7Wsg== 2023-08-31T01:59:30.371 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2023-08-31T01:59:30.371 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDr8+9kmxvCCRAA8cJTfgrPkipt502IoSHe/A== 2023-08-31T01:59:30.371 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2023-08-31T01:59:30.371 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDu8+9kTCbDCBAAwyTS7Y+kLpDhe74Tr9WTEg== 2023-08-31T01:59:30.372 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2023-08-31T01:59:30.372 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDx8+9kOuH8BxAAYodBDGc1FFlgFAOzob2U8A== 2023-08-31T01:59:30.372 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2023-08-31T01:59:30.372 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kkQYjFRAAty+GAiDnmbtlI/VK/K0Wmw== 2023-08-31T01:59:30.372 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-08-31T01:59:30.373 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kgze0JBAAxPJ/5RcSMGxP62aghLVqzA== 2023-08-31T01:59:30.373 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-08-31T01:59:30.373 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kLFgcLBAABLVYfLl7yk/VPk676Opr1Q== 2023-08-31T01:59:30.373 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2023-08-31T01:59:30.373 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD18+9koXUMGhAAUyNcLnNcZw4TNgr0NqaeDg== 2023-08-31T01:59:30.374 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2023-08-31T01:59:30.374 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD48+9kIHUqGRAAt17LBFy+cn6xp5QYNoNm9A== 2023-08-31T01:59:30.374 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2023-08-31T01:59:30.374 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD78+9kI+JqGBAA5vxoDOrG1W1/cK2Uu3QQ5Q== 2023-08-31T01:59:30.375 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2023-08-31T01:59:30.375 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD+8+9koaacFxAAp7WuLrhcIarkzCCl1tt+FA== 2023-08-31T01:59:30.375 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-08-31T01:59:30.375 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kFvODMBAAcqtqFr0KcUWEckdfvqYq2A== 2023-08-31T01:59:30.375 INFO:teuthology.orchestra.run.smithi084.stdout:[client.2] 2023-08-31T01:59:30.376 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kbynZMxAAEOZAXuN51Sun4tDXgJHGlw== 2023-08-31T01:59:30.376 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2023-08-31T01:59:30.376 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kNcMuNxAAPFy0FCshTdGDjuDLhinO6w== 2023-08-31T01:59:30.376 INFO:teuthology.orchestra.run.smithi084.stdout:[client.3] 2023-08-31T01:59:30.376 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDl8+9k5RxMARAA42RvYMpm+oOwNO8ZV26DTg== 2023-08-31T01:59:30.390 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2023-08-31T01:59:30.390 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9kA1E3ERAAz9Pxqyp/TUMegLuyvj1+bg== 2023-08-31T01:59:30.391 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2023-08-31T01:59:30.391 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9kcYqEGBAAT31yT0Two/HvnoRwqs1x7Q== 2023-08-31T01:59:30.391 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2023-08-31T01:59:30.391 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9k8azHHxAAbizcLL9oOOwyUybbQJdKTA== 2023-08-31T01:59:30.392 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2023-08-31T01:59:30.392 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDo8+9kpRAGChAArPBcizwhWLiV7r30xT7Wsg== 2023-08-31T01:59:30.393 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2023-08-31T01:59:30.393 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDr8+9kmxvCCRAA8cJTfgrPkipt502IoSHe/A== 2023-08-31T01:59:30.393 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2023-08-31T01:59:30.394 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDu8+9kTCbDCBAAwyTS7Y+kLpDhe74Tr9WTEg== 2023-08-31T01:59:30.394 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2023-08-31T01:59:30.395 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDx8+9kOuH8BxAAYodBDGc1FFlgFAOzob2U8A== 2023-08-31T01:59:30.395 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2023-08-31T01:59:30.395 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9kkQYjFRAAty+GAiDnmbtlI/VK/K0Wmw== 2023-08-31T01:59:30.396 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2023-08-31T01:59:30.396 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9kgze0JBAAxPJ/5RcSMGxP62aghLVqzA== 2023-08-31T01:59:30.397 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2023-08-31T01:59:30.397 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9kLFgcLBAABLVYfLl7yk/VPk676Opr1Q== 2023-08-31T01:59:30.397 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2023-08-31T01:59:30.398 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD18+9koXUMGhAAUyNcLnNcZw4TNgr0NqaeDg== 2023-08-31T01:59:30.398 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2023-08-31T01:59:30.399 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD48+9kIHUqGRAAt17LBFy+cn6xp5QYNoNm9A== 2023-08-31T01:59:30.399 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2023-08-31T01:59:30.399 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD78+9kI+JqGBAA5vxoDOrG1W1/cK2Uu3QQ5Q== 2023-08-31T01:59:30.400 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2023-08-31T01:59:30.400 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD+8+9koaacFxAAp7WuLrhcIarkzCCl1tt+FA== 2023-08-31T01:59:30.400 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2023-08-31T01:59:30.401 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9kFvODMBAAcqtqFr0KcUWEckdfvqYq2A== 2023-08-31T01:59:30.401 INFO:teuthology.orchestra.run.smithi170.stdout:[client.2] 2023-08-31T01:59:30.401 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9kbynZMxAAEOZAXuN51Sun4tDXgJHGlw== 2023-08-31T01:59:30.402 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2023-08-31T01:59:30.403 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDk8+9kNcMuNxAAPFy0FCshTdGDjuDLhinO6w== 2023-08-31T01:59:30.403 INFO:teuthology.orchestra.run.smithi170.stdout:[client.3] 2023-08-31T01:59:30.403 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDl8+9k5RxMARAA42RvYMpm+oOwNO8ZV26DTg== 2023-08-31T01:59:30.405 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T01:59:30.420 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T01:59:30.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T01:59:30.504 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T01:59:30.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T01:59:30.563 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T01:59:30.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:30.623 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:30.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:30.679 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:30.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:30.734 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:30.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:30.790 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:30.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T01:59:30.845 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T01:59:30.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T01:59:30.900 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T01:59:30.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T01:59:30.961 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T01:59:31.017 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:31.019 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:31.072 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:31.075 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:31.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:31.130 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:31.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:31.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T01:59:31.239 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T01:59:31.242 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T01:59:31.298 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T01:59:31.301 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T01:59:31.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T01:59:31.359 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T01:59:31.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T01:59:31.418 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T01:59:31.474 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-31T01:59:31.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-31T01:59:31.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T01:59:31.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-31T01:59:31.626 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-31T01:59:31.652 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T01:59:31.751 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-31T01:59:31.777 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-31T01:59:31.844 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T01:59:31.942 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-31T01:59:31.970 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:31.973 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-31T01:59:32.026 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-31T01:59:32.027 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-31T01:59:32.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-31T01:59:32.030 INFO:tasks.ceph.mon.a:Started 2023-08-31T01:59:32.031 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-31T01:59:32.031 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-31T01:59:32.068 INFO:tasks.ceph.mon.b:Started 2023-08-31T01:59:32.069 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-31T01:59:32.069 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-31T01:59:32.071 INFO:tasks.ceph.mon.c:Started 2023-08-31T01:59:32.072 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client mount timeout', '600'] 2023-08-31T01:59:32.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client 'client mount timeout' 600 2023-08-31T01:59:32.077 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug client', '20'] 2023-08-31T01:59:32.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client 'debug client' 20 2023-08-31T01:59:32.121 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug ms', '1'] 2023-08-31T01:59:32.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client 'debug ms' 1 2023-08-31T01:59:32.166 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados mon op timeout', '900'] 2023-08-31T01:59:32.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client 'rados mon op timeout' 900 2023-08-31T01:59:32.209 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados osd op timeout', '900'] 2023-08-31T01:59:32.210 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client 'rados osd op timeout' 900 2023-08-31T01:59:32.252 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug mds', '20'] 2023-08-31T01:59:32.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'debug mds' 20 2023-08-31T01:59:32.296 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug mds balancer', '20'] 2023-08-31T01:59:32.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'debug mds balancer' 20 2023-08-31T01:59:32.339 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug ms', '1'] 2023-08-31T01:59:32.340 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'debug ms' 1 2023-08-31T01:59:32.382 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal fragment size max', '10000'] 2023-08-31T01:59:32.383 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'mds bal fragment size max' 10000 2023-08-31T01:59:32.428 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal merge size', '5'] 2023-08-31T01:59:32.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'mds bal merge size' 5 2023-08-31T01:59:32.479 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal split bits', '3'] 2023-08-31T01:59:32.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'mds bal split bits' 3 2023-08-31T01:59:32.542 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal split size', '100'] 2023-08-31T01:59:32.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'mds bal split size' 100 2023-08-31T01:59:32.589 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds debug frag', 'True'] 2023-08-31T01:59:32.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'mds debug frag' True 2023-08-31T01:59:32.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.599+0000 7f2b171b1700 1 -- 172.21.15.84:0/4225805172 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=debug client}] v 0) v1 -- 0x7f2ae8005350 con 0x7f2b100cd060 2023-08-31T01:59:32.593 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds debug scatterstat', 'True'] 2023-08-31T01:59:32.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'mds debug scatterstat' True 2023-08-31T01:59:32.610 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds op complaint time', '180'] 2023-08-31T01:59:32.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'mds op complaint time' 180 2023-08-31T01:59:32.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.607+0000 7fb4afcc3700 1 -- 172.21.15.84:0/3913871957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a809cc50 msgr2=0x7fb4a80cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.607+0000 7fb4afcc3700 1 --2- 172.21.15.84:0/3913871957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a809cc50 0x7fb4a80cb8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8066e30 tx=0x7fb498009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:32.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.607+0000 7fb4afcc3700 1 -- 172.21.15.84:0/3913871957 shutdown_connections 2023-08-31T01:59:32.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.607+0000 7fb4afcc3700 1 --2- 172.21.15.84:0/3913871957 >> v2:172.21.15.84:3300/0 conn(0x7fb4a815f0c0 0x7fb4a815f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.607+0000 7fb4afcc3700 1 --2- 172.21.15.84:0/3913871957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4a809c870 0x7fb4a815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.607+0000 7fb4afcc3700 1 --2- 172.21.15.84:0/3913871957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a809cc50 0x7fb4a80cb8c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.607+0000 7fb4afcc3700 1 -- 172.21.15.84:0/3913871957 >> 172.21.15.84:0/3913871957 conn(0x7fb4a80ae7d0 msgr2=0x7fb4a80aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.608+0000 7fb4afcc3700 1 -- 172.21.15.84:0/3913871957 shutdown_connections 2023-08-31T01:59:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.608+0000 7fb4afcc3700 1 -- 172.21.15.84:0/3913871957 wait complete. 2023-08-31T01:59:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.610+0000 7fb4afcc3700 1 Processor -- start 2023-08-31T01:59:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.610+0000 7fb4afcc3700 1 -- start start 2023-08-31T01:59:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4afcc3700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4a809cc50 0x7fb4a81fbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4afcc3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a815f0c0 0x7fb4a81fe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4afcc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a80b22e0 0x7fb4a80b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4afcc3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81ff5f0 con 0x7fb4a80b22e0 2023-08-31T01:59:32.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4afcc3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81fc070 con 0x7fb4a815f0c0 2023-08-31T01:59:32.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4afcc3700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81ff030 con 0x7fb4a809cc50 2023-08-31T01:59:32.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7f5b145e5700 1 -- 172.21.15.84:0/3016006565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b0c152480 msgr2=0x7f5b0c155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7f5b145e5700 1 --2- 172.21.15.84:0/3016006565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b0c152480 0x7f5b0c155420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0c9980 tx=0x7f5b0400d3b0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7f5b145e5700 1 -- 172.21.15.84:0/3016006565 shutdown_connections 2023-08-31T01:59:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7f5b145e5700 1 --2- 172.21.15.84:0/3016006565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b0c152480 0x7f5b0c155420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7f5b145e5700 1 --2- 172.21.15.84:0/3016006565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af8004850 0x7f5b0c151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7f5b145e5700 1 --2- 172.21.15.84:0/3016006565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b0c15a1d0 0x7f5b0c151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7f5b145e5700 1 -- 172.21.15.84:0/3016006565 >> 172.21.15.84:0/3016006565 conn(0x7f5b0c0afb00 msgr2=0x7f5b0c0cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4ad25e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a815f0c0 0x7fb4a81fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4ad25e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a815f0c0 0x7fb4a81fe6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:53694/0 (socket says 172.21.15.84:53694) 2023-08-31T01:59:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.612+0000 7fb4ad25e700 1 -- 172.21.15.84:0/1642847338 learned_addr learned my addr 172.21.15.84:0/1642847338 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.613+0000 7fb4ae260700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a80b22e0 0x7fb4a80b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.613+0000 7fb4ada5f700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4a809cc50 0x7fb4a81fbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.613+0000 7fb4ae260700 1 -- 172.21.15.84:0/1642847338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4a809cc50 msgr2=0x7fb4a81fbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.613+0000 7fb4ae260700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4a809cc50 0x7fb4a81fbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.613+0000 7fb4ae260700 1 -- 172.21.15.84:0/1642847338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a815f0c0 msgr2=0x7fb4a81fe6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.613+0000 7fb4ae260700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a815f0c0 0x7fb4a81fe6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.613+0000 7fb4ae260700 1 -- 172.21.15.84:0/1642847338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980095f0 con 0x7fb4a80b22e0 2023-08-31T01:59:32.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7fb4ae260700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a80b22e0 0x7fb4a80b0920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400b410 tx=0x7fb4a400b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:32.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7fb49e7fc700 1 -- 172.21.15.84:0/1642847338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4011830 con 0x7fb4a80b22e0 2023-08-31T01:59:32.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7fb49e7fc700 1 -- 172.21.15.84:0/1642847338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7fb4a4011990 con 0x7fb4a80b22e0 2023-08-31T01:59:32.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.614+0000 7fb49e7fc700 1 -- 172.21.15.84:0/1642847338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4011da0 con 0x7fb4a80b22e0 2023-08-31T01:59:32.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.615+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a81ff310 con 0x7fb4a80b22e0 2023-08-31T01:59:32.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.615+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a8069db0 con 0x7fb4a80b22e0 2023-08-31T01:59:32.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.625+0000 7f5b145e5700 1 -- 172.21.15.84:0/3016006565 shutdown_connections 2023-08-31T01:59:32.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.617+0000 7fb49e7fc700 1 -- 172.21.15.84:0/1642847338 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb4a401a700 con 0x7fb4a80b22e0 2023-08-31T01:59:32.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.617+0000 7fb49e7fc700 1 -- 172.21.15.84:0/1642847338 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb4a4019610 con 0x7fb4a80b22e0 2023-08-31T01:59:32.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.621+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4900052f0 con 0x7fb4a80b22e0 2023-08-31T01:59:32.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.625+0000 7fb49e7fc700 1 -- 172.21.15.84:0/1642847338 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb4a4039b00 con 0x7fb4a80b22e0 2023-08-31T01:59:32.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.630+0000 7f5b145e5700 1 -- 172.21.15.84:0/3016006565 wait complete. 2023-08-31T01:59:32.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.631+0000 7f2b0d7fa700 1 -- 172.21.15.84:0/4225805172 <== mon.2 v2:172.21.15.170:3301/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2b0802e900 con 0x7f2b100cd060 2023-08-31T01:59:32.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.632+0000 7f115e7fc700 1 -- 172.21.15.84:0/585076994 <== mon.0 v2:172.21.15.84:3300/0 10 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1158022400 con 0x7f116809cae0 2023-08-31T01:59:32.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.633+0000 7f2b0d7fa700 1 -- 172.21.15.84:0/4225805172 <== mon.2 v2:172.21.15.170:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug client}]=0 v6)=0 v6) v1 ==== 114+0+0 (secure 0 0 0) 0x7f2b0802eca0 con 0x7f2b100cd060 2023-08-31T01:59:32.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.636+0000 7f2b171b1700 1 -- 172.21.15.84:0/4225805172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b100cd060 msgr2=0x7f2b100cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.636+0000 7f2b171b1700 1 --2- 172.21.15.84:0/4225805172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b100cd060 0x7f2b100cd4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b100ada20 tx=0x7f2b0800e420 comp rx=0 tx=0).stop 2023-08-31T01:59:32.630 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds verify scatter', 'True'] 2023-08-31T01:59:32.630 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'mds verify scatter' True 2023-08-31T01:59:32.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.638+0000 7f2b171b1700 1 -- 172.21.15.84:0/4225805172 shutdown_connections 2023-08-31T01:59:32.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.638+0000 7f2b171b1700 1 --2- 172.21.15.84:0/4225805172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b100cd060 0x7f2b100cd4e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.638+0000 7f2b171b1700 1 --2- 172.21.15.84:0/4225805172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b10153610 0x7f2b10159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.638+0000 7f2b171b1700 1 --2- 172.21.15.84:0/4225805172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b1006a230 0x7f2b101f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.638+0000 7f2b171b1700 1 -- 172.21.15.84:0/4225805172 >> 172.21.15.84:0/4225805172 conn(0x7f2b100afb00 msgr2=0x7f2b10156080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.641+0000 7f01dbfff700 1 -- 172.21.15.84:0/3915223372 <== mon.0 v2:172.21.15.84:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f01e8017cf0 con 0x7f01f40cb8a0 2023-08-31T01:59:32.657 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd op complaint time', '180'] 2023-08-31T01:59:32.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'osd op complaint time' 180 2023-08-31T01:59:32.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.648+0000 7f2b171b1700 1 -- 172.21.15.84:0/4225805172 shutdown_connections 2023-08-31T01:59:32.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.648+0000 7f2b171b1700 1 -- 172.21.15.84:0/4225805172 wait complete. 2023-08-31T01:59:32.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.647+0000 7fb49e7fc700 1 -- 172.21.15.84:0/1642847338 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb4a401ab90 con 0x7fb4a80b22e0 2023-08-31T01:59:32.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.663+0000 7f01f3fff700 1 -- 172.21.15.84:0/3915223372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug mds}] v 0) v1 -- 0x7f01cc005350 con 0x7f01f40cb8a0 2023-08-31T01:59:32.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.682+0000 7f01dbfff700 1 -- 172.21.15.84:0/3915223372 <== mon.0 v2:172.21.15.84:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug mds}]=0 v7)=0 v7) v1 ==== 108+0+0 (secure 0 0 0) 0x7f01e800e520 con 0x7f01f40cb8a0 2023-08-31T01:59:32.680 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados mon op timeout', '900'] 2023-08-31T01:59:32.680 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'rados mon op timeout' 900 2023-08-31T01:59:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.684+0000 7f01f3fff700 1 -- 172.21.15.84:0/3915223372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40cb8a0 msgr2=0x7f01f4154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.684+0000 7f01f3fff700 1 --2- 172.21.15.84:0/3915223372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40cb8a0 0x7f01f4154d60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01e800b540 tx=0x7f01e800b850 comp rx=0 tx=0).stop 2023-08-31T01:59:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.693+0000 7f01f3fff700 1 -- 172.21.15.84:0/3915223372 shutdown_connections 2023-08-31T01:59:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.693+0000 7f01f3fff700 1 --2- 172.21.15.84:0/3915223372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f40cbc80 0x7f01f406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.693+0000 7f01f3fff700 1 --2- 172.21.15.84:0/3915223372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01f40b2470 0x7f01f40c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.693+0000 7f01f3fff700 1 --2- 172.21.15.84:0/3915223372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40cb8a0 0x7f01f4154d60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.693+0000 7f01f3fff700 1 -- 172.21.15.84:0/3915223372 >> 172.21.15.84:0/3915223372 conn(0x7f01f40ae5d0 msgr2=0x7f01f40b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.688 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados osd op timeout', '900'] 2023-08-31T01:59:32.688 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds 'rados osd op timeout' 900 2023-08-31T01:59:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.694+0000 7f01f3fff700 1 -- 172.21.15.84:0/3915223372 shutdown_connections 2023-08-31T01:59:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.694+0000 7f01f3fff700 1 -- 172.21.15.84:0/3915223372 wait complete. 2023-08-31T01:59:32.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.725+0000 7f116fc50700 1 -- 172.21.15.84:0/585076994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug mds balancer}] v 0) v1 -- 0x7f11680ad980 con 0x7f116809cae0 2023-08-31T01:59:32.731 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon op complaint time', '120'] 2023-08-31T01:59:32.731 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mon 'mon op complaint time' 120 2023-08-31T01:59:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.755+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug ms}] v 0) v1 -- 0x7fb4840051e0 con 0x7fb4a80b22e0 2023-08-31T01:59:32.758 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd op complaint time', '180'] 2023-08-31T01:59:32.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set osd 'osd op complaint time' 180 2023-08-31T01:59:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.760+0000 7f115e7fc700 1 -- 172.21.15.84:0/585076994 <== mon.0 v2:172.21.15.84:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug mds balancer}]=0 v8)=0 v8) v1 ==== 117+0+0 (secure 0 0 0) 0x7f1158027070 con 0x7f116809cae0 2023-08-31T01:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.768+0000 7f116fc50700 1 -- 172.21.15.84:0/585076994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f116809cae0 msgr2=0x7f1168069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.768+0000 7f116fc50700 1 --2- 172.21.15.84:0/585076994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f116809cae0 0x7f1168069ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f11680cc760 tx=0x7f1158004750 comp rx=0 tx=0).stop 2023-08-31T01:59:32.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.771+0000 7fb49e7fc700 1 -- 172.21.15.84:0/1642847338 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug ms}]=0 v9)=0 v9) v1 ==== 106+0+0 (secure 0 0 0) 0x7fb4a4028030 con 0x7fb4a80b22e0 2023-08-31T01:59:32.775 DEBUG:tasks.ceph:set 21 configs 2023-08-31T01:59:32.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.778+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a80b22e0 msgr2=0x7fb4a80b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.778+0000 7fb4afcc3700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a80b22e0 0x7fb4a80b0920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400b410 tx=0x7fb4a400b720 comp rx=0 tx=0).stop 2023-08-31T01:59:32.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.778+0000 7f8865a44700 1 -- 172.21.15.84:0/2545422966 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600af9f0 msgr2=0x7f88600c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.778+0000 7f8865a44700 1 --2- 172.21.15.84:0/2545422966 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600af9f0 0x7f88600c8d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f88540098c0 tx=0x7f8854009bd0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.780+0000 7f8865a44700 1 -- 172.21.15.84:0/2545422966 shutdown_connections 2023-08-31T01:59:32.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.780+0000 7f8865a44700 1 --2- 172.21.15.84:0/2545422966 >> v2:172.21.15.170:3300/0 conn(0x7f886006cd70 0x7f8860159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.780+0000 7f8865a44700 1 --2- 172.21.15.84:0/2545422966 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600af9f0 0x7f88600c8d10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.780+0000 7f8865a44700 1 -- 172.21.15.84:0/2545422966 >> 172.21.15.84:0/2545422966 conn(0x7f88600ae690 msgr2=0x7f88600aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 shutdown_connections 2023-08-31T01:59:32.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fb4afcc3700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a80b22e0 0x7fb4a80b0920 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fb4afcc3700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4a809cc50 0x7fb4a81fbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fb4afcc3700 1 --2- 172.21.15.84:0/1642847338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a815f0c0 0x7fb4a81fe6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 >> 172.21.15.84:0/1642847338 conn(0x7fb4a80ae7d0 msgr2=0x7fb4a80ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 shutdown_connections 2023-08-31T01:59:32.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fb4afcc3700 1 -- 172.21.15.84:0/1642847338 wait complete. 2023-08-31T01:59:32.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fd878690700 1 -- 172.21.15.84:0/762154158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 msgr2=0x7fd8700cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.783+0000 7fd878690700 1 --2- 172.21.15.84:0/762154158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 0x7fd8700cb8c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd8600098c0 tx=0x7fd860009bd0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.785+0000 7fd878690700 1 -- 172.21.15.84:0/762154158 shutdown_connections 2023-08-31T01:59:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.785+0000 7fd878690700 1 --2- 172.21.15.84:0/762154158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 0x7fd8700cb8c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.785+0000 7fd878690700 1 -- 172.21.15.84:0/762154158 >> 172.21.15.84:0/762154158 conn(0x7fd8700ae7d0 msgr2=0x7fd8700aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.786+0000 7f116fc50700 1 -- 172.21.15.84:0/585076994 shutdown_connections 2023-08-31T01:59:32.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.786+0000 7f116fc50700 1 --2- 172.21.15.84:0/585076994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f116809cec0 0x7f1168156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.786+0000 7f116fc50700 1 --2- 172.21.15.84:0/585076994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11680704a0 0x7f1168155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.786+0000 7f116fc50700 1 --2- 172.21.15.84:0/585076994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f116809cae0 0x7f1168069ab0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.786+0000 7f116fc50700 1 -- 172.21.15.84:0/585076994 >> 172.21.15.84:0/585076994 conn(0x7f11680ae7d0 msgr2=0x7f11680adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.788+0000 7f8865a44700 1 -- 172.21.15.84:0/2545422966 shutdown_connections 2023-08-31T01:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.788+0000 7f116fc50700 1 -- 172.21.15.84:0/585076994 shutdown_connections 2023-08-31T01:59:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.788+0000 7f116fc50700 1 -- 172.21.15.84:0/585076994 wait complete. 2023-08-31T01:59:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.788+0000 7f8865a44700 1 -- 172.21.15.84:0/2545422966 wait complete. 2023-08-31T01:59:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.789+0000 7f8865a44700 1 Processor -- start 2023-08-31T01:59:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.790+0000 7f8865a44700 1 -- start start 2023-08-31T01:59:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.790+0000 7f8865a44700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f886006cd70 0x7f88601fe290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.790+0000 7f8865a44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88600af9f0 0x7f88600c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.790+0000 7f8865a44700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600cb9f0 0x7f88600afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.790+0000 7f8865a44700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860156910 con 0x7f88600af9f0 2023-08-31T01:59:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.790+0000 7f8865a44700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88600c1d90 con 0x7f886006cd70 2023-08-31T01:59:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.790+0000 7f8865a44700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88600c17d0 con 0x7f88600cb9f0 2023-08-31T01:59:32.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.795+0000 7f885effd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f886006cd70 0x7f88601fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.795+0000 7fd878690700 1 -- 172.21.15.84:0/762154158 shutdown_connections 2023-08-31T01:59:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.795+0000 7fd878690700 1 -- 172.21.15.84:0/762154158 wait complete. 2023-08-31T01:59:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.797+0000 7fd878690700 1 Processor -- start 2023-08-31T01:59:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.797+0000 7f885effd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f886006cd70 0x7f88601fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:53708/0 (socket says 172.21.15.84:53708) 2023-08-31T01:59:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.797+0000 7f885effd700 1 -- 172.21.15.84:0/2223522973 learned_addr learned my addr 172.21.15.84:0/2223522973 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.797+0000 7f885e7fc700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88600af9f0 0x7f88600c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.797+0000 7f885f7fe700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600cb9f0 0x7f88600afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.797+0000 7f885f7fe700 1 -- 172.21.15.84:0/2223522973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f886006cd70 msgr2=0x7f88601fe290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.797+0000 7f885f7fe700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f886006cd70 0x7f88601fe290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7f885f7fe700 1 -- 172.21.15.84:0/2223522973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88600af9f0 msgr2=0x7f88600c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7f885f7fe700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88600af9f0 0x7f88600c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7f885f7fe700 1 -- 172.21.15.84:0/2223522973 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854009520 con 0x7f88600cb9f0 2023-08-31T01:59:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.797+0000 7fd878690700 1 -- start start 2023-08-31T01:59:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd878690700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 0x7fd8701fe130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd878690700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd87009cec0 0x7fd87009a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd878690700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8700cbe00 0x7fd87009a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd878690700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87009aca0 con 0x7fd87009cae0 2023-08-31T01:59:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd878690700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87009aea0 con 0x7fd8700cbe00 2023-08-31T01:59:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd878690700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87009b180 con 0x7fd87009cec0 2023-08-31T01:59:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd87642c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 0x7fd8701fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd87642c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 0x7fd8701fe130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50066/0 (socket says 172.21.15.84:50066) 2023-08-31T01:59:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd87642c700 1 -- 172.21.15.84:0/431129247 learned_addr learned my addr 172.21.15.84:0/431129247 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.798+0000 7fd876c2d700 1 --2- 172.21.15.84:0/431129247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8700cbe00 0x7fd87009a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.799+0000 7fd87642c700 1 -- 172.21.15.84:0/431129247 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd87009cec0 msgr2=0x7fd87009a220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T01:59:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.799+0000 7fd87642c700 1 --2- 172.21.15.84:0/431129247 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd87009cec0 0x7fd87009a220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.799+0000 7fd87642c700 1 -- 172.21.15.84:0/431129247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8700cbe00 msgr2=0x7fd87009a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.799+0000 7fd87642c700 1 --2- 172.21.15.84:0/431129247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8700cbe00 0x7fd87009a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.799+0000 7fd87642c700 1 -- 172.21.15.84:0/431129247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860009520 con 0x7fd87009cae0 2023-08-31T01:59:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.799+0000 7fd87642c700 1 --2- 172.21.15.84:0/431129247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 0x7fd8701fe130 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd870073000 tx=0x7fd8600042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.809+0000 7f885f7fe700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600cb9f0 0x7f88600afed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f885800ab70 tx=0x7f885800ae80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:32.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.817+0000 7fd866ffd700 1 -- 172.21.15.84:0/431129247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86001d070 con 0x7fd87009cae0 2023-08-31T01:59:32.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.817+0000 7fd866ffd700 1 -- 172.21.15.84:0/431129247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd86000b830 con 0x7fd87009cae0 2023-08-31T01:59:32.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.817+0000 7fd866ffd700 1 -- 172.21.15.84:0/431129247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86000bc20 con 0x7fd87009cae0 2023-08-31T01:59:32.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.817+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87009b460 con 0x7fd87009cae0 2023-08-31T01:59:32.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.817+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87009ba20 con 0x7fd87009cae0 2023-08-31T01:59:32.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.818+0000 7f8847fff700 1 -- 172.21.15.84:0/2223522973 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800f070 con 0x7f88600cb9f0 2023-08-31T01:59:32.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.818+0000 7f8847fff700 1 -- 172.21.15.84:0/2223522973 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8858004bb0 con 0x7f88600cb9f0 2023-08-31T01:59:32.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.818+0000 7f8847fff700 1 -- 172.21.15.84:0/2223522973 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800c600 con 0x7f88600cb9f0 2023-08-31T01:59:32.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.819+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88600c1ab0 con 0x7f88600cb9f0 2023-08-31T01:59:32.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.819+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886006afc0 con 0x7f88600cb9f0 2023-08-31T01:59:32.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.820+0000 7fd866ffd700 1 -- 172.21.15.84:0/431129247 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd86000bd80 con 0x7fd87009cae0 2023-08-31T01:59:32.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.820+0000 7fd866ffd700 1 -- 172.21.15.84:0/431129247 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd86000fda0 con 0x7fd87009cae0 2023-08-31T01:59:32.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.820+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87009bc40 con 0x7fd87009cae0 2023-08-31T01:59:32.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.824+0000 7fd866ffd700 1 -- 172.21.15.84:0/431129247 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd860026070 con 0x7fd87009cae0 2023-08-31T01:59:32.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.828+0000 7f8847fff700 1 -- 172.21.15.84:0/2223522973 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f885800ca60 con 0x7f88600cb9f0 2023-08-31T01:59:32.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.828+0000 7f8847fff700 1 -- 172.21.15.84:0/2223522973 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f88580057c0 con 0x7f88600cb9f0 2023-08-31T01:59:32.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.828+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88400052f0 con 0x7f88600cb9f0 2023-08-31T01:59:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.841+0000 7f8847fff700 1 -- 172.21.15.84:0/2223522973 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8858017020 con 0x7f88600cb9f0 2023-08-31T01:59:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.850+0000 7f92a8465700 1 -- 172.21.15.84:0/3955117809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00702a0 msgr2=0x7f92a00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.850+0000 7f92a8465700 1 --2- 172.21.15.84:0/3955117809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00702a0 0x7f92a00706f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f92a00676e0 tx=0x7f929800b380 comp rx=0 tx=0).stop 2023-08-31T01:59:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.851+0000 7f92a8465700 1 -- 172.21.15.84:0/3955117809 shutdown_connections 2023-08-31T01:59:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.851+0000 7f92a8465700 1 --2- 172.21.15.84:0/3955117809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00702a0 0x7f92a00706f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.851+0000 7f92a8465700 1 --2- 172.21.15.84:0/3955117809 >> v2:172.21.15.170:3300/0 conn(0x7f92a009c870 0x7f92a015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.851+0000 7f92a8465700 1 -- 172.21.15.84:0/3955117809 >> 172.21.15.84:0/3955117809 conn(0x7f92a00ae7d0 msgr2=0x7f92a00aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.857+0000 7f92a8465700 1 -- 172.21.15.84:0/3955117809 shutdown_connections 2023-08-31T01:59:32.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.857+0000 7f92a8465700 1 -- 172.21.15.84:0/3955117809 wait complete. 2023-08-31T01:59:32.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.859+0000 7f92a8465700 1 Processor -- start 2023-08-31T01:59:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.859+0000 7f92a8465700 1 -- start start 2023-08-31T01:59:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.860+0000 7f92a8465700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a00702a0 0x7f92a01f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.860+0000 7f92a8465700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92a009c870 0x7f92a00c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.860+0000 7f92a8465700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a009cc50 0x7f92a01f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.860+0000 7f92a8465700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c3000 con 0x7f92a009cc50 2023-08-31T01:59:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.860+0000 7f92a8465700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c08b0 con 0x7f92a00702a0 2023-08-31T01:59:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.860+0000 7f92a8465700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c0b20 con 0x7f92a009c870 2023-08-31T01:59:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.860+0000 7f92a6201700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a00702a0 0x7f92a01f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a6201700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a00702a0 0x7f92a01f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:53722/0 (socket says 172.21.15.84:53722) 2023-08-31T01:59:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a6201700 1 -- 172.21.15.84:0/3756148615 learned_addr learned my addr 172.21.15.84:0/3756148615 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a5a00700 1 --2- 172.21.15.84:0/3756148615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92a009c870 0x7f92a00c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a6201700 1 -- 172.21.15.84:0/3756148615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92a009c870 msgr2=0x7f92a00c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a6201700 1 --2- 172.21.15.84:0/3756148615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92a009c870 0x7f92a00c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a6201700 1 -- 172.21.15.84:0/3756148615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a009cc50 msgr2=0x7f92a01f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a6201700 1 --2- 172.21.15.84:0/3756148615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a009cc50 0x7f92a01f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a6201700 1 -- 172.21.15.84:0/3756148615 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298009d00 con 0x7f92a00702a0 2023-08-31T01:59:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.861+0000 7f92a6201700 1 --2- 172.21.15.84:0/3756148615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a00702a0 0x7f92a01f4660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f929c00b550 tx=0x7f929c00b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:32.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.882+0000 7f9296ffd700 1 -- 172.21.15.84:0/3756148615 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c011830 con 0x7f92a00702a0 2023-08-31T01:59:32.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.882+0000 7f9296ffd700 1 -- 172.21.15.84:0/3756148615 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f929c011aa0 con 0x7f92a00702a0 2023-08-31T01:59:32.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.882+0000 7f9296ffd700 1 -- 172.21.15.84:0/3756148615 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c010380 con 0x7f92a00702a0 2023-08-31T01:59:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.893+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a00c0e00 con 0x7f92a00702a0 2023-08-31T01:59:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.893+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a00c8e80 con 0x7f92a00702a0 2023-08-31T01:59:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.894+0000 7f9296ffd700 1 -- 172.21.15.84:0/3756148615 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f929c0107e0 con 0x7f92a00702a0 2023-08-31T01:59:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.894+0000 7f9296ffd700 1 -- 172.21.15.84:0/3756148615 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f929c01a9a0 con 0x7f92a00702a0 2023-08-31T01:59:32.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.913+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a00c0f90 con 0x7f92a00702a0 2023-08-31T01:59:32.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.921+0000 7f9296ffd700 1 -- 172.21.15.84:0/3756148615 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f929c015020 con 0x7f92a00702a0 2023-08-31T01:59:32.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.952+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/2169247328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f7809cae0 msgr2=0x7f2f780cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.952+0000 7f2f7ea3b700 1 --2- 172.21.15.84:0/2169247328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f7809cae0 0x7f2f780cb8c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c005fd0 tx=0x7f2f6c009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:32.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.952+0000 7fce60f8d700 1 -- 172.21.15.84:0/4264501555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0cbb30 msgr2=0x7fce5c16c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.952+0000 7fce60f8d700 1 --2- 172.21.15.84:0/4264501555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0cbb30 0x7fce5c16c450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005f00 tx=0x7fce4c0074a0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.952+0000 7fce60f8d700 1 -- 172.21.15.84:0/4264501555 shutdown_connections 2023-08-31T01:59:32.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.952+0000 7fce60f8d700 1 --2- 172.21.15.84:0/4264501555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0cbb30 0x7fce5c16c450 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005f00 tx=0x7fce4c0074a0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.952+0000 7fce60f8d700 1 -- 172.21.15.84:0/4264501555 >> 172.21.15.84:0/4264501555 conn(0x7fce5c0ae7d0 msgr2=0x7fce5c0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.962+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/2169247328 shutdown_connections 2023-08-31T01:59:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.962+0000 7f2f7ea3b700 1 --2- 172.21.15.84:0/2169247328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f7809cae0 0x7f2f780cb8c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.962+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/2169247328 >> 172.21.15.84:0/2169247328 conn(0x7f2f780ae7d0 msgr2=0x7f2f780aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.962+0000 7fce60f8d700 1 -- 172.21.15.84:0/4264501555 shutdown_connections 2023-08-31T01:59:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.971+0000 7fce60f8d700 1 -- 172.21.15.84:0/4264501555 wait complete. 2023-08-31T01:59:32.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.973+0000 7fce60f8d700 1 Processor -- start 2023-08-31T01:59:32.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.972+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/2169247328 shutdown_connections 2023-08-31T01:59:32.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.973+0000 7fce60f8d700 1 -- start start 2023-08-31T01:59:32.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce60f8d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0cbf10 0x7fce5c0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce60f8d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c0c7590 0x7fce5c0c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce60f8d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0ad760 0x7fce5c0c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce60f8d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c083cd0 con 0x7fce5c0ad760 2023-08-31T01:59:32.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce60f8d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0c8e00 con 0x7fce5c0c7590 2023-08-31T01:59:32.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce60f8d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0c42f0 con 0x7fce5c0cbf10 2023-08-31T01:59:32.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/2169247328 wait complete. 2023-08-31T01:59:32.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce5ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0ad760 0x7fce5c0c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce5ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0ad760 0x7fce5c0c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50090/0 (socket says 172.21.15.84:50090) 2023-08-31T01:59:32.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.974+0000 7fce5ad9d700 1 -- 172.21.15.84:0/2481066612 learned_addr learned my addr 172.21.15.84:0/2481066612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:32.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.975+0000 7fce5a59c700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0cbf10 0x7fce5c0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.975+0000 7fce59d9b700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c0c7590 0x7fce5c0c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.975+0000 7fce5a59c700 1 -- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c0c7590 msgr2=0x7fce5c0c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.975+0000 7fce5a59c700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c0c7590 0x7fce5c0c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.975+0000 7fce5a59c700 1 -- 172.21.15.84:0/2481066612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0ad760 msgr2=0x7fce5c0c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.975+0000 7fce5a59c700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0ad760 0x7fce5c0c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.975+0000 7fce5a59c700 1 -- 172.21.15.84:0/2481066612 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c00d040 con 0x7fce5c0cbf10 2023-08-31T01:59:32.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.975+0000 7fce5a59c700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0cbf10 0x7fce5c0c3db0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fce4c016000 tx=0x7fce4c009470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:32.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.976+0000 7f2f7ea3b700 1 Processor -- start 2023-08-31T01:59:32.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.976+0000 7f2f7ea3b700 1 -- start start 2023-08-31T01:59:32.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f7ea3b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f7809cae0 0x7f2f78155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f7ea3b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7809cec0 0x7f2f780c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f7ea3b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f780cbe00 0x7f2f7815def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:32.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f7ea3b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780c1d00 con 0x7f2f780cbe00 2023-08-31T01:59:32.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f7ea3b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780c1fe0 con 0x7f2f7809cec0 2023-08-31T01:59:32.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f7ea3b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780c22c0 con 0x7f2f7809cae0 2023-08-31T01:59:32.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f777fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7809cec0 0x7f2f780c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:32.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f777fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7809cec0 0x7f2f780c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:53744/0 (socket says 172.21.15.84:53744) 2023-08-31T01:59:32.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f777fe700 1 -- 172.21.15.84:0/4138928906 learned_addr learned my addr 172.21.15.84:0/4138928906 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:32.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f777fe700 1 -- 172.21.15.84:0/4138928906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f7809cae0 msgr2=0x7f2f78155c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T01:59:32.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f777fe700 1 --2- 172.21.15.84:0/4138928906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f7809cae0 0x7f2f78155c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f777fe700 1 -- 172.21.15.84:0/4138928906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f780cbe00 msgr2=0x7f2f7815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:32.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f777fe700 1 --2- 172.21.15.84:0/4138928906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f780cbe00 0x7f2f7815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:32.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.978+0000 7f2f777fe700 1 -- 172.21.15.84:0/4138928906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0095f0 con 0x7f2f7809cec0 2023-08-31T01:59:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.979+0000 7f2f777fe700 1 --2- 172.21.15.84:0/4138928906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7809cec0 0x7f2f780c3060 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800b470 tx=0x7f2f6800b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.979+0000 7f2f74ff9700 1 -- 172.21.15.84:0/4138928906 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68011830 con 0x7f2f7809cec0 2023-08-31T01:59:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.979+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f780c25a0 con 0x7f2f7809cec0 2023-08-31T01:59:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.979+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f78156140 con 0x7f2f7809cec0 2023-08-31T01:59:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.980+0000 7f2f74ff9700 1 -- 172.21.15.84:0/4138928906 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f68011aa0 con 0x7f2f7809cec0 2023-08-31T01:59:32.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.980+0000 7f2f74ff9700 1 -- 172.21.15.84:0/4138928906 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68010380 con 0x7f2f7809cec0 2023-08-31T01:59:32.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.976+0000 7fce4affd700 1 -- 172.21.15.84:0/2481066612 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c004a30 con 0x7fce5c0cbf10 2023-08-31T01:59:32.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.976+0000 7fce4affd700 1 -- 172.21.15.84:0/2481066612 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce4c004ca0 con 0x7fce5c0cbf10 2023-08-31T01:59:32.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.976+0000 7fce4affd700 1 -- 172.21.15.84:0/2481066612 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c005280 con 0x7fce5c0cbf10 2023-08-31T01:59:32.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.976+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c083f20 con 0x7fce5c0cbf10 2023-08-31T01:59:32.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.976+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c06b5d0 con 0x7fce5c0cbf10 2023-08-31T01:59:32.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.981+0000 7fce4affd700 1 -- 172.21.15.84:0/2481066612 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce4c003680 con 0x7fce5c0cbf10 2023-08-31T01:59:32.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.981+0000 7fce4affd700 1 -- 172.21.15.84:0/2481066612 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fce4c020030 con 0x7fce5c0cbf10 2023-08-31T01:59:32.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.981+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f540052f0 con 0x7f2f7809cec0 2023-08-31T01:59:32.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.981+0000 7f2f74ff9700 1 -- 172.21.15.84:0/4138928906 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2f68010820 con 0x7f2f7809cec0 2023-08-31T01:59:32.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.981+0000 7f2f74ff9700 1 -- 172.21.15.84:0/4138928906 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f6801a950 con 0x7f2f7809cec0 2023-08-31T01:59:32.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.981+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c04e7c0 con 0x7fce5c0cbf10 2023-08-31T01:59:32.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.984+0000 7fce4affd700 1 -- 172.21.15.84:0/2481066612 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fce4c015020 con 0x7fce5c0cbf10 2023-08-31T01:59:32.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:32.990+0000 7f2f74ff9700 1 -- 172.21.15.84:0/4138928906 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2f68039b00 con 0x7f2f7809cec0 2023-08-31T01:59:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.007+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=mds bal fragment size max}] v 0) v1 -- 0x7f8840005870 con 0x7f88600cb9f0 2023-08-31T01:59:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.012+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds bal merge size}] v 0) v1 -- 0x7fd87004e7c0 con 0x7fd87009cae0 2023-08-31T01:59:33.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.017+0000 7fe795298700 1 -- 172.21.15.84:0/1964988167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79009c870 msgr2=0x7fe79015b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.017+0000 7fe795298700 1 --2- 172.21.15.84:0/1964988167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79009c870 0x7fe79015b950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe7900734e0 tx=0x7fe780009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:33.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.017+0000 7f3f611a5700 1 -- 172.21.15.84:0/739097883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cae0 msgr2=0x7f3f5c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.017+0000 7f3f611a5700 1 --2- 172.21.15.84:0/739097883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cae0 0x7f3f5c0cb8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c067da0 tx=0x7f3f4c009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:33.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7fe795298700 1 -- 172.21.15.84:0/1964988167 shutdown_connections 2023-08-31T01:59:33.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7fe795298700 1 --2- 172.21.15.84:0/1964988167 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe79015f0c0 0x7fe79015f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7fe795298700 1 --2- 172.21.15.84:0/1964988167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79009c870 0x7fe79015b950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7fe795298700 1 --2- 172.21.15.84:0/1964988167 >> v2:172.21.15.170:3300/0 conn(0x7fe79009cc50 0x7fe7900cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7fe795298700 1 -- 172.21.15.84:0/1964988167 >> 172.21.15.84:0/1964988167 conn(0x7fe7900ae7d0 msgr2=0x7fe7900aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7f3f611a5700 1 -- 172.21.15.84:0/739097883 shutdown_connections 2023-08-31T01:59:33.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7f3f611a5700 1 --2- 172.21.15.84:0/739097883 >> v2:172.21.15.170:3300/0 conn(0x7f3f5c09cec0 0x7f3f5c15f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7f3f611a5700 1 --2- 172.21.15.84:0/739097883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cae0 0x7f3f5c0cb8c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7f3f611a5700 1 --2- 172.21.15.84:0/739097883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f5c0cbe00 0x7f3f5c15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7f3f611a5700 1 -- 172.21.15.84:0/739097883 >> 172.21.15.84:0/739097883 conn(0x7f3f5c0ae7d0 msgr2=0x7f3f5c0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7fe795298700 1 -- 172.21.15.84:0/1964988167 shutdown_connections 2023-08-31T01:59:33.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.018+0000 7fe795298700 1 -- 172.21.15.84:0/1964988167 wait complete. 2023-08-31T01:59:33.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.020+0000 7fe795298700 1 Processor -- start 2023-08-31T01:59:33.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.020+0000 7f3f611a5700 1 -- 172.21.15.84:0/739097883 shutdown_connections 2023-08-31T01:59:33.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.021+0000 7fa67ae48700 1 -- 172.21.15.84:0/3482058067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 msgr2=0x7fa67416abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.021+0000 7fa67ae48700 1 --2- 172.21.15.84:0/3482058067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 0x7fa67416abe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009f90 tx=0x7fa66c00b330 comp rx=0 tx=0).stop 2023-08-31T01:59:33.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.021+0000 7fa67ae48700 1 -- 172.21.15.84:0/3482058067 shutdown_connections 2023-08-31T01:59:33.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.021+0000 7fa67ae48700 1 --2- 172.21.15.84:0/3482058067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 0x7fa67416abe0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.021+0000 7fa67ae48700 1 -- 172.21.15.84:0/3482058067 >> 172.21.15.84:0/3482058067 conn(0x7fa6740ae7d0 msgr2=0x7fa6740aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.021+0000 7fa67ae48700 1 -- 172.21.15.84:0/3482058067 shutdown_connections 2023-08-31T01:59:33.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.021+0000 7fa67ae48700 1 -- 172.21.15.84:0/3482058067 wait complete. 2023-08-31T01:59:33.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7fa67ae48700 1 Processor -- start 2023-08-31T01:59:33.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7f49e5efb700 1 -- 172.21.15.84:0/3790660634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e009cae0 msgr2=0x7f49e00cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7f49e5efb700 1 --2- 172.21.15.84:0/3790660634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e009cae0 0x7f49e00cb8c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f49e0067da0 tx=0x7f49d4009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:33.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7fe3e784f700 1 -- 172.21.15.84:0/187883313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbf10 msgr2=0x7fe3e00c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7fe3e784f700 1 --2- 172.21.15.84:0/187883313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbf10 0x7fe3e00c8400 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800b5c0 tx=0x7fe3d800b8d0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.020+0000 7f3f611a5700 1 -- 172.21.15.84:0/739097883 wait complete. 2023-08-31T01:59:33.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7f3f611a5700 1 Processor -- start 2023-08-31T01:59:33.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.021+0000 7fe795298700 1 -- start start 2023-08-31T01:59:33.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.022+0000 7fe795298700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe79009c870 0x7fe7900c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.022+0000 7fe795298700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79009cc50 0x7fe7901f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.022+0000 7fe795298700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe79015f0c0 0x7fe7900b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.022+0000 7fe795298700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901f6e80 con 0x7fe79009cc50 2023-08-31T01:59:33.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.022+0000 7fe795298700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901f63e0 con 0x7fe79009c870 2023-08-31T01:59:33.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.022+0000 7fe795298700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900b0b50 con 0x7fe79015f0c0 2023-08-31T01:59:33.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7fe78f7fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe79015f0c0 0x7fe7900b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7fe78f7fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe79015f0c0 0x7fe7900b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:44352/0 (socket says 172.21.15.84:44352) 2023-08-31T01:59:33.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7fe78f7fe700 1 -- 172.21.15.84:0/1182880290 learned_addr learned my addr 172.21.15.84:0/1182880290 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7fe78effd700 1 --2- 172.21.15.84:0/1182880290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe79009c870 0x7fe7900c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7f3f611a5700 1 -- start start 2023-08-31T01:59:33.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fe78f7fe700 1 -- 172.21.15.84:0/1182880290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe79009c870 msgr2=0x7fe7900c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fe78f7fe700 1 --2- 172.21.15.84:0/1182880290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe79009c870 0x7fe7900c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fe78f7fe700 1 -- 172.21.15.84:0/1182880290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79009cc50 msgr2=0x7fe7901f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fe78f7fe700 1 --2- 172.21.15.84:0/1182880290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79009cc50 0x7fe7901f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fe78f7fe700 1 -- 172.21.15.84:0/1182880290 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800095f0 con 0x7fe79015f0c0 2023-08-31T01:59:33.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f8847fff700 1 -- 172.21.15.84:0/2223522973 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal fragment size max}]=0 v10)=0 v10) v1 ==== 127+0+0 (secure 0 0 0) 0x7f88580059d0 con 0x7f88600cb9f0 2023-08-31T01:59:33.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f3f611a5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f5c09cae0 0x7f3f5c06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f3f611a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cec0 0x7f3f5c0bf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f3f611a5700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f5c0cbe00 0x7f3f5c1fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f3f611a5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c22d0 con 0x7f3f5c09cec0 2023-08-31T01:59:33.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f3f611a5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0bfeb0 con 0x7f3f5c09cae0 2023-08-31T01:59:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f3f611a5700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c19a0 con 0x7f3f5c0cbe00 2023-08-31T01:59:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f49e5efb700 1 -- 172.21.15.84:0/3790660634 shutdown_connections 2023-08-31T01:59:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f49e5efb700 1 --2- 172.21.15.84:0/3790660634 >> v2:172.21.15.170:3300/0 conn(0x7f49e009cec0 0x7f49e015f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f49e5efb700 1 --2- 172.21.15.84:0/3790660634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e009cae0 0x7f49e00cb8c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f49e5efb700 1 --2- 172.21.15.84:0/3790660634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49e00cbe00 0x7f49e015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f49e5efb700 1 -- 172.21.15.84:0/3790660634 >> 172.21.15.84:0/3790660634 conn(0x7f49e00ae7d0 msgr2=0x7f49e00aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7f49e5efb700 1 -- 172.21.15.84:0/3790660634 shutdown_connections 2023-08-31T01:59:33.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.023+0000 7fa67ae48700 1 -- start start 2023-08-31T01:59:33.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fa67ae48700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 0x7fa67415f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fa67ae48700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa67409cae0 0x7fa6740abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fa67ae48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67409cec0 0x7fa674155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fa67ae48700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa674150d90 con 0x7fa67409cec0 2023-08-31T01:59:33.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fa67ae48700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67416af20 con 0x7fa67409cae0 2023-08-31T01:59:33.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.024+0000 7fa67ae48700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740ac140 con 0x7fa6740714b0 2023-08-31T01:59:33.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe78f7fe700 1 --2- 172.21.15.84:0/1182880290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe79015f0c0 0x7fe7900b2290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe788007c90 tx=0x7fe78800d0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe7777fe700 1 -- 172.21.15.84:0/1182880290 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788017070 con 0x7fe79015f0c0 2023-08-31T01:59:33.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe7777fe700 1 -- 172.21.15.84:0/1182880290 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe78800f040 con 0x7fe79015f0c0 2023-08-31T01:59:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe7777fe700 1 -- 172.21.15.84:0/1182880290 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800d9b0 con 0x7fe79015f0c0 2023-08-31T01:59:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe3e784f700 1 -- 172.21.15.84:0/187883313 shutdown_connections 2023-08-31T01:59:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe3e784f700 1 --2- 172.21.15.84:0/187883313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbf10 0x7fe3e00c8400 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe3e784f700 1 --2- 172.21.15.84:0/187883313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3e00cbb30 0x7fe3e016c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe3e784f700 1 -- 172.21.15.84:0/187883313 >> 172.21.15.84:0/187883313 conn(0x7fe3e00ae7d0 msgr2=0x7fe3e00aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7900b27d0 con 0x7fe79015f0c0 2023-08-31T01:59:33.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7901f68c0 con 0x7fe79015f0c0 2023-08-31T01:59:33.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe3e784f700 1 -- 172.21.15.84:0/187883313 shutdown_connections 2023-08-31T01:59:33.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7f49e5efb700 1 -- 172.21.15.84:0/3790660634 wait complete. 2023-08-31T01:59:33.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.026+0000 7f49e5efb700 1 Processor -- start 2023-08-31T01:59:33.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.026+0000 7fe7777fe700 1 -- 172.21.15.84:0/1182880290 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe78801c410 con 0x7fe79015f0c0 2023-08-31T01:59:33.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.026+0000 7fe7777fe700 1 -- 172.21.15.84:0/1182880290 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe788013480 con 0x7fe79015f0c0 2023-08-31T01:59:33.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.027+0000 7f49e5efb700 1 -- start start 2023-08-31T01:59:33.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.025+0000 7fe3e784f700 1 -- 172.21.15.84:0/187883313 wait complete. 2023-08-31T01:59:33.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.027+0000 7fe3e784f700 1 Processor -- start 2023-08-31T01:59:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49e5efb700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49e009cae0 0x7f49e01f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49e5efb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49e009cec0 0x7f49e006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49e5efb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00cbe00 0x7f49e0159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49e5efb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e006ba00 con 0x7f49e00cbe00 2023-08-31T01:59:33.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49e5efb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00c00e0 con 0x7f49e009cec0 2023-08-31T01:59:33.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49e5efb700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e02007a0 con 0x7f49e009cae0 2023-08-31T01:59:33.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49df7fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49e009cae0 0x7f49e01f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49df7fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49e009cae0 0x7f49e01f91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:44370/0 (socket says 172.21.15.84:44370) 2023-08-31T01:59:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49df7fe700 1 -- 172.21.15.84:0/803030863 learned_addr learned my addr 172.21.15.84:0/803030863 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.028+0000 7f49deffd700 1 --2- 172.21.15.84:0/803030863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49e009cec0 0x7f49e006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7fa678be4700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 0x7fa67415f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7fa673fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa67409cae0 0x7fa6740abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49df7fe700 1 -- 172.21.15.84:0/803030863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49e009cec0 msgr2=0x7f49e006a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49df7fe700 1 --2- 172.21.15.84:0/803030863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49e009cec0 0x7f49e006a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49df7fe700 1 -- 172.21.15.84:0/803030863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00cbe00 msgr2=0x7f49e0159c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T01:59:33.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49df7fe700 1 --2- 172.21.15.84:0/803030863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00cbe00 0x7f49e0159c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49df7fe700 1 -- 172.21.15.84:0/803030863 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40095f0 con 0x7f49e009cae0 2023-08-31T01:59:33.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7fa678be4700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 0x7fa67415f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:44362/0 (socket says 172.21.15.84:44362) 2023-08-31T01:59:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7fa678be4700 1 -- 172.21.15.84:0/2900248899 learned_addr learned my addr 172.21.15.84:0/2900248899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49df7fe700 1 --2- 172.21.15.84:0/803030863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49e009cae0 0x7f49e01f91f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f49e0073000 tx=0x7f49d4004240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7fa6793e5700 1 --2- 172.21.15.84:0/2900248899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67409cec0 0x7fa674155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fa6793e5700 1 -- 172.21.15.84:0/2900248899 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 msgr2=0x7fa67415f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fa6793e5700 1 --2- 172.21.15.84:0/2900248899 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 0x7fa67415f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fa6793e5700 1 -- 172.21.15.84:0/2900248899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa67409cae0 msgr2=0x7fa6740abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fa6793e5700 1 --2- 172.21.15.84:0/2900248899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa67409cae0 0x7fa6740abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fa6793e5700 1 -- 172.21.15.84:0/2900248899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009c40 con 0x7fa67409cec0 2023-08-31T01:59:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.032+0000 7fa6793e5700 1 --2- 172.21.15.84:0/2900248899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67409cec0 0x7fa674155f00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa66c014000 tx=0x7fa66c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.033+0000 7fa6717fa700 1 -- 172.21.15.84:0/2900248899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00e070 con 0x7fa67409cec0 2023-08-31T01:59:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.033+0000 7fa6717fa700 1 -- 172.21.15.84:0/2900248899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa66c004bb0 con 0x7fa67409cec0 2023-08-31T01:59:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.033+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6740afa70 con 0x7fa67409cec0 2023-08-31T01:59:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.033+0000 7fa6717fa700 1 -- 172.21.15.84:0/2900248899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c004240 con 0x7fa67409cec0 2023-08-31T01:59:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.033+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674150a20 con 0x7fa67409cec0 2023-08-31T01:59:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.033+0000 7fa6717fa700 1 -- 172.21.15.84:0/2900248899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa66c019040 con 0x7fa67409cec0 2023-08-31T01:59:33.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.033+0000 7fa6717fa700 1 -- 172.21.15.84:0/2900248899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa66c01bd60 con 0x7fa67409cec0 2023-08-31T01:59:33.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49c7fff700 1 -- 172.21.15.84:0/803030863 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d401d070 con 0x7f49e009cae0 2023-08-31T01:59:33.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49c7fff700 1 -- 172.21.15.84:0/803030863 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f49d4003890 con 0x7f49e009cae0 2023-08-31T01:59:33.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49c7fff700 1 -- 172.21.15.84:0/803030863 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4003cc0 con 0x7f49e009cae0 2023-08-31T01:59:33.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e006b440 con 0x7f49e009cae0 2023-08-31T01:59:33.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e0200430 con 0x7f49e009cae0 2023-08-31T01:59:33.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7f49c7fff700 1 -- 172.21.15.84:0/803030863 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f49d4004830 con 0x7f49e009cae0 2023-08-31T01:59:33.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7f49c7fff700 1 -- 172.21.15.84:0/803030863 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f49d40054f0 con 0x7f49e009cae0 2023-08-31T01:59:33.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.029+0000 7fe3e784f700 1 -- start start 2023-08-31T01:59:33.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7fe3e784f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3e0088280 0x7fe3e006a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7fe3e784f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbb30 0x7fe3e007bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7fe3e784f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3e00cbf10 0x7fe3e0200140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7fe3e784f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e006ac70 con 0x7fe3e00cbb30 2023-08-31T01:59:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7fe3e784f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e0069d60 con 0x7fe3e00cbf10 2023-08-31T01:59:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7fe3e784f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e0200680 con 0x7fe3e0088280 2023-08-31T01:59:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fe3e5dec700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3e00cbf10 0x7fe3e0200140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fe3e55eb700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3e0088280 0x7fe3e006a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fe3e55eb700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3e0088280 0x7fe3e006a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:44372/0 (socket says 172.21.15.84:44372) 2023-08-31T01:59:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fe3e55eb700 1 -- 172.21.15.84:0/926781126 learned_addr learned my addr 172.21.15.84:0/926781126 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7fe3e4dea700 1 --2- 172.21.15.84:0/926781126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbb30 0x7fe3e007bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.032+0000 7fe3e4dea700 1 -- 172.21.15.84:0/926781126 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3e0088280 msgr2=0x7fe3e006a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.032+0000 7fe3e4dea700 1 --2- 172.21.15.84:0/926781126 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3e0088280 0x7fe3e006a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.032+0000 7fe3e4dea700 1 -- 172.21.15.84:0/926781126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3e00cbf10 msgr2=0x7fe3e0200140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.032+0000 7fe3e4dea700 1 --2- 172.21.15.84:0/926781126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3e00cbf10 0x7fe3e0200140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.032+0000 7fe3e4dea700 1 -- 172.21.15.84:0/926781126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d8009d00 con 0x7fe3e00cbb30 2023-08-31T01:59:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.030+0000 7f3f5a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cec0 0x7f3f5c0bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cec0 0x7f3f5c0bf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50138/0 (socket says 172.21.15.84:50138) 2023-08-31T01:59:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5a59c700 1 -- 172.21.15.84:0/1039919049 learned_addr learned my addr 172.21.15.84:0/1039919049 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5b59e700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f5c0cbe00 0x7f3f5c1fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5ad9d700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f5c09cae0 0x7f3f5c06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5ad9d700 1 -- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f5c0cbe00 msgr2=0x7f3f5c1fdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5ad9d700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f5c0cbe00 0x7f3f5c1fdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5ad9d700 1 -- 172.21.15.84:0/1039919049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cec0 msgr2=0x7f3f5c0bf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5ad9d700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cec0 0x7f3f5c0bf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5ad9d700 1 -- 172.21.15.84:0/1039919049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c0095f0 con 0x7f3f5c09cae0 2023-08-31T01:59:33.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.031+0000 7f3f5a59c700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cec0 0x7f3f5c0bf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T01:59:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.032+0000 7f3f5ad9d700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f5c09cae0 0x7f3f5c06ae40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c015000 tx=0x7f3f4c009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.037+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c00052f0 con 0x7f49e009cae0 2023-08-31T01:59:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.035+0000 7f3f437fe700 1 -- 172.21.15.84:0/1039919049 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c01d070 con 0x7f3f5c09cae0 2023-08-31T01:59:33.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.035+0000 7f3f437fe700 1 -- 172.21.15.84:0/1039919049 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3f4c00b7b0 con 0x7f3f5c09cae0 2023-08-31T01:59:33.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.035+0000 7f3f437fe700 1 -- 172.21.15.84:0/1039919049 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00bbc0 con 0x7f3f5c09cae0 2023-08-31T01:59:33.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.035+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c0c1c80 con 0x7f3f5c09cae0 2023-08-31T01:59:33.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.035+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c1fe190 con 0x7f3f5c09cae0 2023-08-31T01:59:33.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.037+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c0052f0 con 0x7f3f5c09cae0 2023-08-31T01:59:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.038+0000 7fe3e4dea700 1 --2- 172.21.15.84:0/926781126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbb30 0x7fe3e007bdc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0088680 tx=0x7fe3d000b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.038+0000 7fd866ffd700 1 -- 172.21.15.84:0/431129247 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal merge size}]=0 v11)=0 v11) v1 ==== 116+0+0 (secure 0 0 0) 0x7fd86000f460 con 0x7fd87009cae0 2023-08-31T01:59:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.038+0000 7fe3d5ffb700 1 -- 172.21.15.84:0/926781126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0011830 con 0x7fe3e00cbb30 2023-08-31T01:59:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.038+0000 7fe3d5ffb700 1 -- 172.21.15.84:0/926781126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe3d0011a80 con 0x7fe3e00cbb30 2023-08-31T01:59:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.038+0000 7fe3d5ffb700 1 -- 172.21.15.84:0/926781126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0011e70 con 0x7fe3e00cbb30 2023-08-31T01:59:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.038+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e006a990 con 0x7fe3e00cbb30 2023-08-31T01:59:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.039+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e01ff940 con 0x7fe3e00cbb30 2023-08-31T01:59:33.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.039+0000 7fe3d5ffb700 1 -- 172.21.15.84:0/926781126 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe3d001a700 con 0x7fe3e00cbb30 2023-08-31T01:59:33.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.040+0000 7fe3d5ffb700 1 -- 172.21.15.84:0/926781126 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe3d0019930 con 0x7fe3e00cbb30 2023-08-31T01:59:33.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.040+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7700052f0 con 0x7fe79015f0c0 2023-08-31T01:59:33.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.040+0000 7f49c7fff700 1 -- 172.21.15.84:0/803030863 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f49d4040b00 con 0x7f49e009cae0 2023-08-31T01:59:33.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.040+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa674150bb0 con 0x7fa67409cec0 2023-08-31T01:59:33.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.043+0000 7f3f437fe700 1 -- 172.21.15.84:0/1039919049 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3f4c00bd20 con 0x7f3f5c09cae0 2023-08-31T01:59:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.043+0000 7f3f437fe700 1 -- 172.21.15.84:0/1039919049 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3f4c00f460 con 0x7f3f5c09cae0 2023-08-31T01:59:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.044+0000 7fe7777fe700 1 -- 172.21.15.84:0/1182880290 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe78801c900 con 0x7fe79015f0c0 2023-08-31T01:59:33.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.044+0000 7fa6717fa700 1 -- 172.21.15.84:0/2900248899 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa66c01f030 con 0x7fa67409cec0 2023-08-31T01:59:33.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.045+0000 7f3f437fe700 1 -- 172.21.15.84:0/1039919049 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3f4c043b00 con 0x7f3f5c09cae0 2023-08-31T01:59:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600cb9f0 msgr2=0x7f88600afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600cb9f0 0x7f88600afed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f885800ab70 tx=0x7f885800ae80 comp rx=0 tx=0).stop 2023-08-31T01:59:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 shutdown_connections 2023-08-31T01:59:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600cb9f0 0x7f88600afed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f886006cd70 0x7f88601fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 --2- 172.21.15.84:0/2223522973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88600af9f0 0x7f88600c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 >> 172.21.15.84:0/2223522973 conn(0x7f88600ae690 msgr2=0x7f88600b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 shutdown_connections 2023-08-31T01:59:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.055+0000 7f8865a44700 1 -- 172.21.15.84:0/2223522973 wait complete. 2023-08-31T01:59:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.071+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c00052f0 con 0x7fe3e00cbb30 2023-08-31T01:59:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.075+0000 7fe3d5ffb700 1 -- 172.21.15.84:0/926781126 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe3d0039b00 con 0x7fe3e00cbb30 2023-08-31T01:59:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.096+0000 7f8571e19700 1 -- 172.21.15.84:0/2472085275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cae0 msgr2=0x7f856c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.096+0000 7f8571e19700 1 --2- 172.21.15.84:0/2472085275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cae0 0x7f856c0cb8c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f856c06f720 tx=0x7f856400b380 comp rx=0 tx=0).stop 2023-08-31T01:59:33.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.088+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds bal split bits}] v 0) v1 -- 0x7f92a004e7c0 con 0x7f92a00702a0 2023-08-31T01:59:33.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.113+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 msgr2=0x7fd8701fe130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.113+0000 7fd878690700 1 --2- 172.21.15.84:0/431129247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 0x7fd8701fe130 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd870073000 tx=0x7fd8600042c0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.113+0000 7f8571e19700 1 -- 172.21.15.84:0/2472085275 shutdown_connections 2023-08-31T01:59:33.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.113+0000 7f8571e19700 1 --2- 172.21.15.84:0/2472085275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c09cec0 0x7f856c15f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.113+0000 7f8571e19700 1 --2- 172.21.15.84:0/2472085275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cae0 0x7f856c0cb8c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.113+0000 7f8571e19700 1 --2- 172.21.15.84:0/2472085275 >> v2:172.21.15.170:3300/0 conn(0x7f856c0cbe00 0x7f856c15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.113+0000 7f8571e19700 1 -- 172.21.15.84:0/2472085275 >> 172.21.15.84:0/2472085275 conn(0x7f856c0ae7d0 msgr2=0x7f856c0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.120+0000 7f8571e19700 1 -- 172.21.15.84:0/2472085275 shutdown_connections 2023-08-31T01:59:33.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.120+0000 7f8571e19700 1 -- 172.21.15.84:0/2472085275 wait complete. 2023-08-31T01:59:33.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.121+0000 7f8571e19700 1 Processor -- start 2023-08-31T01:59:33.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.122+0000 7f8571e19700 1 -- start start 2023-08-31T01:59:33.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f8571e19700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c09cae0 0x7f856c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f8571e19700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cec0 0x7f856c0c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f8571e19700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0cbe00 0x7f856c0c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f8571e19700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0c2f70 con 0x7f856c09cec0 2023-08-31T01:59:33.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f8571e19700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0c1760 con 0x7f856c09cae0 2023-08-31T01:59:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f8571e19700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0c1990 con 0x7f856c0cbe00 2023-08-31T01:59:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f856affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cec0 0x7f856c0c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f856affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cec0 0x7f856c0c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50164/0 (socket says 172.21.15.84:50164) 2023-08-31T01:59:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.123+0000 7f856affd700 1 -- 172.21.15.84:0/426837452 learned_addr learned my addr 172.21.15.84:0/426837452 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7f856bfff700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0cbe00 0x7f856c0c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7f856b7fe700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c09cae0 0x7f856c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 shutdown_connections 2023-08-31T01:59:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7fd878690700 1 --2- 172.21.15.84:0/431129247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8700cbe00 0x7fd87009a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7fd878690700 1 --2- 172.21.15.84:0/431129247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd87009cae0 0x7fd8701fe130 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7fd878690700 1 --2- 172.21.15.84:0/431129247 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd87009cec0 0x7fd87009a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 >> 172.21.15.84:0/431129247 conn(0x7fd8700ae7d0 msgr2=0x7fd8700ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7f856affd700 1 -- 172.21.15.84:0/426837452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0cbe00 msgr2=0x7f856c0c1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7f856affd700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0cbe00 0x7f856c0c1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7f856affd700 1 -- 172.21.15.84:0/426837452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c09cae0 msgr2=0x7f856c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7f856affd700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c09cae0 0x7f856c0b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.124+0000 7f856affd700 1 -- 172.21.15.84:0/426837452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009d00 con 0x7f856c09cec0 2023-08-31T01:59:33.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.125+0000 7f856affd700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cec0 0x7f856c0c2a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f856000b470 tx=0x7f856000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.135+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 shutdown_connections 2023-08-31T01:59:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.135+0000 7fd878690700 1 -- 172.21.15.84:0/431129247 wait complete. 2023-08-31T01:59:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.135+0000 7f855bfff700 1 -- 172.21.15.84:0/426837452 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560011830 con 0x7f856c09cec0 2023-08-31T01:59:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.135+0000 7f855bfff700 1 -- 172.21.15.84:0/426837452 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8560011a80 con 0x7f856c09cec0 2023-08-31T01:59:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.135+0000 7f855bfff700 1 -- 172.21.15.84:0/426837452 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560011e70 con 0x7f856c09cec0 2023-08-31T01:59:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.135+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c0c1c70 con 0x7f856c09cec0 2023-08-31T01:59:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.135+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c0c2230 con 0x7f856c09cec0 2023-08-31T01:59:33.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.140+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=mds debug frag}] v 0) v1 -- 0x7fce400051e0 con 0x7fce5c0cbf10 2023-08-31T01:59:33.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.153+0000 7f855bfff700 1 -- 172.21.15.84:0/426837452 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f856001a700 con 0x7f856c09cec0 2023-08-31T01:59:33.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.153+0000 7f855bfff700 1 -- 172.21.15.84:0/426837452 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8560019860 con 0x7f856c09cec0 2023-08-31T01:59:33.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.153+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85480052f0 con 0x7f856c09cec0 2023-08-31T01:59:33.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.161+0000 7f855bfff700 1 -- 172.21.15.84:0/426837452 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8560039b00 con 0x7f856c09cec0 2023-08-31T01:59:33.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.163+0000 7f9296ffd700 1 -- 172.21.15.84:0/3756148615 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal split bits}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7f929c01a470 con 0x7f92a00702a0 2023-08-31T01:59:33.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.193+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=rados osd op timeout}] v 0) v1 -- 0x7f49c0005910 con 0x7f49e009cae0 2023-08-31T01:59:33.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.196+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds debug scatterstat}] v 0) v1 -- 0x7f3f3c005870 con 0x7f3f5c09cae0 2023-08-31T01:59:33.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.200+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a00702a0 msgr2=0x7f92a01f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.200+0000 7f92a8465700 1 --2- 172.21.15.84:0/3756148615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a00702a0 0x7f92a01f4660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f929c00b550 tx=0x7f929c00b860 comp rx=0 tx=0).stop 2023-08-31T01:59:33.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.203+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 shutdown_connections 2023-08-31T01:59:33.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.203+0000 7f92a8465700 1 --2- 172.21.15.84:0/3756148615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a009cc50 0x7f92a01f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.203+0000 7f92a8465700 1 --2- 172.21.15.84:0/3756148615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a00702a0 0x7f92a01f4660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.203+0000 7f92a8465700 1 --2- 172.21.15.84:0/3756148615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92a009c870 0x7f92a00c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.203+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 >> 172.21.15.84:0/3756148615 conn(0x7f92a00ae7d0 msgr2=0x7f92a00ad1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.203+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 shutdown_connections 2023-08-31T01:59:33.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.204+0000 7f92a8465700 1 -- 172.21.15.84:0/3756148615 wait complete. 2023-08-31T01:59:33.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.204+0000 7fce4affd700 1 -- 172.21.15.84:0/2481066612 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds debug frag}]=0 v13)=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7fce4c004e50 con 0x7fce5c0cbf10 2023-08-31T01:59:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.209+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0cbf10 msgr2=0x7fce5c0c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.209+0000 7fce60f8d700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0cbf10 0x7fce5c0c3db0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fce4c016000 tx=0x7fce4c009470 comp rx=0 tx=0).stop 2023-08-31T01:59:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.211+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds bal split size}] v 0) v1 -- 0x7f2f54005160 con 0x7f2f7809cec0 2023-08-31T01:59:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.212+0000 7f49c7fff700 1 -- 172.21.15.84:0/803030863 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados osd op timeout}]=0 v14)=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7f49d402f070 con 0x7f49e009cae0 2023-08-31T01:59:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.212+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49e009cae0 msgr2=0x7f49e01f91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.212+0000 7f49e5efb700 1 --2- 172.21.15.84:0/803030863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49e009cae0 0x7f49e01f91f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f49e0073000 tx=0x7f49d4004240 comp rx=0 tx=0).stop 2023-08-31T01:59:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.213+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 shutdown_connections 2023-08-31T01:59:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.213+0000 7f49e5efb700 1 --2- 172.21.15.84:0/803030863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00cbe00 0x7f49e0159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.213+0000 7f49e5efb700 1 --2- 172.21.15.84:0/803030863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49e009cae0 0x7f49e01f91f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.213+0000 7f49e5efb700 1 --2- 172.21.15.84:0/803030863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49e009cec0 0x7f49e006a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.213+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 >> 172.21.15.84:0/803030863 conn(0x7f49e00ae7d0 msgr2=0x7f49e015e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.213+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 shutdown_connections 2023-08-31T01:59:33.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.213+0000 7f49e5efb700 1 -- 172.21.15.84:0/803030863 wait complete. 2023-08-31T01:59:33.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.214+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 shutdown_connections 2023-08-31T01:59:33.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.214+0000 7fce60f8d700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c0ad760 0x7fce5c0c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.214+0000 7fce60f8d700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0cbf10 0x7fce5c0c3db0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.214+0000 7fce60f8d700 1 --2- 172.21.15.84:0/2481066612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c0c7590 0x7fce5c0c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.214+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 >> 172.21.15.84:0/2481066612 conn(0x7fce5c0ae7d0 msgr2=0x7fce5c0869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.214+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 shutdown_connections 2023-08-31T01:59:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.214+0000 7fce60f8d700 1 -- 172.21.15.84:0/2481066612 wait complete. 2023-08-31T01:59:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.215+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=mds op complaint time}] v 0) v1 -- 0x7fe770005910 con 0x7fe79015f0c0 2023-08-31T01:59:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.216+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados mon op timeout}] v 0) v1 -- 0x7fa674150f00 con 0x7fa67409cec0 2023-08-31T01:59:33.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.219+0000 7f2f74ff9700 1 -- 172.21.15.84:0/4138928906 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal split size}]=0 v16)=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2f68028030 con 0x7f2f7809cec0 2023-08-31T01:59:33.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.225+0000 7f3f437fe700 1 -- 172.21.15.84:0/1039919049 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds debug scatterstat}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3f4c032070 con 0x7f3f5c09cae0 2023-08-31T01:59:33.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.225+0000 7fe7777fe700 1 -- 172.21.15.84:0/1182880290 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds op complaint time}]=0 v17)=0 v17) v1 ==== 121+0+0 (secure 0 0 0) 0x7fe78801caa0 con 0x7fe79015f0c0 2023-08-31T01:59:33.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.231+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7809cec0 msgr2=0x7f2f780c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.231+0000 7f2f7ea3b700 1 --2- 172.21.15.84:0/4138928906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7809cec0 0x7f2f780c3060 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800b470 tx=0x7f2f6800b830 comp rx=0 tx=0).stop 2023-08-31T01:59:33.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.231+0000 7fb8a5838700 1 -- 172.21.15.84:0/3578175418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb888003a00 msgr2=0x7fb888003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.231+0000 7fb8a5838700 1 --2- 172.21.15.84:0/3578175418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb888003a00 0x7fb888003e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb894005fd0 tx=0x7fb888005880 comp rx=0 tx=0).stop 2023-08-31T01:59:33.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.231+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe79015f0c0 msgr2=0x7fe7900b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.231+0000 7fe795298700 1 --2- 172.21.15.84:0/1182880290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe79015f0c0 0x7fe7900b2290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe788007c90 tx=0x7fe78800d0d0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 shutdown_connections 2023-08-31T01:59:33.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7f2f7ea3b700 1 --2- 172.21.15.84:0/4138928906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f780cbe00 0x7f2f7815def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7f2f7ea3b700 1 --2- 172.21.15.84:0/4138928906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f7809cae0 0x7f2f78155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7f2f7ea3b700 1 --2- 172.21.15.84:0/4138928906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7809cec0 0x7f2f780c3060 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 >> 172.21.15.84:0/4138928906 conn(0x7f2f780ae7d0 msgr2=0x7f2f78071130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 shutdown_connections 2023-08-31T01:59:33.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7f2f7ea3b700 1 -- 172.21.15.84:0/4138928906 wait complete. 2023-08-31T01:59:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7fba40813700 1 -- 172.21.15.84:0/1464290962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba240050d0 msgr2=0x7fba2400fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7fba40813700 1 --2- 172.21.15.84:0/1464290962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba240050d0 0x7fba2400fe20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fba3400e4a0 tx=0x7fba24005880 comp rx=0 tx=0).stop 2023-08-31T01:59:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7fba3ad9d700 1 -- 172.21.15.84:0/1464290962 reap_dead start 2023-08-31T01:59:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7fba40813700 1 -- 172.21.15.84:0/1464290962 shutdown_connections 2023-08-31T01:59:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7fba40813700 1 -- 172.21.15.84:0/1464290962 >> 172.21.15.84:0/1464290962 conn(0x7fba3c0afb00 msgr2=0x7fba3c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7fba40813700 1 -- 172.21.15.84:0/1464290962 shutdown_connections 2023-08-31T01:59:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.233+0000 7fba40813700 1 -- 172.21.15.84:0/1464290962 wait complete. 2023-08-31T01:59:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.235+0000 7fba40813700 1 Processor -- start 2023-08-31T01:59:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.235+0000 7fba40813700 1 -- start start 2023-08-31T01:59:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.235+0000 7fb8a5838700 1 -- 172.21.15.84:0/3578175418 shutdown_connections 2023-08-31T01:59:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.235+0000 7fb8a5838700 1 --2- 172.21.15.84:0/3578175418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb888003a00 0x7fb888003e20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.235+0000 7fb8a5838700 1 -- 172.21.15.84:0/3578175418 >> 172.21.15.84:0/3578175418 conn(0x7fb8a00ae7d0 msgr2=0x7fb8a00aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.235+0000 7fb8a5838700 1 -- 172.21.15.84:0/3578175418 shutdown_connections 2023-08-31T01:59:33.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.235+0000 7fb8a5838700 1 -- 172.21.15.84:0/3578175418 wait complete. 2023-08-31T01:59:33.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fa6717fa700 1 -- 172.21.15.84:0/2900248899 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados mon op timeout}]=0 v18)=0 v18) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa66c017070 con 0x7fa67409cec0 2023-08-31T01:59:33.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f5c09cae0 msgr2=0x7f3f5c06ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7f3f611a5700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f5c09cae0 0x7f3f5c06ae40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c015000 tx=0x7f3f4c009570 comp rx=0 tx=0).stop 2023-08-31T01:59:33.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 shutdown_connections 2023-08-31T01:59:33.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7f3f611a5700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f5c0cbe00 0x7f3f5c1fdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7f3f611a5700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f5c09cae0 0x7f3f5c06ae40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7f3f611a5700 1 --2- 172.21.15.84:0/1039919049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f5c09cec0 0x7f3f5c0bf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 >> 172.21.15.84:0/1039919049 conn(0x7f3f5c0ae7d0 msgr2=0x7f3f5c15ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 shutdown_connections 2023-08-31T01:59:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fe795298700 1 --2- 172.21.15.84:0/1182880290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe79015f0c0 0x7fe7900b2290 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fe795298700 1 --2- 172.21.15.84:0/1182880290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe79009c870 0x7fe7900c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fe795298700 1 --2- 172.21.15.84:0/1182880290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79009cc50 0x7fe7901f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 >> 172.21.15.84:0/1182880290 conn(0x7fe7900ae7d0 msgr2=0x7fe7900aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.237+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 shutdown_connections 2023-08-31T01:59:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.237+0000 7fe795298700 1 -- 172.21.15.84:0/1182880290 wait complete. 2023-08-31T01:59:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fba40813700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba3c149be0 0x7fba3c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fba40813700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba3c149fc0 0x7fba3c0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fba40813700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba3c0c33f0 0x7fba3c0c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fba40813700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c0c3de0 con 0x7fba3c149fc0 2023-08-31T01:59:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fba40813700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c1534d0 con 0x7fba3c0c33f0 2023-08-31T01:59:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.236+0000 7fba40813700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c1537b0 con 0x7fba3c149be0 2023-08-31T01:59:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.237+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 shutdown_connections 2023-08-31T01:59:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.237+0000 7f3f611a5700 1 -- 172.21.15.84:0/1039919049 wait complete. 2023-08-31T01:59:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.237+0000 7fb8a5838700 1 Processor -- start 2023-08-31T01:59:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.237+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds verify scatter}] v 0) v1 -- 0x7fe3c0005160 con 0x7fe3e00cbb30 2023-08-31T01:59:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba39d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba3c149fc0 0x7fba3c0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba39d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba3c149fc0 0x7fba3c0ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50196/0 (socket says 172.21.15.84:50196) 2023-08-31T01:59:33.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba39d9b700 1 -- 172.21.15.84:0/1852138490 learned_addr learned my addr 172.21.15.84:0/1852138490 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba39d9b700 1 -- 172.21.15.84:0/1852138490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba3c149be0 msgr2=0x7fba3c0adf10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T01:59:33.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba39d9b700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba3c149be0 0x7fba3c0adf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba39d9b700 1 -- 172.21.15.84:0/1852138490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba3c0c33f0 msgr2=0x7fba3c0c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba3ad9d700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba3c0c33f0 0x7fba3c0c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fb8a5838700 1 -- start start 2023-08-31T01:59:33.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba39d9b700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba3c0c33f0 0x7fba3c0c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba39d9b700 1 -- 172.21.15.84:0/1852138490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c153a90 con 0x7fba3c149fc0 2023-08-31T01:59:33.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.239+0000 7fba3ad9d700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba3c0c33f0 0x7fba3c0c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T01:59:33.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fba39d9b700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba3c149fc0 0x7fba3c0ae450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00e9a0 tx=0x7fba2c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fba2affd700 1 -- 172.21.15.84:0/1852138490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00abb0 con 0x7fba3c149fc0 2023-08-31T01:59:33.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fba2affd700 1 -- 172.21.15.84:0/1852138490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fba2c00ae00 con 0x7fba3c149fc0 2023-08-31T01:59:33.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fba2affd700 1 -- 172.21.15.84:0/1852138490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c004280 con 0x7fba3c149fc0 2023-08-31T01:59:33.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fb8a5838700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb888003a00 0x7fb8a00bd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fb8a5838700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a00bf610 0x7fb8a00c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fb8a5838700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a00bede0 0x7fb8a00c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fb8a5838700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a0152100 con 0x7fb8a00bede0 2023-08-31T01:59:33.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fb8a5838700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00bdd40 con 0x7fb888003a00 2023-08-31T01:59:33.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fb8a5838700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00be020 con 0x7fb8a00bf610 2023-08-31T01:59:33.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fb89e7fc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a00bf610 0x7fb8a00c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89e7fc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a00bf610 0x7fb8a00c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:44420/0 (socket says 172.21.15.84:44420) 2023-08-31T01:59:33.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89e7fc700 1 -- 172.21.15.84:0/2837731564 learned_addr learned my addr 172.21.15.84:0/2837731564 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.240+0000 7fb89effd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb888003a00 0x7fb8a00bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67409cec0 msgr2=0x7fa674155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fa67ae48700 1 --2- 172.21.15.84:0/2900248899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67409cec0 0x7fa674155f00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa66c014000 tx=0x7fa66c00bed0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 shutdown_connections 2023-08-31T01:59:33.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fa67ae48700 1 --2- 172.21.15.84:0/2900248899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67409cec0 0x7fa674155f00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fa67ae48700 1 --2- 172.21.15.84:0/2900248899 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740714b0 0x7fa67415f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fa67ae48700 1 --2- 172.21.15.84:0/2900248899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa67409cae0 0x7fa6740abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 >> 172.21.15.84:0/2900248899 conn(0x7fa6740ae7d0 msgr2=0x7fa674153be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89e7fc700 1 -- 172.21.15.84:0/2837731564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb888003a00 msgr2=0x7fb8a00bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89e7fc700 1 --2- 172.21.15.84:0/2837731564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb888003a00 0x7fb8a00bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89e7fc700 1 -- 172.21.15.84:0/2837731564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a00bede0 msgr2=0x7fb8a00c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89e7fc700 1 --2- 172.21.15.84:0/2837731564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a00bede0 0x7fb8a00c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89e7fc700 1 -- 172.21.15.84:0/2837731564 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00be300 con 0x7fb8a00bf610 2023-08-31T01:59:33.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89effd700 1 --2- 172.21.15.84:0/2837731564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb888003a00 0x7fb8a00bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T01:59:33.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb89e7fc700 1 --2- 172.21.15.84:0/2837731564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a00bf610 0x7fb8a00c8430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb89000c840 tx=0x7fb89000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb887fff700 1 -- 172.21.15.84:0/2837731564 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb890005480 con 0x7fb8a00bf610 2023-08-31T01:59:33.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb887fff700 1 -- 172.21.15.84:0/2837731564 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb890003770 con 0x7fb8a00bf610 2023-08-31T01:59:33.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb887fff700 1 -- 172.21.15.84:0/2837731564 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb890003b80 con 0x7fb8a00bf610 2023-08-31T01:59:33.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a00be5e0 con 0x7fb8a00bf610 2023-08-31T01:59:33.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a00c8970 con 0x7fb8a00bf610 2023-08-31T01:59:33.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.242+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 shutdown_connections 2023-08-31T01:59:33.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.242+0000 7fa67ae48700 1 -- 172.21.15.84:0/2900248899 wait complete. 2023-08-31T01:59:33.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c153d70 con 0x7fba3c149fc0 2023-08-31T01:59:33.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.241+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c0aff10 con 0x7fba3c149fc0 2023-08-31T01:59:33.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.242+0000 7fb887fff700 1 -- 172.21.15.84:0/2837731564 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb89001c440 con 0x7fb8a00bf610 2023-08-31T01:59:33.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.242+0000 7fb887fff700 1 -- 172.21.15.84:0/2837731564 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb890012940 con 0x7fb8a00bf610 2023-08-31T01:59:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.243+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a00beb00 con 0x7fb8a00bf610 2023-08-31T01:59:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.243+0000 7fba2affd700 1 -- 172.21.15.84:0/1852138490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba2c0043e0 con 0x7fba3c149fc0 2023-08-31T01:59:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.243+0000 7fba2affd700 1 -- 172.21.15.84:0/1852138490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fba2c01a780 con 0x7fba3c149fc0 2023-08-31T01:59:33.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.243+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba200052f0 con 0x7fba3c149fc0 2023-08-31T01:59:33.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.247+0000 7fba2affd700 1 -- 172.21.15.84:0/1852138490 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fba2c01f020 con 0x7fba3c149fc0 2023-08-31T01:59:33.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.248+0000 7fb887fff700 1 -- 172.21.15.84:0/2837731564 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb8a00beb00 con 0x7fb8a00bf610 2023-08-31T01:59:33.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.257+0000 7fe3d5ffb700 1 -- 172.21.15.84:0/926781126 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds verify scatter}]=0 v19)=0 v19) v1 ==== 119+0+0 (secure 0 0 0) 0x7fe3d0028020 con 0x7fe3e00cbb30 2023-08-31T01:59:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbb30 msgr2=0x7fe3e007bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 --2- 172.21.15.84:0/926781126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbb30 0x7fe3e007bdc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0088680 tx=0x7fe3d000b750 comp rx=0 tx=0).stop 2023-08-31T01:59:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 shutdown_connections 2023-08-31T01:59:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 --2- 172.21.15.84:0/926781126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3e00cbf10 0x7fe3e0200140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 --2- 172.21.15.84:0/926781126 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3e0088280 0x7fe3e006a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 --2- 172.21.15.84:0/926781126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00cbb30 0x7fe3e007bdc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 >> 172.21.15.84:0/926781126 conn(0x7fe3e00ae7d0 msgr2=0x7fe3e00b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 shutdown_connections 2023-08-31T01:59:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.258+0000 7fe3e784f700 1 -- 172.21.15.84:0/926781126 wait complete. 2023-08-31T01:59:33.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.282+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=osd op complaint time}] v 0) v1 -- 0x7f8548005910 con 0x7f856c09cec0 2023-08-31T01:59:33.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.285+0000 7f855bfff700 1 -- 172.21.15.84:0/426837452 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd op complaint time}]=0 v20)=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f8560028020 con 0x7f856c09cec0 2023-08-31T01:59:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cec0 msgr2=0x7f856c0c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cec0 0x7f856c0c2a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f856000b470 tx=0x7f856000b830 comp rx=0 tx=0).stop 2023-08-31T01:59:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 shutdown_connections 2023-08-31T01:59:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0cbe00 0x7f856c0c1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c09cae0 0x7f856c0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 --2- 172.21.15.84:0/426837452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f856c09cec0 0x7f856c0c2a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 >> 172.21.15.84:0/426837452 conn(0x7f856c0ae7d0 msgr2=0x7f856c158a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 shutdown_connections 2023-08-31T01:59:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.286+0000 7f8571e19700 1 -- 172.21.15.84:0/426837452 wait complete. 2023-08-31T01:59:33.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.324+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=osd op complaint time}] v 0) v1 -- 0x7fba20005910 con 0x7fba3c149fc0 2023-08-31T01:59:33.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.327+0000 7fba2affd700 1 -- 172.21.15.84:0/1852138490 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd op complaint time}]=0 v21)=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7fba2c003680 con 0x7fba3c149fc0 2023-08-31T01:59:33.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba3c149fc0 msgr2=0x7fba3c0ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba3c149fc0 0x7fba3c0ae450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00e9a0 tx=0x7fba2c00ed60 comp rx=0 tx=0).stop 2023-08-31T01:59:33.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 shutdown_connections 2023-08-31T01:59:33.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba3c0c33f0 0x7fba3c0c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba3c149be0 0x7fba3c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 --2- 172.21.15.84:0/1852138490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba3c149fc0 0x7fba3c0ae450 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 >> 172.21.15.84:0/1852138490 conn(0x7fba3c0afb00 msgr2=0x7fba3c0cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 shutdown_connections 2023-08-31T01:59:33.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.328+0000 7fba40813700 1 -- 172.21.15.84:0/1852138490 wait complete. 2023-08-31T01:59:33.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.334+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=mon op complaint time}] v 0) v1 -- 0x7fb8a004e7c0 con 0x7fb8a00bf610 2023-08-31T01:59:33.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.337+0000 7fb887fff700 1 -- 172.21.15.84:0/2837731564 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon op complaint time}]=0 v22)=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7fb890017070 con 0x7fb8a00bf610 2023-08-31T01:59:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a00bf610 msgr2=0x7fb8a00c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 --2- 172.21.15.84:0/2837731564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a00bf610 0x7fb8a00c8430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb89000c840 tx=0x7fb89000cb50 comp rx=0 tx=0).stop 2023-08-31T01:59:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 shutdown_connections 2023-08-31T01:59:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 --2- 172.21.15.84:0/2837731564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a00bede0 0x7fb8a00c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 --2- 172.21.15.84:0/2837731564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb888003a00 0x7fb8a00bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 --2- 172.21.15.84:0/2837731564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a00bf610 0x7fb8a00c8430 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 >> 172.21.15.84:0/2837731564 conn(0x7fb8a00ae7d0 msgr2=0x7fb8a00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 shutdown_connections 2023-08-31T01:59:33.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.338+0000 7fb8a5838700 1 -- 172.21.15.84:0/2837731564 wait complete. 2023-08-31T01:59:33.343 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-31T01:59:33.343 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-31T01:59:33.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-31T01:59:33.386 INFO:tasks.ceph.mgr.y:Started 2023-08-31T01:59:33.386 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-31T01:59:33.387 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-31T01:59:33.389 INFO:tasks.ceph.mgr.x:Started 2023-08-31T01:59:33.390 INFO:tasks.ceph:Setting crush tunables to default 2023-08-31T01:59:33.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2023-08-31T01:59:33.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.521+0000 7f9ee5276700 1 -- 172.21.15.84:0/3539923642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ee00b15e0 msgr2=0x7f9ee00b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.521+0000 7f9ee5276700 1 --2- 172.21.15.84:0/3539923642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ee00b15e0 0x7f9ee00b27f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009f90 tx=0x7f9ed800b330 comp rx=0 tx=0).stop 2023-08-31T01:59:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.522+0000 7f9ee5276700 1 -- 172.21.15.84:0/3539923642 shutdown_connections 2023-08-31T01:59:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.522+0000 7f9ee5276700 1 --2- 172.21.15.84:0/3539923642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ee00b15e0 0x7f9ee00b27f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.522+0000 7f9ee5276700 1 -- 172.21.15.84:0/3539923642 >> 172.21.15.84:0/3539923642 conn(0x7f9ee00ca0f0 msgr2=0x7f9ee00ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.522+0000 7f9ee5276700 1 -- 172.21.15.84:0/3539923642 shutdown_connections 2023-08-31T01:59:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.522+0000 7f9ee5276700 1 -- 172.21.15.84:0/3539923642 wait complete. 2023-08-31T01:59:33.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.523+0000 7f9ee5276700 1 Processor -- start 2023-08-31T01:59:33.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.523+0000 7f9ee5276700 1 -- start start 2023-08-31T01:59:33.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ee5276700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ee00b15e0 0x7f9ee00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ee5276700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ee00b1f90 0x7f9ee00c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ee5276700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ee00b2370 0x7f9ee01545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ee5276700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee01f1500 con 0x7f9ee00b2370 2023-08-31T01:59:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ee5276700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee01f17e0 con 0x7f9ee00b1f90 2023-08-31T01:59:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ee5276700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee01f1ac0 con 0x7f9ee00b15e0 2023-08-31T01:59:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ee00b2370 0x7f9ee01545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ee00b2370 0x7f9ee01545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50224/0 (socket says 172.21.15.84:50224) 2023-08-31T01:59:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 -- 172.21.15.84:0/3228037798 learned_addr learned my addr 172.21.15.84:0/3228037798 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edeffd700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ee00b15e0 0x7f9ee00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ede7fc700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ee00b1f90 0x7f9ee00c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 -- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ee00b15e0 msgr2=0x7f9ee00699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ee00b15e0 0x7f9ee00699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 -- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ee00b1f90 msgr2=0x7f9ee00c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ee00b1f90 0x7f9ee00c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 -- 172.21.15.84:0/3228037798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8009c40 con 0x7f9ee00b2370 2023-08-31T01:59:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ede7fc700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ee00b1f90 0x7f9ee00c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T01:59:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9edf7fe700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ee00b2370 0x7f9ee01545e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800b680 tx=0x7f9ed8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ec77fe700 1 -- 172.21.15.84:0/3228037798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800e040 con 0x7f9ee00b2370 2023-08-31T01:59:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ec77fe700 1 -- 172.21.15.84:0/3228037798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ed800bc00 con 0x7f9ee00b2370 2023-08-31T01:59:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee01f1da0 con 0x7f9ee00b2370 2023-08-31T01:59:33.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ec77fe700 1 -- 172.21.15.84:0/3228037798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8004df0 con 0x7f9ee00b2370 2023-08-31T01:59:33.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.524+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee0069ee0 con 0x7f9ee00b2370 2023-08-31T01:59:33.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.525+0000 7f9ec77fe700 1 -- 172.21.15.84:0/3228037798 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9ed8003d00 con 0x7f9ee00b2370 2023-08-31T01:59:33.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.525+0000 7f9ec77fe700 1 -- 172.21.15.84:0/3228037798 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9ed801d7c0 con 0x7f9ee00b2370 2023-08-31T01:59:33.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.525+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee01f1920 con 0x7f9ee00b2370 2023-08-31T01:59:33.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.528+0000 7f9ec77fe700 1 -- 172.21.15.84:0/3228037798 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9ee01f1920 con 0x7f9ee00b2370 2023-08-31T01:59:33.581 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:33.588+0000 7f772777d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-31T01:59:33.582 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:33.590+0000 7f7447797200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-31T01:59:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.604+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9ee01f12c0 con 0x7f9ee00b2370 2023-08-31T01:59:33.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.607+0000 7f9ec77fe700 1 -- 172.21.15.84:0/3228037798 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9ee01f12c0 con 0x7f9ee00b2370 2023-08-31T01:59:33.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ee00b2370 msgr2=0x7f9ee01545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:33.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ee00b2370 0x7f9ee01545e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800b680 tx=0x7f9ed8007f60 comp rx=0 tx=0).stop 2023-08-31T01:59:33.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 shutdown_connections 2023-08-31T01:59:33.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ee00b2370 0x7f9ee01545e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ee00b15e0 0x7f9ee00699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 --2- 172.21.15.84:0/3228037798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ee00b1f90 0x7f9ee00c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:33.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 >> 172.21.15.84:0/3228037798 conn(0x7f9ee00ca0f0 msgr2=0x7f9ee00b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:33.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 shutdown_connections 2023-08-31T01:59:33.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:33.608+0000 7f9ee5276700 1 -- 172.21.15.84:0/3228037798 wait complete. 2023-08-31T01:59:33.603 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2023-08-31T01:59:33.613 INFO:tasks.ceph:check_enable_crimson: False 2023-08-31T01:59:33.613 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-31T01:59:33.613 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:33.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-31T01:59:33.640 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:33.640 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-31T01:59:33.648 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:33.656+0000 7f7447797200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T01:59:33.651 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:33.658+0000 7f772777d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T01:59:33.677 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:33.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-31T01:59:33.723 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:33.731+0000 7f7447797200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T01:59:33.733 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:33.741+0000 7f772777d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T01:59:33.746 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T01:59:33.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-31T01:59:33.801 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:33.809+0000 7f7447797200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T01:59:33.813 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:33.813 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-31T01:59:33.818 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:33.825+0000 7f772777d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T01:59:33.841 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:33.841 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-31T01:59:33.908 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:33.908 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-31T01:59:33.953 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:33.961+0000 7f7447797200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T01:59:33.961 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:33.968+0000 7f772777d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T01:59:33.974 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T01:59:33.975 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-31T01:59:34.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new aeb58e93-e490-463f-9ab8-b9295b224a8e 0 2023-08-31T01:59:34.203 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.210+0000 7f98f6837700 1 -- 172.21.15.170:0/2986522140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f015cce0 msgr2=0x7f98f015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.204 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.210+0000 7f98f6837700 1 --2- 172.21.15.170:0/2986522140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f015cce0 0x7f98f015d150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98d80098f0 tx=0x7f98d8009c00 comp rx=0 tx=0).stop 2023-08-31T01:59:34.204 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.210+0000 7f98f6837700 1 -- 172.21.15.170:0/2986522140 shutdown_connections 2023-08-31T01:59:34.204 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.210+0000 7f98f6837700 1 --2- 172.21.15.170:0/2986522140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98f00cba50 0x7f98f00cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.204 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.210+0000 7f98f6837700 1 --2- 172.21.15.170:0/2986522140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f015cce0 0x7f98f015d150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.204 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.210+0000 7f98f6837700 1 -- 172.21.15.170:0/2986522140 >> 172.21.15.170:0/2986522140 conn(0x7f98f00ca900 msgr2=0x7f98f00cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:34.205 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.210+0000 7f98f6837700 1 -- 172.21.15.170:0/2986522140 shutdown_connections 2023-08-31T01:59:34.205 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.210+0000 7f98f6837700 1 -- 172.21.15.170:0/2986522140 wait complete. 2023-08-31T01:59:34.208 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.211+0000 7f98f6837700 1 Processor -- start 2023-08-31T01:59:34.208 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.212+0000 7f98f6837700 1 -- start start 2023-08-31T01:59:34.208 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.212+0000 7f98f6837700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98f00cba50 0x7f98f01332b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.208 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.212+0000 7f98f6837700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f0142a60 0x7f98f00c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.209 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.212+0000 7f98f6837700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98f015cce0 0x7f98f00c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.209 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.212+0000 7f98f6837700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00c2fa0 con 0x7f98f015cce0 2023-08-31T01:59:34.209 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.212+0000 7f98f6837700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00c3b20 con 0x7f98f0142a60 2023-08-31T01:59:34.209 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.212+0000 7f98f6837700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00c31f0 con 0x7f98f00cba50 2023-08-31T01:59:34.209 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.212+0000 7f98effff700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98f00cba50 0x7f98f01332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.210 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ef7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f0142a60 0x7f98f00c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.210 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98effff700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98f00cba50 0x7f98f01332b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54250/0 (socket says 172.21.15.170:54250) 2023-08-31T01:59:34.210 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98effff700 1 -- 172.21.15.170:0/1080657371 learned_addr learned my addr 172.21.15.170:0/1080657371 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-08-31T01:59:34.210 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98f4dd4700 1 --2- 172.21.15.170:0/1080657371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98f015cce0 0x7f98f00c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.210 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ef7fe700 1 -- 172.21.15.170:0/1080657371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98f00cba50 msgr2=0x7f98f01332b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.211 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ef7fe700 1 --2- 172.21.15.170:0/1080657371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98f00cba50 0x7f98f01332b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.211 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ef7fe700 1 -- 172.21.15.170:0/1080657371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98f015cce0 msgr2=0x7f98f00c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.211 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ef7fe700 1 --2- 172.21.15.170:0/1080657371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98f015cce0 0x7f98f00c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.211 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ef7fe700 1 -- 172.21.15.170:0/1080657371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8009520 con 0x7f98f0142a60 2023-08-31T01:59:34.212 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ef7fe700 1 --2- 172.21.15.170:0/1080657371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f0142a60 0x7f98f00c3fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f98d8016000 tx=0x7f98d800f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:34.212 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ecff9700 1 -- 172.21.15.170:0/1080657371 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d800fe40 con 0x7f98f0142a60 2023-08-31T01:59:34.212 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ecff9700 1 -- 172.21.15.170:0/1080657371 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f98d8017400 con 0x7f98f0142a60 2023-08-31T01:59:34.213 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f00c34d0 con 0x7f98f0142a60 2023-08-31T01:59:34.214 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98ecff9700 1 -- 172.21.15.170:0/1080657371 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8017810 con 0x7f98f0142a60 2023-08-31T01:59:34.214 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.213+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f00c4a30 con 0x7f98f0142a60 2023-08-31T01:59:34.214 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.214+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f00c3c90 con 0x7f98f0142a60 2023-08-31T01:59:34.215 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.217+0000 7f98ecff9700 1 -- 172.21.15.170:0/1080657371 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f98d8017970 con 0x7f98f0142a60 2023-08-31T01:59:34.215 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.217+0000 7f98ecff9700 1 -- 172.21.15.170:0/1080657371 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f98d8003680 con 0x7f98f0142a60 2023-08-31T01:59:34.216 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.219+0000 7f98ecff9700 1 -- 172.21.15.170:0/1080657371 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f98d8017c20 con 0x7f98f0142a60 2023-08-31T01:59:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.302+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aeb58e93-e490-463f-9ab8-b9295b224a8e", "id": 0} v 0) v1 -- 0x7f98f004e7c0 con 0x7f98f0142a60 2023-08-31T01:59:34.298 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.306+0000 7f98ecff9700 1 -- 172.21.15.170:0/1080657371 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aeb58e93-e490-463f-9ab8-b9295b224a8e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f98d8017dc0 con 0x7f98f0142a60 2023-08-31T01:59:34.298 INFO:teuthology.orchestra.run.smithi170.stdout:0 2023-08-31T01:59:34.300 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f0142a60 msgr2=0x7f98f00c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.300 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 --2- 172.21.15.170:0/1080657371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f0142a60 0x7f98f00c3fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f98d8016000 tx=0x7f98d800f710 comp rx=0 tx=0).stop 2023-08-31T01:59:34.300 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 shutdown_connections 2023-08-31T01:59:34.300 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 --2- 172.21.15.170:0/1080657371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98f015cce0 0x7f98f00c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.301 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 --2- 172.21.15.170:0/1080657371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98f00cba50 0x7f98f01332b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.301 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 --2- 172.21.15.170:0/1080657371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f0142a60 0x7f98f00c3fb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.301 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 >> 172.21.15.170:0/1080657371 conn(0x7f98f00ca900 msgr2=0x7f98f01416d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:34.301 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 shutdown_connections 2023-08-31T01:59:34.301 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.307+0000 7f98f6837700 1 -- 172.21.15.170:0/1080657371 wait complete. 2023-08-31T01:59:34.311 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 8b81870a-0d5c-4b87-b959-b44386769b81 1 2023-08-31T01:59:34.351 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:34.358+0000 7f772777d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T01:59:34.366 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:34.374+0000 7f7447797200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T01:59:34.435 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.443+0000 7ff3a8b50700 1 -- 172.21.15.170:0/3372713128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a415cce0 msgr2=0x7ff3a415d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.436 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.443+0000 7ff3a8b50700 1 --2- 172.21.15.170:0/3372713128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a415cce0 0x7ff3a415d120 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff398005fd0 tx=0x7ff398009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:34.436 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.443+0000 7ff3a8b50700 1 -- 172.21.15.170:0/3372713128 shutdown_connections 2023-08-31T01:59:34.436 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.443+0000 7ff3a8b50700 1 --2- 172.21.15.170:0/3372713128 >> v2:172.21.15.84:3300/0 conn(0x7ff3a4142a60 0x7ff3a40ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.437 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.443+0000 7ff3a8b50700 1 --2- 172.21.15.170:0/3372713128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a415cce0 0x7ff3a415d120 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.437 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.443+0000 7ff3a8b50700 1 -- 172.21.15.170:0/3372713128 >> 172.21.15.170:0/3372713128 conn(0x7ff3a40ca900 msgr2=0x7ff3a40cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:34.437 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.443+0000 7ff3a8b50700 1 -- 172.21.15.170:0/3372713128 shutdown_connections 2023-08-31T01:59:34.438 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.443+0000 7ff3a8b50700 1 -- 172.21.15.170:0/3372713128 wait complete. 2023-08-31T01:59:34.441 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.444+0000 7ff3a8b50700 1 Processor -- start 2023-08-31T01:59:34.442 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.444+0000 7ff3a8b50700 1 -- start start 2023-08-31T01:59:34.442 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a8b50700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3a40c84d0 0x7ff3a41585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.442 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a8b50700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a4142a60 0x7ff3a415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.442 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a8b50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3a415cce0 0x7ff3a415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.443 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a8b50700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a413ce50 con 0x7ff3a415cce0 2023-08-31T01:59:34.443 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a8b50700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a41597c0 con 0x7ff3a40c84d0 2023-08-31T01:59:34.443 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a8b50700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4159aa0 con 0x7ff3a4142a60 2023-08-31T01:59:34.443 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a1d9b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a4142a60 0x7ff3a415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.444 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a1d9b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a4142a60 0x7ff3a415bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54264/0 (socket says 172.21.15.170:54264) 2023-08-31T01:59:34.444 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a1d9b700 1 -- 172.21.15.170:0/408052322 learned_addr learned my addr 172.21.15.170:0/408052322 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-08-31T01:59:34.444 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a259c700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3a40c84d0 0x7ff3a41585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.444 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a2d9d700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3a415cce0 0x7ff3a415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.445 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a1d9b700 1 -- 172.21.15.170:0/408052322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3a40c84d0 msgr2=0x7ff3a41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.445 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a1d9b700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3a40c84d0 0x7ff3a41585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.445 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a1d9b700 1 -- 172.21.15.170:0/408052322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3a415cce0 msgr2=0x7ff3a415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.445 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.445+0000 7ff3a1d9b700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3a415cce0 0x7ff3a415c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.445 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff3a1d9b700 1 -- 172.21.15.170:0/408052322 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3980095f0 con 0x7ff3a4142a60 2023-08-31T01:59:34.445 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff3a1d9b700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a4142a60 0x7ff3a415bbd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40ca810 tx=0x7ff398004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:34.446 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff392ffd700 1 -- 172.21.15.170:0/408052322 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39801c070 con 0x7ff3a4142a60 2023-08-31T01:59:34.446 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff392ffd700 1 -- 172.21.15.170:0/408052322 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff398004260 con 0x7ff3a4142a60 2023-08-31T01:59:34.446 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a413c5b0 con 0x7ff3a4142a60 2023-08-31T01:59:34.446 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff392ffd700 1 -- 172.21.15.170:0/408052322 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398003680 con 0x7ff3a4142a60 2023-08-31T01:59:34.446 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a413cb70 con 0x7ff3a4142a60 2023-08-31T01:59:34.447 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff392ffd700 1 -- 172.21.15.170:0/408052322 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff3980037e0 con 0x7ff3a4142a60 2023-08-31T01:59:34.447 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.446+0000 7ff392ffd700 1 -- 172.21.15.170:0/408052322 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff3980051b0 con 0x7ff3a4142a60 2023-08-31T01:59:34.447 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.447+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a404e7c0 con 0x7ff3a4142a60 2023-08-31T01:59:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.449+0000 7ff392ffd700 1 -- 172.21.15.170:0/408052322 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff398003c20 con 0x7ff3a4142a60 2023-08-31T01:59:34.469 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:34.476+0000 7f772777d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T01:59:34.490 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:34.498+0000 7f7447797200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T01:59:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.533+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8b81870a-0d5c-4b87-b959-b44386769b81", "id": 1} v 0) v1 -- 0x7ff3a40b0e10 con 0x7ff3a4142a60 2023-08-31T01:59:34.528 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.536+0000 7ff392ffd700 1 -- 172.21.15.170:0/408052322 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b81870a-0d5c-4b87-b959-b44386769b81", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff398003dc0 con 0x7ff3a4142a60 2023-08-31T01:59:34.529 INFO:teuthology.orchestra.run.smithi170.stdout:1 2023-08-31T01:59:34.530 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a4142a60 msgr2=0x7ff3a415bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.530 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a4142a60 0x7ff3a415bbd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40ca810 tx=0x7ff398004a60 comp rx=0 tx=0).stop 2023-08-31T01:59:34.530 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 shutdown_connections 2023-08-31T01:59:34.530 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3a415cce0 0x7ff3a415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.531 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3a40c84d0 0x7ff3a41585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.531 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 --2- 172.21.15.170:0/408052322 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3a4142a60 0x7ff3a415bbd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.531 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 >> 172.21.15.170:0/408052322 conn(0x7ff3a40ca900 msgr2=0x7ff3a41416b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:34.531 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 shutdown_connections 2023-08-31T01:59:34.531 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.537+0000 7ff3a8b50700 1 -- 172.21.15.170:0/408052322 wait complete. 2023-08-31T01:59:34.541 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 902b105d-5db8-41ea-a4b7-8917479c0ff6 2 2023-08-31T01:59:34.554 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:34.561+0000 7f772777d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T01:59:34.578 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:34.586+0000 7f7447797200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T01:59:34.635 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:34.642+0000 7f772777d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T01:59:34.662 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:34.670+0000 7f7447797200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T01:59:34.665 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.673+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2503842088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c8071690 msgr2=0x7f58c8071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.665 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.673+0000 7f58ccf9d700 1 --2- 172.21.15.170:0/2503842088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c8071690 0x7f58c8071ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009f60 tx=0x7f58c0009f90 comp rx=0 tx=0).stop 2023-08-31T01:59:34.665 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.673+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2503842088 shutdown_connections 2023-08-31T01:59:34.666 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.673+0000 7f58ccf9d700 1 --2- 172.21.15.170:0/2503842088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c8071690 0x7f58c8071ae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.666 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.673+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2503842088 >> 172.21.15.170:0/2503842088 conn(0x7f58c80ca6e0 msgr2=0x7f58c80caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:34.666 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.673+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2503842088 shutdown_connections 2023-08-31T01:59:34.666 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.673+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2503842088 wait complete. 2023-08-31T01:59:34.669 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.674+0000 7f58ccf9d700 1 Processor -- start 2023-08-31T01:59:34.669 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.674+0000 7f58ccf9d700 1 -- start start 2023-08-31T01:59:34.670 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58ccf9d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58c8071690 0x7f58c8156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.670 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58ccf9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c80ca120 0x7f58c81457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.670 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58ccf9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c81558d0 0x7f58c8157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.670 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58ccf9d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8156b90 con 0x7f58c81558d0 2023-08-31T01:59:34.671 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58ccf9d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8155f10 con 0x7f58c80ca120 2023-08-31T01:59:34.671 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58ccf9d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81561f0 con 0x7f58c8071690 2023-08-31T01:59:34.671 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58c8071690 0x7f58c8156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.672 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58c8071690 0x7f58c8156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54274/0 (socket says 172.21.15.170:54274) 2023-08-31T01:59:34.672 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 -- 172.21.15.170:0/2466533020 learned_addr learned my addr 172.21.15.170:0/2466533020 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-08-31T01:59:34.672 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c6ffd700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c80ca120 0x7f58c81457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.672 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c7fff700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c81558d0 0x7f58c8157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.672 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 -- 172.21.15.170:0/2466533020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c80ca120 msgr2=0x7f58c81457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.673 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c80ca120 0x7f58c81457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.673 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 -- 172.21.15.170:0/2466533020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c81558d0 msgr2=0x7f58c8157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.673 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c81558d0 0x7f58c8157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.673 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 -- 172.21.15.170:0/2466533020 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c0009c40 con 0x7f58c8071690 2023-08-31T01:59:34.673 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c7fff700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c81558d0 0x7f58c8157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T01:59:34.674 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.675+0000 7f58c77fe700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58c8071690 0x7f58c8156fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c4d0 tx=0x7f58b800c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:34.674 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.676+0000 7f58affff700 1 -- 172.21.15.170:0/2466533020 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800cea0 con 0x7f58c8071690 2023-08-31T01:59:34.674 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.676+0000 7f58affff700 1 -- 172.21.15.170:0/2466533020 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f58b8011880 con 0x7f58c8071690 2023-08-31T01:59:34.674 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.676+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c81564d0 con 0x7f58c8071690 2023-08-31T01:59:34.674 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.676+0000 7f58affff700 1 -- 172.21.15.170:0/2466533020 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8011c90 con 0x7f58c8071690 2023-08-31T01:59:34.675 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.676+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c8145d20 con 0x7f58c8071690 2023-08-31T01:59:34.675 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.676+0000 7f58affff700 1 -- 172.21.15.170:0/2466533020 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f58b8005320 con 0x7f58c8071690 2023-08-31T01:59:34.675 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.676+0000 7f58affff700 1 -- 172.21.15.170:0/2466533020 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f58b8012840 con 0x7f58c8071690 2023-08-31T01:59:34.675 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.677+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c8067120 con 0x7f58c8071690 2023-08-31T01:59:34.676 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.679+0000 7f58affff700 1 -- 172.21.15.170:0/2466533020 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f58b8011df0 con 0x7f58c8071690 2023-08-31T01:59:34.754 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.761+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "902b105d-5db8-41ea-a4b7-8917479c0ff6", "id": 2} v 0) v1 -- 0x7f58c8158f10 con 0x7f58c8071690 2023-08-31T01:59:34.757 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.765+0000 7f58affff700 1 -- 172.21.15.170:0/2466533020 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "902b105d-5db8-41ea-a4b7-8917479c0ff6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58b8012420 con 0x7f58c8071690 2023-08-31T01:59:34.757 INFO:teuthology.orchestra.run.smithi170.stdout:2 2023-08-31T01:59:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58c8071690 msgr2=0x7f58c8156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58c8071690 0x7f58c8156fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c4d0 tx=0x7f58b800c7e0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 shutdown_connections 2023-08-31T01:59:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58c81558d0 0x7f58c8157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58c8071690 0x7f58c8156fb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 --2- 172.21.15.170:0/2466533020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c80ca120 0x7f58c81457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 >> 172.21.15.170:0/2466533020 conn(0x7f58c80ca6e0 msgr2=0x7f58c80cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 shutdown_connections 2023-08-31T01:59:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.766+0000 7f58ccf9d700 1 -- 172.21.15.170:0/2466533020 wait complete. 2023-08-31T01:59:34.771 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new cee7d084-e5fd-4b9c-92e3-e14e7efd925a 3 2023-08-31T01:59:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.944+0000 7fe936bf2700 1 -- 172.21.15.170:0/1762069141 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9300cba50 msgr2=0x7fe9300c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.944+0000 7fe936bf2700 1 --2- 172.21.15.170:0/1762069141 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9300cba50 0x7fe9300c84d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe9240098f0 tx=0x7fe924009c00 comp rx=0 tx=0).stop 2023-08-31T01:59:34.938 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.944+0000 7fe936bf2700 1 -- 172.21.15.170:0/1762069141 shutdown_connections 2023-08-31T01:59:34.938 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.944+0000 7fe936bf2700 1 --2- 172.21.15.170:0/1762069141 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9300cba50 0x7fe9300c84d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.938 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.944+0000 7fe936bf2700 1 -- 172.21.15.170:0/1762069141 >> 172.21.15.170:0/1762069141 conn(0x7fe9300ca900 msgr2=0x7fe9300cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:34.938 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.944+0000 7fe936bf2700 1 -- 172.21.15.170:0/1762069141 shutdown_connections 2023-08-31T01:59:34.938 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.944+0000 7fe936bf2700 1 -- 172.21.15.170:0/1762069141 wait complete. 2023-08-31T01:59:34.941 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.946+0000 7fe936bf2700 1 Processor -- start 2023-08-31T01:59:34.941 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.946+0000 7fe936bf2700 1 -- start start 2023-08-31T01:59:34.941 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe936bf2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9300c4290 0x7fe9301e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.942 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe936bf2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cba50 0x7fe93006bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.942 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe936bf2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe93006c010 0x7fe9301e0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:34.942 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe936bf2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93006d1a0 con 0x7fe9300c4290 2023-08-31T01:59:34.942 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe936bf2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93006c590 con 0x7fe9300cba50 2023-08-31T01:59:34.942 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe936bf2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93006c870 con 0x7fe93006c010 2023-08-31T01:59:34.943 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cba50 0x7fe93006bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.943 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe93518f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe93006c010 0x7fe9301e0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.943 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cba50 0x7fe93006bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55576/0 (socket says 172.21.15.170:55576) 2023-08-31T01:59:34.943 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe92ffff700 1 -- 172.21.15.170:0/3754691485 learned_addr learned my addr 172.21.15.170:0/3754691485 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-08-31T01:59:34.943 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe93498e700 1 --2- 172.21.15.170:0/3754691485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9300c4290 0x7fe9301e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.947+0000 7fe92ffff700 1 -- 172.21.15.170:0/3754691485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe93006c010 msgr2=0x7fe9301e0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92ffff700 1 --2- 172.21.15.170:0/3754691485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe93006c010 0x7fe9301e0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92ffff700 1 -- 172.21.15.170:0/3754691485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9300c4290 msgr2=0x7fe9301e2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92ffff700 1 --2- 172.21.15.170:0/3754691485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9300c4290 0x7fe9301e2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92ffff700 1 -- 172.21.15.170:0/3754691485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924009520 con 0x7fe9300cba50 2023-08-31T01:59:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92ffff700 1 --2- 172.21.15.170:0/3754691485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cba50 0x7fe93006bad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00c700 tx=0x7fe91c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92d7fa700 1 -- 172.21.15.170:0/3754691485 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c005230 con 0x7fe9300cba50 2023-08-31T01:59:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92d7fa700 1 -- 172.21.15.170:0/3754691485 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe91c005480 con 0x7fe9300cba50 2023-08-31T01:59:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93006cb50 con 0x7fe9300cba50 2023-08-31T01:59:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92d7fa700 1 -- 172.21.15.170:0/3754691485 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c004990 con 0x7fe9300cba50 2023-08-31T01:59:34.946 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9301e0860 con 0x7fe9300cba50 2023-08-31T01:59:34.946 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92d7fa700 1 -- 172.21.15.170:0/3754691485 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe91c011590 con 0x7fe9300cba50 2023-08-31T01:59:34.946 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.948+0000 7fe92d7fa700 1 -- 172.21.15.170:0/3754691485 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe91c011cd0 con 0x7fe9300cba50 2023-08-31T01:59:34.946 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.949+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93006d530 con 0x7fe9300cba50 2023-08-31T01:59:34.947 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:34.951+0000 7fe92d7fa700 1 -- 172.21.15.170:0/3754691485 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe93006d530 con 0x7fe9300cba50 2023-08-31T01:59:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.032+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cee7d084-e5fd-4b9c-92e3-e14e7efd925a", "id": 3} v 0) v1 -- 0x7fe93006d310 con 0x7fe9300cba50 2023-08-31T01:59:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.036+0000 7fe92d7fa700 1 -- 172.21.15.170:0/3754691485 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cee7d084-e5fd-4b9c-92e3-e14e7efd925a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe91c017070 con 0x7fe9300cba50 2023-08-31T01:59:35.029 INFO:teuthology.orchestra.run.smithi170.stdout:3 2023-08-31T01:59:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cba50 msgr2=0x7fe93006bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 --2- 172.21.15.170:0/3754691485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cba50 0x7fe93006bad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00c700 tx=0x7fe91c00ca10 comp rx=0 tx=0).stop 2023-08-31T01:59:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 shutdown_connections 2023-08-31T01:59:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 --2- 172.21.15.170:0/3754691485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe93006c010 0x7fe9301e0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 --2- 172.21.15.170:0/3754691485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9300c4290 0x7fe9301e2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 --2- 172.21.15.170:0/3754691485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cba50 0x7fe93006bad0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 >> 172.21.15.170:0/3754691485 conn(0x7fe9300ca900 msgr2=0x7fe9300b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 shutdown_connections 2023-08-31T01:59:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.037+0000 7fe936bf2700 1 -- 172.21.15.170:0/3754691485 wait complete. 2023-08-31T01:59:35.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new c452f9fd-131e-401f-b16c-4406f2aff9ec 4 2023-08-31T01:59:35.074 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:35.081+0000 7f772777d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T01:59:35.142 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:35.150+0000 7f7447797200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T01:59:35.168 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.171+0000 7f94a51fa700 1 -- 172.21.15.170:0/2956325270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a006b340 msgr2=0x7f94a00ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.168 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.172+0000 7f94a51fa700 1 --2- 172.21.15.170:0/2956325270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a006b340 0x7f94a00ce9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9498009f60 tx=0x7f9498009f90 comp rx=0 tx=0).stop 2023-08-31T01:59:35.169 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.172+0000 7f94a51fa700 1 -- 172.21.15.170:0/2956325270 shutdown_connections 2023-08-31T01:59:35.169 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.172+0000 7f94a51fa700 1 --2- 172.21.15.170:0/2956325270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a006b340 0x7f94a00ce9d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.169 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.172+0000 7f94a51fa700 1 -- 172.21.15.170:0/2956325270 >> 172.21.15.170:0/2956325270 conn(0x7f94a0069d90 msgr2=0x7f94a00cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.169 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.172+0000 7f94a51fa700 1 -- 172.21.15.170:0/2956325270 shutdown_connections 2023-08-31T01:59:35.169 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.172+0000 7f94a51fa700 1 -- 172.21.15.170:0/2956325270 wait complete. 2023-08-31T01:59:35.170 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.173+0000 7f94a51fa700 1 Processor -- start 2023-08-31T01:59:35.170 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.173+0000 7f94a51fa700 1 -- start start 2023-08-31T01:59:35.170 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f94a51fa700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a006b340 0x7f94a0148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.170 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f94a51fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a00b1250 0x7f94a00c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.171 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f94a51fa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a00cdcb0 0x7f94a00c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.171 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f94a51fa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00c40e0 con 0x7f94a00b1250 2023-08-31T01:59:35.171 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f94a51fa700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0148b50 con 0x7f94a00cdcb0 2023-08-31T01:59:35.171 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f94a51fa700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00c34d0 con 0x7f94a006b340 2023-08-31T01:59:35.171 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949ed9d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a006b340 0x7f94a0148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.171 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949f59e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a00cdcb0 0x7f94a00c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949f59e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a00cdcb0 0x7f94a00c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55590/0 (socket says 172.21.15.170:55590) 2023-08-31T01:59:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949ed9d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a006b340 0x7f94a0148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54298/0 (socket says 172.21.15.170:54298) 2023-08-31T01:59:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949f59e700 1 -- 172.21.15.170:0/1900206562 learned_addr learned my addr 172.21.15.170:0/1900206562 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-08-31T01:59:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949e59c700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a00b1250 0x7f94a00c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949e59c700 1 -- 172.21.15.170:0/1900206562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a006b340 msgr2=0x7f94a0148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949e59c700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a006b340 0x7f94a0148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949e59c700 1 -- 172.21.15.170:0/1900206562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a00cdcb0 msgr2=0x7f94a00c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949e59c700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a00cdcb0 0x7f94a00c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949e59c700 1 -- 172.21.15.170:0/1900206562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498009c40 con 0x7f94a00b1250 2023-08-31T01:59:35.174 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949f59e700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a00cdcb0 0x7f94a00c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T01:59:35.174 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.174+0000 7f949ed9d700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a006b340 0x7f94a0148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T01:59:35.174 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.175+0000 7f949e59c700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a00b1250 0x7f94a00c2b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9494000f60 tx=0x7f949400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:35.174 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.175+0000 7f94877fe700 1 -- 172.21.15.170:0/1900206562 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940054e0 con 0x7f94a00b1250 2023-08-31T01:59:35.174 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.175+0000 7f94877fe700 1 -- 172.21.15.170:0/1900206562 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9494003680 con 0x7f94a00b1250 2023-08-31T01:59:35.175 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.175+0000 7f94877fe700 1 -- 172.21.15.170:0/1900206562 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494003a90 con 0x7f94a00b1250 2023-08-31T01:59:35.175 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.175+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a00c37b0 con 0x7f94a00b1250 2023-08-31T01:59:35.175 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.175+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a00c3d70 con 0x7f94a00b1250 2023-08-31T01:59:35.175 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.175+0000 7f94877fe700 1 -- 172.21.15.170:0/1900206562 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f949401c440 con 0x7f94a00b1250 2023-08-31T01:59:35.175 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.175+0000 7f94877fe700 1 -- 172.21.15.170:0/1900206562 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f949401cc00 con 0x7f94a00b1250 2023-08-31T01:59:35.176 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.176+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a004e7c0 con 0x7f94a00b1250 2023-08-31T01:59:35.176 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.178+0000 7f94877fe700 1 -- 172.21.15.170:0/1900206562 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9494017070 con 0x7f94a00b1250 2023-08-31T01:59:35.254 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.262+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c452f9fd-131e-401f-b16c-4406f2aff9ec", "id": 4} v 0) v1 -- 0x7f94a00c4220 con 0x7f94a00b1250 2023-08-31T01:59:35.258 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.266+0000 7f94877fe700 1 -- 172.21.15.170:0/1900206562 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c452f9fd-131e-401f-b16c-4406f2aff9ec", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f94a00af990 con 0x7f94a00b1250 2023-08-31T01:59:35.258 INFO:teuthology.orchestra.run.smithi170.stdout:4 2023-08-31T01:59:35.259 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a00b1250 msgr2=0x7f94a00c2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.260 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a00b1250 0x7f94a00c2b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9494000f60 tx=0x7f949400c9c0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.260 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 shutdown_connections 2023-08-31T01:59:35.260 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a00cdcb0 0x7f94a00c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.260 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a006b340 0x7f94a0148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.261 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 --2- 172.21.15.170:0/1900206562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94a00b1250 0x7f94a00c2b80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.261 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 >> 172.21.15.170:0/1900206562 conn(0x7f94a0069d90 msgr2=0x7f94a006edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.261 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 shutdown_connections 2023-08-31T01:59:35.261 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.267+0000 7f94a51fa700 1 -- 172.21.15.170:0/1900206562 wait complete. 2023-08-31T01:59:35.271 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 0b52460e-6bb7-4f33-801f-cbdff681fcdd 5 2023-08-31T01:59:35.393 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.401+0000 7f5a86116700 1 -- 172.21.15.170:0/170412954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80071090 msgr2=0x7f5a800c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.394 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.401+0000 7f5a86116700 1 --2- 172.21.15.170:0/170412954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80071090 0x7f5a800c5340 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5a800ca860 tx=0x7f5a78009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:35.394 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.401+0000 7f5a86116700 1 -- 172.21.15.170:0/170412954 shutdown_connections 2023-08-31T01:59:35.394 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.401+0000 7f5a86116700 1 --2- 172.21.15.170:0/170412954 >> v2:172.21.15.84:3300/0 conn(0x7f5a80159190 0x7f5a800b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.394 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.401+0000 7f5a86116700 1 --2- 172.21.15.170:0/170412954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80071090 0x7f5a800c5340 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.395 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.401+0000 7f5a86116700 1 -- 172.21.15.170:0/170412954 >> 172.21.15.170:0/170412954 conn(0x7f5a800cdee0 msgr2=0x7f5a800ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.395 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.401+0000 7f5a86116700 1 -- 172.21.15.170:0/170412954 shutdown_connections 2023-08-31T01:59:35.395 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.401+0000 7f5a86116700 1 -- 172.21.15.170:0/170412954 wait complete. 2023-08-31T01:59:35.399 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.402+0000 7f5a86116700 1 Processor -- start 2023-08-31T01:59:35.400 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.402+0000 7f5a86116700 1 -- start start 2023-08-31T01:59:35.400 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a86116700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a80071090 0x7f5a8006c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.400 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a86116700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a800c8530 0x7f5a8015b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.401 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a86116700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a80159190 0x7f5a80148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.401 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a86116700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8006ad40 con 0x7f5a80159190 2023-08-31T01:59:35.401 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a86116700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8006d460 con 0x7f5a800c8530 2023-08-31T01:59:35.402 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a86116700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a80148860 con 0x7f5a80071090 2023-08-31T01:59:35.402 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7effd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a800c8530 0x7f5a8015b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.402 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7f7fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a80071090 0x7f5a8006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.403 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7f7fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a80071090 0x7f5a8006c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54310/0 (socket says 172.21.15.170:54310) 2023-08-31T01:59:35.403 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7effd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a800c8530 0x7f5a8015b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55600/0 (socket says 172.21.15.170:55600) 2023-08-31T01:59:35.404 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7f7fe700 1 -- 172.21.15.170:0/2652895570 learned_addr learned my addr 172.21.15.170:0/2652895570 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-08-31T01:59:35.404 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7ffff700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a80159190 0x7f5a80148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.404 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7f7fe700 1 -- 172.21.15.170:0/2652895570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a800c8530 msgr2=0x7f5a8015b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.405 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7f7fe700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a800c8530 0x7f5a8015b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.405 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7f7fe700 1 -- 172.21.15.170:0/2652895570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a80159190 msgr2=0x7f5a80148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.405 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7f7fe700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a80159190 0x7f5a80148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.405 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7f7fe700 1 -- 172.21.15.170:0/2652895570 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780095f0 con 0x7f5a80071090 2023-08-31T01:59:35.406 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.403+0000 7f5a7effd700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a800c8530 0x7f5a8015b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T01:59:35.406 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.404+0000 7f5a7f7fe700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a80071090 0x7f5a8006c100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000efc0 tx=0x7f5a7000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:35.406 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.404+0000 7f5a67fff700 1 -- 172.21.15.170:0/2652895570 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7000c900 con 0x7f5a80071090 2023-08-31T01:59:35.406 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.404+0000 7f5a67fff700 1 -- 172.21.15.170:0/2652895570 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5a7000f040 con 0x7f5a80071090 2023-08-31T01:59:35.407 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.404+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8006c7e0 con 0x7f5a80071090 2023-08-31T01:59:35.407 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.404+0000 7f5a67fff700 1 -- 172.21.15.170:0/2652895570 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7000cd00 con 0x7f5a80071090 2023-08-31T01:59:35.407 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.404+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8006cda0 con 0x7f5a80071090 2023-08-31T01:59:35.407 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.404+0000 7f5a67fff700 1 -- 172.21.15.170:0/2652895570 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a70007800 con 0x7f5a80071090 2023-08-31T01:59:35.407 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.404+0000 7f5a67fff700 1 -- 172.21.15.170:0/2652895570 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5a70014cd0 con 0x7f5a80071090 2023-08-31T01:59:35.409 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.405+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a801e17b0 con 0x7f5a80071090 2023-08-31T01:59:35.409 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.407+0000 7f5a67fff700 1 -- 172.21.15.170:0/2652895570 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5a70007bf0 con 0x7f5a80071090 2023-08-31T01:59:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.489+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0b52460e-6bb7-4f33-801f-cbdff681fcdd", "id": 5} v 0) v1 -- 0x7f5a800c5850 con 0x7f5a80071090 2023-08-31T01:59:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.494+0000 7f5a67fff700 1 -- 172.21.15.170:0/2652895570 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b52460e-6bb7-4f33-801f-cbdff681fcdd", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a70007d90 con 0x7f5a80071090 2023-08-31T01:59:35.486 INFO:teuthology.orchestra.run.smithi170.stdout:5 2023-08-31T01:59:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.494+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a80071090 msgr2=0x7f5a8006c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.494+0000 7f5a86116700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a80071090 0x7f5a8006c100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000efc0 tx=0x7f5a7000c3a0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.494+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 shutdown_connections 2023-08-31T01:59:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.494+0000 7f5a86116700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a80159190 0x7f5a80148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.494+0000 7f5a86116700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a80071090 0x7f5a8006c100 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.494+0000 7f5a86116700 1 --2- 172.21.15.170:0/2652895570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a800c8530 0x7f5a8015b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.495+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 >> 172.21.15.170:0/2652895570 conn(0x7f5a800cdee0 msgr2=0x7f5a80158290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.495+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 shutdown_connections 2023-08-31T01:59:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.495+0000 7f5a86116700 1 -- 172.21.15.170:0/2652895570 wait complete. 2023-08-31T01:59:35.499 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new a076d44f-d92a-4547-a076-dabe1fff3121 6 2023-08-31T01:59:35.646 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.654+0000 7f27ced66700 1 -- 172.21.15.170:0/2717148785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c815cce0 msgr2=0x7f27c815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.647 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.654+0000 7f27ced66700 1 --2- 172.21.15.170:0/2717148785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c815cce0 0x7f27c815d150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f27b40098f0 tx=0x7f27b4009c00 comp rx=0 tx=0).stop 2023-08-31T01:59:35.647 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.654+0000 7f27ced66700 1 -- 172.21.15.170:0/2717148785 shutdown_connections 2023-08-31T01:59:35.647 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.654+0000 7f27ced66700 1 --2- 172.21.15.170:0/2717148785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27c80cba50 0x7f27c80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.647 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.654+0000 7f27ced66700 1 --2- 172.21.15.170:0/2717148785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c815cce0 0x7f27c815d150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.648 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.654+0000 7f27ced66700 1 -- 172.21.15.170:0/2717148785 >> 172.21.15.170:0/2717148785 conn(0x7f27c80ca900 msgr2=0x7f27c80cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.648 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.654+0000 7f27ced66700 1 -- 172.21.15.170:0/2717148785 shutdown_connections 2023-08-31T01:59:35.648 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.654+0000 7f27ced66700 1 -- 172.21.15.170:0/2717148785 wait complete. 2023-08-31T01:59:35.651 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.655+0000 7f27ced66700 1 Processor -- start 2023-08-31T01:59:35.651 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.655+0000 7f27ced66700 1 -- start start 2023-08-31T01:59:35.651 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27ced66700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27c80cba50 0x7f27c8131f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.651 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27ced66700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c8142a60 0x7f27c8158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.651 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27ced66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c815cce0 0x7f27c80c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.652 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27ced66700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8130460 con 0x7f27c815cce0 2023-08-31T01:59:35.652 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27ced66700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c812f540 con 0x7f27c8142a60 2023-08-31T01:59:35.652 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27ced66700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c81324d0 con 0x7f27c80cba50 2023-08-31T01:59:35.652 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27c7fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c8142a60 0x7f27c8158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.652 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27ccb02700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27c80cba50 0x7f27c8131f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.653 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27c7fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c8142a60 0x7f27c8158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55612/0 (socket says 172.21.15.170:55612) 2023-08-31T01:59:35.653 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27c7fff700 1 -- 172.21.15.170:0/1734497283 learned_addr learned my addr 172.21.15.170:0/1734497283 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-08-31T01:59:35.653 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27cd303700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c815cce0 0x7f27c80c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.653 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27c7fff700 1 -- 172.21.15.170:0/1734497283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27c80cba50 msgr2=0x7f27c8131f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.653 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27c7fff700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27c80cba50 0x7f27c8131f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.654 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27c7fff700 1 -- 172.21.15.170:0/1734497283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c815cce0 msgr2=0x7f27c80c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.654 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27c7fff700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c815cce0 0x7f27c80c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.654 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27c7fff700 1 -- 172.21.15.170:0/1734497283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4009520 con 0x7f27c8142a60 2023-08-31T01:59:35.654 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.656+0000 7f27ccb02700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27c80cba50 0x7f27c8131f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T01:59:35.654 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.657+0000 7f27c7fff700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c8142a60 0x7f27c8158ac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009230 tx=0x7f27b400f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:35.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.657+0000 7f27c57fa700 1 -- 172.21.15.170:0/1734497283 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b400fd90 con 0x7f27c8142a60 2023-08-31T01:59:35.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.657+0000 7f27c57fa700 1 -- 172.21.15.170:0/1734497283 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f27b4017400 con 0x7f27c8142a60 2023-08-31T01:59:35.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.657+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c812f7e0 con 0x7f27c8142a60 2023-08-31T01:59:35.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.657+0000 7f27c57fa700 1 -- 172.21.15.170:0/1734497283 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4017810 con 0x7f27c8142a60 2023-08-31T01:59:35.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.657+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c812fda0 con 0x7f27c8142a60 2023-08-31T01:59:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.657+0000 7f27c57fa700 1 -- 172.21.15.170:0/1734497283 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f27b4017970 con 0x7f27c8142a60 2023-08-31T01:59:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.657+0000 7f27c57fa700 1 -- 172.21.15.170:0/1734497283 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f27b402bd00 con 0x7f27c8142a60 2023-08-31T01:59:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.658+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c81305a0 con 0x7f27c8142a60 2023-08-31T01:59:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.660+0000 7f27c57fa700 1 -- 172.21.15.170:0/1734497283 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f27c81305a0 con 0x7f27c8142a60 2023-08-31T01:59:35.708 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:35.716+0000 7f772777d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T01:59:35.737 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.745+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a076d44f-d92a-4547-a076-dabe1fff3121", "id": 6} v 0) v1 -- 0x7f27c804e7c0 con 0x7f27c8142a60 2023-08-31T01:59:35.740 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.748+0000 7f27c57fa700 1 -- 172.21.15.170:0/1734497283 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a076d44f-d92a-4547-a076-dabe1fff3121", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f27b4030060 con 0x7f27c8142a60 2023-08-31T01:59:35.741 INFO:teuthology.orchestra.run.smithi170.stdout:6 2023-08-31T01:59:35.742 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.749+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c8142a60 msgr2=0x7f27c8158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.742 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.749+0000 7f27ced66700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c8142a60 0x7f27c8158ac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009230 tx=0x7f27b400f710 comp rx=0 tx=0).stop 2023-08-31T01:59:35.742 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.750+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 shutdown_connections 2023-08-31T01:59:35.742 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.750+0000 7f27ced66700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27c815cce0 0x7f27c80c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.750+0000 7f27ced66700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27c80cba50 0x7f27c8131f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.750+0000 7f27ced66700 1 --2- 172.21.15.170:0/1734497283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c8142a60 0x7f27c8158ac0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.750+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 >> 172.21.15.170:0/1734497283 conn(0x7f27c80ca900 msgr2=0x7f27c8141ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.750+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 shutdown_connections 2023-08-31T01:59:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.750+0000 7f27ced66700 1 -- 172.21.15.170:0/1734497283 wait complete. 2023-08-31T01:59:35.755 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 041acc92-3c86-425f-a750-6db96a7b852a 7 2023-08-31T01:59:35.777 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:35.784+0000 7f772777d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T01:59:35.835 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:35.843+0000 7f7447797200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T01:59:35.879 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 -- 172.21.15.170:0/2744258260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 msgr2=0x7fe2500c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.879 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 --2- 172.21.15.170:0/2744258260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 0x7fe2500c96a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2500d0150 tx=0x7fe240009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:35.880 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 -- 172.21.15.170:0/2744258260 shutdown_connections 2023-08-31T01:59:35.880 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 --2- 172.21.15.170:0/2744258260 >> v2:172.21.15.84:3300/0 conn(0x7fe2500b0b20 0x7fe2500b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.880 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 --2- 172.21.15.170:0/2744258260 >> v2:172.21.15.170:3300/0 conn(0x7fe2501591b0 0x7fe2500af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.880 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 --2- 172.21.15.170:0/2744258260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 0x7fe2500c96a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.881 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 -- 172.21.15.170:0/2744258260 >> 172.21.15.170:0/2744258260 conn(0x7fe250069d90 msgr2=0x7fe2500cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.881 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 -- 172.21.15.170:0/2744258260 shutdown_connections 2023-08-31T01:59:35.881 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.886+0000 7fe2581d7700 1 -- 172.21.15.170:0/2744258260 wait complete. 2023-08-31T01:59:35.884 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.888+0000 7fe2581d7700 1 Processor -- start 2023-08-31T01:59:35.884 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.888+0000 7fe2581d7700 1 -- start start 2023-08-31T01:59:35.884 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe2581d7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2500b0b20 0x7fe2501e1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.885 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe2581d7700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 0x7fe2501e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.885 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe2581d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2501591b0 0x7fe2500c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:35.885 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe2581d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501e2800 con 0x7fe2501591b0 2023-08-31T01:59:35.885 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe2581d7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501e3ee0 con 0x7fe2500b0b20 2023-08-31T01:59:35.886 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe2581d7700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25015a1d0 con 0x7fe2500cb1c0 2023-08-31T01:59:35.886 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255f73700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2500b0b20 0x7fe2501e1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.886 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255772700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 0x7fe2501e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.886 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255f73700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2500b0b20 0x7fe2501e1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55622/0 (socket says 172.21.15.170:55622) 2023-08-31T01:59:35.887 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255772700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 0x7fe2501e4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54336/0 (socket says 172.21.15.170:54336) 2023-08-31T01:59:35.887 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255f73700 1 -- 172.21.15.170:0/3994731765 learned_addr learned my addr 172.21.15.170:0/3994731765 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-08-31T01:59:35.887 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe256774700 1 --2- 172.21.15.170:0/3994731765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2501591b0 0x7fe2500c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:35.887 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255772700 1 -- 172.21.15.170:0/3994731765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2500b0b20 msgr2=0x7fe2501e1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.888 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255772700 1 --2- 172.21.15.170:0/3994731765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2500b0b20 0x7fe2501e1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.888 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255772700 1 -- 172.21.15.170:0/3994731765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2501591b0 msgr2=0x7fe2500c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.888 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255772700 1 --2- 172.21.15.170:0/3994731765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2501591b0 0x7fe2500c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.888 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255772700 1 -- 172.21.15.170:0/3994731765 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400095f0 con 0x7fe2500cb1c0 2023-08-31T01:59:35.888 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.889+0000 7fe255772700 1 --2- 172.21.15.170:0/3994731765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 0x7fe2501e4390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe240015000 tx=0x7fe240004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:35.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.890+0000 7fe2467fc700 1 -- 172.21.15.170:0/3994731765 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240021070 con 0x7fe2500cb1c0 2023-08-31T01:59:35.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.890+0000 7fe2467fc700 1 -- 172.21.15.170:0/3994731765 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe240003680 con 0x7fe2500cb1c0 2023-08-31T01:59:35.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.890+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe250159ea0 con 0x7fe2500cb1c0 2023-08-31T01:59:35.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.890+0000 7fe2467fc700 1 -- 172.21.15.170:0/3994731765 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2400045f0 con 0x7fe2500cb1c0 2023-08-31T01:59:35.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.890+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2501e2240 con 0x7fe2500cb1c0 2023-08-31T01:59:35.890 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.890+0000 7fe2467fc700 1 -- 172.21.15.170:0/3994731765 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe240025070 con 0x7fe2500cb1c0 2023-08-31T01:59:35.890 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.890+0000 7fe2467fc700 1 -- 172.21.15.170:0/3994731765 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe24000f460 con 0x7fe2500cb1c0 2023-08-31T01:59:35.890 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.891+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2500afab0 con 0x7fe2500cb1c0 2023-08-31T01:59:35.890 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.893+0000 7fe2467fc700 1 -- 172.21.15.170:0/3994731765 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe240003a90 con 0x7fe2500cb1c0 2023-08-31T01:59:35.907 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:35.915+0000 7f7447797200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T01:59:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.974+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "041acc92-3c86-425f-a750-6db96a7b852a", "id": 7} v 0) v1 -- 0x7fe2500c9d50 con 0x7fe2500cb1c0 2023-08-31T01:59:35.975 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.982+0000 7fe2467fc700 1 -- 172.21.15.170:0/3994731765 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "041acc92-3c86-425f-a750-6db96a7b852a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe240003d00 con 0x7fe2500cb1c0 2023-08-31T01:59:35.976 INFO:teuthology.orchestra.run.smithi170.stdout:7 2023-08-31T01:59:35.977 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 msgr2=0x7fe2501e4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 --2- 172.21.15.170:0/3994731765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 0x7fe2501e4390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe240015000 tx=0x7fe240004260 comp rx=0 tx=0).stop 2023-08-31T01:59:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 shutdown_connections 2023-08-31T01:59:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 --2- 172.21.15.170:0/3994731765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2501591b0 0x7fe2500c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 --2- 172.21.15.170:0/3994731765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2500b0b20 0x7fe2501e1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 --2- 172.21.15.170:0/3994731765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2500cb1c0 0x7fe2501e4390 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 >> 172.21.15.170:0/3994731765 conn(0x7fe250069d90 msgr2=0x7fe2500ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 shutdown_connections 2023-08-31T01:59:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T01:59:35.983+0000 7fe2581d7700 1 -- 172.21.15.170:0/3994731765 wait complete. 2023-08-31T01:59:35.989 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-31T01:59:35.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-31T01:59:35.992 INFO:tasks.ceph.osd.0:Started 2023-08-31T01:59:35.992 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-31T01:59:35.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-31T01:59:35.994 INFO:tasks.ceph.osd.1:Started 2023-08-31T01:59:35.995 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-31T01:59:35.995 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-31T01:59:35.997 INFO:tasks.ceph.osd.2:Started 2023-08-31T01:59:35.998 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-31T01:59:35.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-31T01:59:36.000 INFO:tasks.ceph.osd.3:Started 2023-08-31T01:59:36.000 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-31T01:59:36.001 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-31T01:59:36.003 INFO:tasks.ceph.osd.4:Started 2023-08-31T01:59:36.003 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-31T01:59:36.004 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-31T01:59:36.006 INFO:tasks.ceph.osd.5:Started 2023-08-31T01:59:36.006 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-31T01:59:36.006 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-31T01:59:36.008 INFO:tasks.ceph.osd.6:Started 2023-08-31T01:59:36.010 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-31T01:59:36.010 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-31T01:59:36.013 INFO:tasks.ceph.osd.7:Started 2023-08-31T01:59:36.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T01:59:36.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.178+0000 7f0b679dc700 1 -- 172.21.15.84:0/1284224459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b4c005210 msgr2=0x7f0b4c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:36.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.178+0000 7f0b679dc700 1 --2- 172.21.15.84:0/1284224459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b4c005210 0x7f0b4c00ba10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e350 tx=0x7f0b4c005880 comp rx=0 tx=0).stop 2023-08-31T01:59:36.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.178+0000 7f0b679dc700 1 -- 172.21.15.84:0/1284224459 shutdown_connections 2023-08-31T01:59:36.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.178+0000 7f0b679dc700 1 --2- 172.21.15.84:0/1284224459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b4c005210 0x7f0b4c00ba10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:36.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.178+0000 7f0b679dc700 1 -- 172.21.15.84:0/1284224459 >> 172.21.15.84:0/1284224459 conn(0x7f0b600ca930 msgr2=0x7f0b600cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:36.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.178+0000 7f0b679dc700 1 -- 172.21.15.84:0/1284224459 shutdown_connections 2023-08-31T01:59:36.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.178+0000 7f0b679dc700 1 -- 172.21.15.84:0/1284224459 wait complete. 2023-08-31T01:59:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.179+0000 7f0b679dc700 1 Processor -- start 2023-08-31T01:59:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.179+0000 7f0b679dc700 1 -- start start 2023-08-31T01:59:36.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b679dc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b4c005210 0x7f0b6014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:36.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b679dc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b600c3d20 0x7f0b600c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:36.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b679dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b601e1ca0 0x7f0b601e2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:36.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b679dc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b601e2660 con 0x7f0b601e1ca0 2023-08-31T01:59:36.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b679dc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600c17d0 con 0x7f0b4c005210 2023-08-31T01:59:36.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b679dc700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6014d430 con 0x7f0b600c3d20 2023-08-31T01:59:36.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b4c005210 0x7f0b6014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:36.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b64f77700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b600c3d20 0x7f0b600c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:36.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65f79700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b601e1ca0 0x7f0b601e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b4c005210 0x7f0b6014cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:53914/0 (socket says 172.21.15.84:53914) 2023-08-31T01:59:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 -- 172.21.15.84:0/2867772493 learned_addr learned my addr 172.21.15.84:0/2867772493 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b64f77700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b600c3d20 0x7f0b600c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:44488/0 (socket says 172.21.15.84:44488) 2023-08-31T01:59:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 -- 172.21.15.84:0/2867772493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b600c3d20 msgr2=0x7f0b600c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 --2- 172.21.15.84:0/2867772493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b600c3d20 0x7f0b600c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 -- 172.21.15.84:0/2867772493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b601e1ca0 msgr2=0x7f0b601e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 --2- 172.21.15.84:0/2867772493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b601e1ca0 0x7f0b601e2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 -- 172.21.15.84:0/2867772493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b601596c0 con 0x7f0b4c005210 2023-08-31T01:59:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65f79700 1 --2- 172.21.15.84:0/2867772493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b601e1ca0 0x7f0b601e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T01:59:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.180+0000 7f0b65778700 1 --2- 172.21.15.84:0/2867772493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b4c005210 0x7f0b6014cef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c003f50 tx=0x7f0b5c0017c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.181+0000 7f0b55ffb700 1 -- 172.21.15.84:0/2867772493 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011840 con 0x7f0b4c005210 2023-08-31T01:59:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.181+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b600c1a20 con 0x7f0b4c005210 2023-08-31T01:59:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.181+0000 7f0b55ffb700 1 -- 172.21.15.84:0/2867772493 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0b5c0119a0 con 0x7f0b4c005210 2023-08-31T01:59:36.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.181+0000 7f0b55ffb700 1 -- 172.21.15.84:0/2867772493 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011d70 con 0x7f0b4c005210 2023-08-31T01:59:36.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.181+0000 7f0b55ffb700 1 -- 172.21.15.84:0/2867772493 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0b5c01a450 con 0x7f0b4c005210 2023-08-31T01:59:36.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.181+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b600c1fe0 con 0x7f0b4c005210 2023-08-31T01:59:36.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.181+0000 7f0b55ffb700 1 -- 172.21.15.84:0/2867772493 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0b5c01add0 con 0x7f0b4c005210 2023-08-31T01:59:36.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.182+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6004e7c0 con 0x7f0b4c005210 2023-08-31T01:59:36.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.186+0000 7f0b55ffb700 1 -- 172.21.15.84:0/2867772493 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0b5c01f060 con 0x7f0b4c005210 2023-08-31T01:59:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.255+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b600af3c0 con 0x7f0b4c005210 2023-08-31T01:59:36.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.256+0000 7f0b55ffb700 1 -- 172.21.15.84:0/2867772493 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0b5c015070 con 0x7f0b4c005210 2023-08-31T01:59:36.249 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:59:36.249 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T01:59:35.976173+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T01:59:36.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b4c005210 msgr2=0x7f0b6014cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:36.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 --2- 172.21.15.84:0/2867772493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b4c005210 0x7f0b6014cef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c003f50 tx=0x7f0b5c0017c0 comp rx=0 tx=0).stop 2023-08-31T01:59:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 shutdown_connections 2023-08-31T01:59:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 --2- 172.21.15.84:0/2867772493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b601e1ca0 0x7f0b601e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 --2- 172.21.15.84:0/2867772493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b4c005210 0x7f0b6014cef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 --2- 172.21.15.84:0/2867772493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b600c3d20 0x7f0b600c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 >> 172.21.15.84:0/2867772493 conn(0x7f0b600ca930 msgr2=0x7f0b600ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:36.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 shutdown_connections 2023-08-31T01:59:36.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:36.257+0000 7f0b679dc700 1 -- 172.21.15.84:0/2867772493 wait complete. 2023-08-31T01:59:36.261 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-31T01:59:36.262 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-31T01:59:36.362 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-08-31T01:59:36.369+0000 7fbfa65cf640 -1 Falling back to public interface 2023-08-31T01:59:36.508 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:36.516+0000 7f772777d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T01:59:36.586 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:36.593+0000 7f772777d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-31T01:59:36.608 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-08-31T01:59:36.616+0000 7f011d3bf640 -1 Falling back to public interface 2023-08-31T01:59:36.615 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-08-31T01:59:36.623+0000 7f174d3bc640 -1 Falling back to public interface 2023-08-31T01:59:36.623 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-08-31T01:59:36.631+0000 7eff36ae8640 -1 Falling back to public interface 2023-08-31T01:59:36.628 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-08-31T01:59:36.635+0000 7f7be91b9640 -1 Falling back to public interface 2023-08-31T01:59:36.629 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-08-31T01:59:36.636+0000 7f23e17a2640 -1 Falling back to public interface 2023-08-31T01:59:36.630 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-08-31T01:59:36.637+0000 7f7be0577700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6813/0: (98) Address already in use 2023-08-31T01:59:36.631 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-08-31T01:59:36.639+0000 7f39c33f2640 -1 Falling back to public interface 2023-08-31T01:59:36.632 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-08-31T01:59:36.639+0000 7efce7042640 -1 Falling back to public interface 2023-08-31T01:59:36.641 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:36.649+0000 7f7447797200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T01:59:36.719 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:36.727+0000 7f7447797200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-31T01:59:36.731 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:36.738+0000 7f772777d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T01:59:36.859 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:36.867+0000 7f7447797200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T01:59:36.965 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:36.973+0000 7f772777d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-31T01:59:37.066 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T01:59:37.096 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:37.104+0000 7f7447797200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-31T01:59:37.179 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:37.187+0000 7f772777d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T01:59:37.184 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.191+0000 7f85add01700 1 -- 172.21.15.84:0/849427770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8590005210 msgr2=0x7f859000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:37.184 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.191+0000 7f85add01700 1 --2- 172.21.15.84:0/849427770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8590005210 0x7f859000ba10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85a000e350 tx=0x7f8590005880 comp rx=0 tx=0).stop 2023-08-31T01:59:37.184 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.191+0000 7f85add01700 1 -- 172.21.15.84:0/849427770 shutdown_connections 2023-08-31T01:59:37.184 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.191+0000 7f85add01700 1 --2- 172.21.15.84:0/849427770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8590005210 0x7f859000ba10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:37.185 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.191+0000 7f85add01700 1 -- 172.21.15.84:0/849427770 >> 172.21.15.84:0/849427770 conn(0x7f85a80caa20 msgr2=0x7f85a80cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:37.185 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.191+0000 7f85add01700 1 -- 172.21.15.84:0/849427770 shutdown_connections 2023-08-31T01:59:37.185 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.191+0000 7f85add01700 1 -- 172.21.15.84:0/849427770 wait complete. 2023-08-31T01:59:37.186 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.193+0000 7f85add01700 1 Processor -- start 2023-08-31T01:59:37.186 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.193+0000 7f85add01700 1 -- start start 2023-08-31T01:59:37.189 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85add01700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8590005210 0x7f85a81f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:37.189 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85add01700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a80c40b0 0x7f85a80c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:37.189 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85add01700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a8155740 0x7f85a806a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:37.190 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85add01700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80c1ad0 con 0x7f85a8155740 2023-08-31T01:59:37.190 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85add01700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81f3b50 con 0x7f85a80c40b0 2023-08-31T01:59:37.190 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85add01700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80c1d20 con 0x7f8590005210 2023-08-31T01:59:37.190 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a8155740 0x7f85a806a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:37.190 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a8155740 0x7f85a806a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50288/0 (socket says 172.21.15.84:50288) 2023-08-31T01:59:37.191 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85a7fff700 1 -- 172.21.15.84:0/20163577 learned_addr learned my addr 172.21.15.84:0/20163577 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:37.191 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85a6ffd700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a80c40b0 0x7f85a80c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:37.191 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.194+0000 7f85a77fe700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8590005210 0x7f85a81f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:37.191 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f85a7fff700 1 -- 172.21.15.84:0/20163577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8590005210 msgr2=0x7f85a81f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:37.191 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f85a7fff700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8590005210 0x7f85a81f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:37.192 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f85a7fff700 1 -- 172.21.15.84:0/20163577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a80c40b0 msgr2=0x7f85a80c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:37.192 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f85a7fff700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a80c40b0 0x7f85a80c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:37.192 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f85a7fff700 1 -- 172.21.15.84:0/20163577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80c2000 con 0x7f85a8155740 2023-08-31T01:59:37.192 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f85a7fff700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a8155740 0x7f85a806a160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85a80ad9d0 tx=0x7f85a0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:37.192 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f858ffff700 1 -- 172.21.15.84:0/20163577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0003e10 con 0x7f85a8155740 2023-08-31T01:59:37.193 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f858ffff700 1 -- 172.21.15.84:0/20163577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f85a000eeb0 con 0x7f85a8155740 2023-08-31T01:59:37.193 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a80c22e0 con 0x7f85a8155740 2023-08-31T01:59:37.193 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f858ffff700 1 -- 172.21.15.84:0/20163577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a001b7b0 con 0x7f85a8155740 2023-08-31T01:59:37.193 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a80c28a0 con 0x7f85a8155740 2023-08-31T01:59:37.193 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f858ffff700 1 -- 172.21.15.84:0/20163577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f85a001bc10 con 0x7f85a8155740 2023-08-31T01:59:37.194 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.195+0000 7f858ffff700 1 -- 172.21.15.84:0/20163577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f85a0007c80 con 0x7f85a8155740 2023-08-31T01:59:37.194 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.196+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a80c2a30 con 0x7f85a8155740 2023-08-31T01:59:37.194 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.199+0000 7f858ffff700 1 -- 172.21.15.84:0/20163577 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f85a002a060 con 0x7f85a8155740 2023-08-31T01:59:37.273 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.281+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85a80b0a80 con 0x7f85a8155740 2023-08-31T01:59:37.274 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.282+0000 7f858ffff700 1 -- 172.21.15.84:0/20163577 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f85a0009de0 con 0x7f85a8155740 2023-08-31T01:59:37.275 INFO:teuthology.misc.health.smithi084.stdout: 2023-08-31T01:59:37.275 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T01:59:35.976173+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T01:59:37.277 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.282+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a8155740 msgr2=0x7f85a806a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:37.278 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.282+0000 7f85add01700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a8155740 0x7f85a806a160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85a80ad9d0 tx=0x7f85a0009300 comp rx=0 tx=0).stop 2023-08-31T01:59:37.278 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.283+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 shutdown_connections 2023-08-31T01:59:37.278 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.283+0000 7f85add01700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a8155740 0x7f85a806a160 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:37.278 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.283+0000 7f85add01700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8590005210 0x7f85a81f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:37.279 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.283+0000 7f85add01700 1 --2- 172.21.15.84:0/20163577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a80c40b0 0x7f85a80c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:37.279 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.283+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 >> 172.21.15.84:0/20163577 conn(0x7f85a80caa20 msgr2=0x7f85a80c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:37.279 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.283+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 shutdown_connections 2023-08-31T01:59:37.279 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:37.283+0000 7f85add01700 1 -- 172.21.15.84:0/20163577 wait complete. 2023-08-31T01:59:37.286 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-31T01:59:37.313 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:37.321+0000 7f7447797200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T01:59:37.329 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:37.337+0000 7f772777d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T01:59:37.446 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:37.454+0000 7f7447797200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T01:59:37.548 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:37.556+0000 7f772777d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T01:59:37.663 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:37.671+0000 7f7447797200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T01:59:37.703 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:37.711+0000 7f772777d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T01:59:37.819 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:37.827+0000 7f772777d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T01:59:37.820 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:37.828+0000 7f7447797200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T01:59:37.935 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:37.943+0000 7f7447797200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T01:59:38.139 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:38.146+0000 7f772777d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T01:59:38.238 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:38.245+0000 7f772777d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T01:59:38.261 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:38.269+0000 7f7447797200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T01:59:38.360 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:38.368+0000 7f7447797200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T01:59:38.424 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:38.431+0000 7f772777d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T01:59:38.546 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:38.554+0000 7f7447797200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T01:59:39.019 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:39.027+0000 7f772777d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T01:59:39.152 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-08-31T01:59:39.160+0000 7f7447797200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T01:59:39.909 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-08-31T01:59:39.917+0000 7fbfa65cf640 -1 osd.2 0 log_to_monitors true 2023-08-31T01:59:39.926 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-08-31T01:59:39.933+0000 7efce7042640 -1 osd.3 0 log_to_monitors true 2023-08-31T01:59:40.043 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:40.050+0000 7f76df7b1700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-31T01:59:40.043 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-08-31T01:59:40.050+0000 7f76df7b1700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-31T01:59:40.112 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-08-31T01:59:40.120+0000 7f011d3bf640 -1 osd.5 0 log_to_monitors true 2023-08-31T01:59:40.123 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-08-31T01:59:40.131+0000 7f174d3bc640 -1 osd.4 0 log_to_monitors true 2023-08-31T01:59:40.124 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-08-31T01:59:40.131+0000 7eff36ae8640 -1 osd.7 0 log_to_monitors true 2023-08-31T01:59:40.151 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-08-31T01:59:40.159+0000 7f39c33f2640 -1 osd.6 0 log_to_monitors true 2023-08-31T01:59:40.178 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-08-31T01:59:40.185+0000 7f7be91b9640 -1 osd.1 0 log_to_monitors true 2023-08-31T01:59:40.190 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-08-31T01:59:40.198+0000 7f23e17a2640 -1 osd.0 0 log_to_monitors true 2023-08-31T01:59:41.707 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-08-31T01:59:41.715+0000 7f0111777700 -1 osd.5 0 waiting for initial osdmap 2023-08-31T01:59:41.717 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-08-31T01:59:41.725+0000 7f0109351700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T01:59:42.464 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-08-31T01:59:42.471+0000 7efcdb3fa700 -1 osd.3 0 waiting for initial osdmap 2023-08-31T01:59:42.465 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-08-31T01:59:42.472+0000 7fbf9a987700 -1 osd.2 0 waiting for initial osdmap 2023-08-31T01:59:42.497 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-08-31T01:59:42.505+0000 7fbf92561700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T01:59:42.499 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-08-31T01:59:42.507+0000 7efcd2fd4700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T01:59:43.184 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-08-31T01:59:43.192+0000 7eff2aea0700 -1 osd.7 0 waiting for initial osdmap 2023-08-31T01:59:43.200 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-08-31T01:59:43.208+0000 7f39b77aa700 -1 osd.6 0 waiting for initial osdmap 2023-08-31T01:59:43.204 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-08-31T01:59:43.212+0000 7eff22a7a700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T01:59:43.213 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-08-31T01:59:43.221+0000 7f39af384700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T01:59:43.213 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-08-31T01:59:43.221+0000 7f1741774700 -1 osd.4 0 waiting for initial osdmap 2023-08-31T01:59:43.227 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-08-31T01:59:43.235+0000 7f173934e700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T01:59:43.388 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-08-31T01:59:43.394+0000 7f23d5b5a700 -1 osd.0 0 waiting for initial osdmap 2023-08-31T01:59:43.398 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-08-31T01:59:43.406+0000 7f23cd734700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T01:59:43.484 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-08-31T01:59:43.491+0000 7f7bdd571700 -1 osd.1 0 waiting for initial osdmap 2023-08-31T01:59:43.502 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-08-31T01:59:43.510+0000 7f7bd514b700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T01:59:44.094 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T01:59:44.219 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.225+0000 7f0fc33e5700 1 -- 172.21.15.84:0/1390193292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc0caea0 msgr2=0x7f0fbc0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:44.220 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.225+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/1390193292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0cb350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009f60 tx=0x7f0fb4009f90 comp rx=0 tx=0).stop 2023-08-31T01:59:44.220 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.225+0000 7f0fc33e5700 1 -- 172.21.15.84:0/1390193292 shutdown_connections 2023-08-31T01:59:44.221 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.225+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/1390193292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0cb350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.221 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.225+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/1390193292 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0fbc06c930 0x7f0fbc158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.221 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.225+0000 7f0fc33e5700 1 -- 172.21.15.84:0/1390193292 >> 172.21.15.84:0/1390193292 conn(0x7f0fbc0699a0 msgr2=0x7f0fbc069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:44.222 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.225+0000 7f0fc33e5700 1 -- 172.21.15.84:0/1390193292 shutdown_connections 2023-08-31T01:59:44.222 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.225+0000 7f0fc33e5700 1 -- 172.21.15.84:0/1390193292 wait complete. 2023-08-31T01:59:44.223 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc33e5700 1 Processor -- start 2023-08-31T01:59:44.223 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc33e5700 1 -- start start 2023-08-31T01:59:44.227 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc33e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc06c930 0x7f0fbc1efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:44.227 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc33e5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fbc0b2b60 0x7f0fbc0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:44.228 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc33e5700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0fbc0caea0 0x7f0fbc15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:44.228 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc33e5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc1f32c0 con 0x7f0fbc06c930 2023-08-31T01:59:44.229 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc33e5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc1f0180 con 0x7f0fbc0b2b60 2023-08-31T01:59:44.229 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc33e5700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc1f0460 con 0x7f0fbc0caea0 2023-08-31T01:59:44.229 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc1181700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc06c930 0x7f0fbc1efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:44.229 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc1181700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc06c930 0x7f0fbc1efb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50472/0 (socket says 172.21.15.84:50472) 2023-08-31T01:59:44.230 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.227+0000 7f0fc1181700 1 -- 172.21.15.84:0/3040078534 learned_addr learned my addr 172.21.15.84:0/3040078534 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:44.230 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc1982700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0fbc0caea0 0x7f0fbc15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:44.230 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc0980700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fbc0b2b60 0x7f0fbc0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:44.230 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc1181700 1 -- 172.21.15.84:0/3040078534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0fbc0caea0 msgr2=0x7f0fbc15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:44.231 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc1181700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0fbc0caea0 0x7f0fbc15cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.231 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc1181700 1 -- 172.21.15.84:0/3040078534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fbc0b2b60 msgr2=0x7f0fbc0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:44.231 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc1181700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fbc0b2b60 0x7f0fbc0b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.231 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc1181700 1 -- 172.21.15.84:0/3040078534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009c40 con 0x7f0fbc06c930 2023-08-31T01:59:44.232 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc1181700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc06c930 0x7f0fbc1efb50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00c500 tx=0x7f0fac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:44.232 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fb1ffb700 1 -- 172.21.15.84:0/3040078534 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac011790 con 0x7f0fbc06c930 2023-08-31T01:59:44.232 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fb1ffb700 1 -- 172.21.15.84:0/3040078534 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0fac0119e0 con 0x7f0fbc06c930 2023-08-31T01:59:44.232 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fb1ffb700 1 -- 172.21.15.84:0/3040078534 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac011dd0 con 0x7f0fbc06c930 2023-08-31T01:59:44.232 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc1f0740 con 0x7f0fbc06c930 2023-08-31T01:59:44.233 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.228+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc0ad0c0 con 0x7f0fbc06c930 2023-08-31T01:59:44.233 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.229+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc04e7c0 con 0x7f0fbc06c930 2023-08-31T01:59:44.233 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.229+0000 7f0fb1ffb700 1 -- 172.21.15.84:0/3040078534 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f0fac01c460 con 0x7f0fbc06c930 2023-08-31T01:59:44.233 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.230+0000 7f0fb1ffb700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fa006a050 0x7f0fa006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:44.233 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.230+0000 7f0fb1ffb700 1 -- 172.21.15.84:0/3040078534 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4191+0+0 (secure 0 0 0) 0x7f0fac087b40 con 0x7f0fbc06c930 2023-08-31T01:59:44.234 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.230+0000 7f0fc0980700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fa006a050 0x7f0fa006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:44.234 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.230+0000 7f0fc0980700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fa006a050 0x7f0fa006c510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005950 tx=0x7f0fb80058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:44.234 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.234+0000 7f0fb1ffb700 1 -- 172.21.15.84:0/3040078534 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0fac053a80 con 0x7f0fbc06c930 2023-08-31T01:59:44.416 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.423+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fbc0b2f40 con 0x7f0fbc06c930 2023-08-31T01:59:44.417 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.424+0000 7f0fb1ffb700 1 -- 172.21.15.84:0/3040078534 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10445 (secure 0 0 0) 0x7f0fbc0b2f40 con 0x7f0fbc06c930 2023-08-31T01:59:44.417 INFO:teuthology.misc.health.smithi084.stdout: 2023-08-31T01:59:44.418 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":14,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T01:59:43.490303+0000","last_up_change":"2023-08-31T01:59:43.490303+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T01:59:44.419 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fa006a050 msgr2=0x7f0fa006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:44.419 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fa006a050 0x7f0fa006c510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005950 tx=0x7f0fb80058e0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.420 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc06c930 msgr2=0x7f0fbc1efb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:44.420 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc06c930 0x7f0fbc1efb50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00c500 tx=0x7f0fac00c8c0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.420 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 shutdown_connections 2023-08-31T01:59:44.420 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fa006a050 0x7f0fa006c510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.420 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0fbc0caea0 0x7f0fbc15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.421 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fbc06c930 0x7f0fbc1efb50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.421 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 --2- 172.21.15.84:0/3040078534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fbc0b2b60 0x7f0fbc0b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:44.421 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 >> 172.21.15.84:0/3040078534 conn(0x7f0fbc0699a0 msgr2=0x7f0fbc0ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:44.421 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 shutdown_connections 2023-08-31T01:59:44.421 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:44.426+0000 7f0fc33e5700 1 -- 172.21.15.84:0/3040078534 wait complete. 2023-08-31T01:59:44.430 DEBUG:teuthology.misc:7 of 8 OSDs are up 2023-08-31T01:59:51.237 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T01:59:51.363 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.370+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/2754520904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 msgr2=0x7f0cb0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.364 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.370+0000 7f0ccc2d2700 1 --2- 172.21.15.84:0/2754520904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 0x7f0cb0004cd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009bb0 tx=0x7f0cb0005880 comp rx=0 tx=0).stop 2023-08-31T01:59:51.364 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.370+0000 7f0cca86f700 1 -- 172.21.15.84:0/2754520904 reap_dead start 2023-08-31T01:59:51.364 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.370+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/2754520904 shutdown_connections 2023-08-31T01:59:51.364 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.370+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/2754520904 >> 172.21.15.84:0/2754520904 conn(0x7f0cc40caa20 msgr2=0x7f0cc40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:51.365 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.370+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/2754520904 shutdown_connections 2023-08-31T01:59:51.365 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.370+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/2754520904 wait complete. 2023-08-31T01:59:51.367 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.372+0000 7f0ccc2d2700 1 Processor -- start 2023-08-31T01:59:51.367 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.372+0000 7f0ccc2d2700 1 -- start start 2023-08-31T01:59:51.367 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.372+0000 7f0ccc2d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 0x7f0cc41ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:51.367 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.372+0000 7f0ccc2d2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc4155970 0x7f0cc414fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:51.368 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.372+0000 7f0ccc2d2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc41f1360 0x7f0cc40b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:51.368 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.372+0000 7f0ccc2d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40c5120 con 0x7f0cb0004850 2023-08-31T01:59:51.368 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.372+0000 7f0ccc2d2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4152370 con 0x7f0cc41f1360 2023-08-31T01:59:51.368 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.372+0000 7f0ccc2d2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4150260 con 0x7f0cc4155970 2023-08-31T01:59:51.368 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 0x7f0cc41ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:51.369 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 0x7f0cc41ee5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50626/0 (socket says 172.21.15.84:50626) 2023-08-31T01:59:51.369 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 -- 172.21.15.84:0/1917827931 learned_addr learned my addr 172.21.15.84:0/1917827931 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:51.369 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 -- 172.21.15.84:0/1917827931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc4155970 msgr2=0x7f0cc414fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.369 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc4155970 0x7f0cc414fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.369 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 -- 172.21.15.84:0/1917827931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc41f1360 msgr2=0x7f0cc40b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.370 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca86f700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc41f1360 0x7f0cc40b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:51.370 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc41f1360 0x7f0cc40b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.370 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 -- 172.21.15.84:0/1917827931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc41542f0 con 0x7f0cb0004850 2023-08-31T01:59:51.370 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cca06e700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 0x7f0cc41ee5f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4004f90 tx=0x7f0cb40015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:51.370 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cbaffd700 1 -- 172.21.15.84:0/1917827931 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4011660 con 0x7f0cb0004850 2023-08-31T01:59:51.371 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cbaffd700 1 -- 172.21.15.84:0/1917827931 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0cb40118b0 con 0x7f0cb0004850 2023-08-31T01:59:51.371 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0cbaffd700 1 -- 172.21.15.84:0/1917827931 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4011c80 con 0x7f0cb0004850 2023-08-31T01:59:51.371 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc4150490 con 0x7f0cb0004850 2023-08-31T01:59:51.371 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.373+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc4150a50 con 0x7f0cb0004850 2023-08-31T01:59:51.371 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.374+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc404e7c0 con 0x7f0cb0004850 2023-08-31T01:59:51.372 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.375+0000 7f0cbaffd700 1 -- 172.21.15.84:0/1917827931 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0cb4024440 con 0x7f0cb0004850 2023-08-31T01:59:51.373 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.375+0000 7f0cbaffd700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ca806a0e0 0x7f0ca806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:51.373 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.375+0000 7f0cbaffd700 1 -- 172.21.15.84:0/1917827931 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0cb4089530 con 0x7f0cb0004850 2023-08-31T01:59:51.373 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.375+0000 7f0cc986d700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ca806a0e0 0x7f0ca806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:51.373 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.376+0000 7f0cc986d700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ca806a0e0 0x7f0ca806c5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40ccf50 tx=0x7f0cc00047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:51.373 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.379+0000 7f0cbaffd700 1 -- 172.21.15.84:0/1917827931 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0cb4055140 con 0x7f0cb0004850 2023-08-31T01:59:51.564 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.571+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cc4158740 con 0x7f0cb0004850 2023-08-31T01:59:51.565 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.572+0000 7f0cbaffd700 1 -- 172.21.15.84:0/1917827931 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f0cb4058760 con 0x7f0cb0004850 2023-08-31T01:59:51.565 INFO:teuthology.misc.health.smithi084.stdout: 2023-08-31T01:59:51.565 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":18,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T01:59:47.512086+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T01:59:51.567 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ca806a0e0 msgr2=0x7f0ca806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.567 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ca806a0e0 0x7f0ca806c5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40ccf50 tx=0x7f0cc00047c0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.567 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 msgr2=0x7f0cc41ee5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.568 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 0x7f0cc41ee5f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4004f90 tx=0x7f0cb40015f0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.568 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 shutdown_connections 2023-08-31T01:59:51.568 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ca806a0e0 0x7f0ca806c5a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.568 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc41f1360 0x7f0cc40b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.568 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cb0004850 0x7f0cc41ee5f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.569 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 --2- 172.21.15.84:0/1917827931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc4155970 0x7f0cc414fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.569 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 >> 172.21.15.84:0/1917827931 conn(0x7f0cc40caa20 msgr2=0x7f0cc40c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:51.569 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 shutdown_connections 2023-08-31T01:59:51.569 INFO:teuthology.misc.health.smithi084.stderr:2023-08-31T01:59:51.574+0000 7f0ccc2d2700 1 -- 172.21.15.84:0/1917827931 wait complete. 2023-08-31T01:59:51.578 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-31T01:59:51.578 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-31T01:59:51.579 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T01:59:51.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T01:59:51.581 INFO:tasks.ceph.mds.a:Started 2023-08-31T01:59:51.582 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T01:59:51.582 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T01:59:51.584 INFO:tasks.ceph.mds.c:Started 2023-08-31T01:59:51.585 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T01:59:51.585 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T01:59:51.592 INFO:tasks.ceph.mds.b:Started 2023-08-31T01:59:51.592 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T01:59:51.593 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T01:59:51.595 INFO:tasks.ceph.mds.d:Started 2023-08-31T01:59:51.595 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-31T01:59:51.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T01:59:51.660 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-08-31T01:59:51.662 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-08-31T01:59:51.682 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2023-08-31T01:59:51.683 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2023-08-31T01:59:51.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.733+0000 7fe3c8db3700 1 -- 172.21.15.84:0/2350202856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 msgr2=0x7fe3c40af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.733+0000 7fe3c8db3700 1 --2- 172.21.15.84:0/2350202856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 0x7fe3c40af7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40098b0 tx=0x7fe3b4009bc0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.733+0000 7fe3c8db3700 1 -- 172.21.15.84:0/2350202856 shutdown_connections 2023-08-31T01:59:51.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.733+0000 7fe3c8db3700 1 --2- 172.21.15.84:0/2350202856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 0x7fe3c40af7f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.733+0000 7fe3c8db3700 1 -- 172.21.15.84:0/2350202856 >> 172.21.15.84:0/2350202856 conn(0x7fe3c40699a0 msgr2=0x7fe3c4069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:51.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.733+0000 7fe3c8db3700 1 -- 172.21.15.84:0/2350202856 shutdown_connections 2023-08-31T01:59:51.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.733+0000 7fe3c8db3700 1 -- 172.21.15.84:0/2350202856 wait complete. 2023-08-31T01:59:51.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.734+0000 7fe3c8db3700 1 Processor -- start 2023-08-31T01:59:51.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.734+0000 7fe3c8db3700 1 -- start start 2023-08-31T01:59:51.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c8db3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3c40b09b0 0x7fe3c40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c8db3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 0x7fe3c40ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c8db3700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3c41591f0 0x7fe3c406db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c8db3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4150b00 con 0x7fe3c40c9780 2023-08-31T01:59:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c8db3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c414fe80 con 0x7fe3c40b09b0 2023-08-31T01:59:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c8db3700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4150160 con 0x7fe3c41591f0 2023-08-31T01:59:51.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 0x7fe3c40ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:51.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 0x7fe3c40ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50672/0 (socket says 172.21.15.84:50672) 2023-08-31T01:59:51.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 -- 172.21.15.84:0/4074823273 learned_addr learned my addr 172.21.15.84:0/4074823273 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:51.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c259c700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3c40b09b0 0x7fe3c40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:51.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c2d9d700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3c41591f0 0x7fe3c406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:51.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 -- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3c41591f0 msgr2=0x7fe3c406db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3c41591f0 0x7fe3c406db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 -- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3c40b09b0 msgr2=0x7fe3c40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3c40b09b0 0x7fe3c40cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 -- 172.21.15.84:0/4074823273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40094c0 con 0x7fe3c40c9780 2023-08-31T01:59:51.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c2d9d700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3c41591f0 0x7fe3c406db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T01:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c1d9b700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 0x7fe3c40ce230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400b5e0 tx=0x7fe3b4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3b2ffd700 1 -- 172.21.15.84:0/4074823273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b401e070 con 0x7fe3c40c9780 2023-08-31T01:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3b2ffd700 1 -- 172.21.15.84:0/4074823273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe3b400b820 con 0x7fe3c40c9780 2023-08-31T01:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c4150440 con 0x7fe3c40c9780 2023-08-31T01:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.735+0000 7fe3b2ffd700 1 -- 172.21.15.84:0/4074823273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400bc30 con 0x7fe3c40c9780 2023-08-31T01:59:51.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.736+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c406e070 con 0x7fe3c40c9780 2023-08-31T01:59:51.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.736+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c4150c40 con 0x7fe3c40c9780 2023-08-31T01:59:51.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.737+0000 7fe3b2ffd700 1 -- 172.21.15.84:0/4074823273 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe3b400bd90 con 0x7fe3c40c9780 2023-08-31T01:59:51.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.737+0000 7fe3b2ffd700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3a406a0e0 0x7fe3a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:51.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.737+0000 7fe3b2ffd700 1 -- 172.21.15.84:0/4074823273 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe3b4089950 con 0x7fe3c40c9780 2023-08-31T01:59:51.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.737+0000 7fe3c259c700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3a406a0e0 0x7fe3a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:51.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.737+0000 7fe3c259c700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3a406a0e0 0x7fe3a406c5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4152d70 tx=0x7fe3b8009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:51.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.741+0000 7fe3b2ffd700 1 -- 172.21.15.84:0/4074823273 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe3c4150c40 con 0x7fe3c40c9780 2023-08-31T01:59:51.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.931+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3c4150c40 con 0x7fe3c40c9780 2023-08-31T01:59:51.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.932+0000 7fe3b2ffd700 1 -- 172.21.15.84:0/4074823273 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fe3c4150c40 con 0x7fe3c40c9780 2023-08-31T01:59:51.925 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:59:51.926 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T01:59:47.512086+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T01:59:51.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3a406a0e0 msgr2=0x7fe3a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3a406a0e0 0x7fe3a406c5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4152d70 tx=0x7fe3b8009040 comp rx=0 tx=0).stop 2023-08-31T01:59:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 msgr2=0x7fe3c40ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 0x7fe3c40ce230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400b5e0 tx=0x7fe3b4005040 comp rx=0 tx=0).stop 2023-08-31T01:59:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 shutdown_connections 2023-08-31T01:59:51.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3a406a0e0 0x7fe3a406c5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3c41591f0 0x7fe3c406db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3c40b09b0 0x7fe3c40cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 --2- 172.21.15.84:0/4074823273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c40c9780 0x7fe3c40ce230 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.934+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 >> 172.21.15.84:0/4074823273 conn(0x7fe3c40699a0 msgr2=0x7fe3c415b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.935+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 shutdown_connections 2023-08-31T01:59:51.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:51.935+0000 7fe3c8db3700 1 -- 172.21.15.84:0/4074823273 wait complete. 2023-08-31T01:59:51.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T01:59:51.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T01:59:52.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.072+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3810857535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0ca2d0 msgr2=0x7f4b4c0cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.072+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3810857535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0ca2d0 0x7f4b4c0cbad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009f60 tx=0x7f4b44009f90 comp rx=0 tx=0).stop 2023-08-31T01:59:52.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.072+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3810857535 shutdown_connections 2023-08-31T01:59:52.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.072+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3810857535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0ca2d0 0x7f4b4c0cbad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.072+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3810857535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b4c15b790 0x7f4b4c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.072+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3810857535 >> 172.21.15.84:0/3810857535 conn(0x7f4b4c0afb00 msgr2=0x7f4b4c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:52.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.072+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3810857535 shutdown_connections 2023-08-31T01:59:52.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.072+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3810857535 wait complete. 2023-08-31T01:59:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.073+0000 7f4b51ce9700 1 Processor -- start 2023-08-31T01:59:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b51ce9700 1 -- start start 2023-08-31T01:59:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b51ce9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b4c0ca2d0 0x7f4b4c0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b51ce9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c15b790 0x7f4b4c147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b51ce9700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b4c15bce0 0x7f4b4c0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b51ce9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c147a90 con 0x7f4b4c15b790 2023-08-31T01:59:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b51ce9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c2ad0 con 0x7f4b4c0ca2d0 2023-08-31T01:59:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b51ce9700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c2db0 con 0x7f4b4c15bce0 2023-08-31T01:59:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b4affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c15b790 0x7f4b4c147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b4affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c15b790 0x7f4b4c147550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50686/0 (socket says 172.21.15.84:50686) 2023-08-31T01:59:52.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b4affd700 1 -- 172.21.15.84:0/3185491268 learned_addr learned my addr 172.21.15.84:0/3185491268 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:52.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b4bfff700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b4c15bce0 0x7f4b4c0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:52.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.074+0000 7f4b4b7fe700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b4c0ca2d0 0x7f4b4c0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:52.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b4affd700 1 -- 172.21.15.84:0/3185491268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b4c15bce0 msgr2=0x7f4b4c0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b4affd700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b4c15bce0 0x7f4b4c0b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b4affd700 1 -- 172.21.15.84:0/3185491268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b4c0ca2d0 msgr2=0x7f4b4c0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b4affd700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b4c0ca2d0 0x7f4b4c0c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b4affd700 1 -- 172.21.15.84:0/3185491268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009c40 con 0x7f4b4c15b790 2023-08-31T01:59:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b4affd700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c15b790 0x7f4b4c147550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00c4d0 tx=0x7f4b3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b33fff700 1 -- 172.21.15.84:0/3185491268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c005230 con 0x7f4b4c15b790 2023-08-31T01:59:52.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b33fff700 1 -- 172.21.15.84:0/3185491268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4b3c005480 con 0x7f4b4c15b790 2023-08-31T01:59:52.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c0c3090 con 0x7f4b4c15b790 2023-08-31T01:59:52.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b33fff700 1 -- 172.21.15.84:0/3185491268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c004990 con 0x7f4b4c15b790 2023-08-31T01:59:52.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.075+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c0c3650 con 0x7f4b4c15b790 2023-08-31T01:59:52.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.076+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c0c3870 con 0x7f4b4c15b790 2023-08-31T01:59:52.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.076+0000 7f4b33fff700 1 -- 172.21.15.84:0/3185491268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b3c004af0 con 0x7f4b4c15b790 2023-08-31T01:59:52.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.077+0000 7f4b33fff700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b3806a0e0 0x7f4b3806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:52.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.077+0000 7f4b4b7fe700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b3806a0e0 0x7f4b3806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:52.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.077+0000 7f4b33fff700 1 -- 172.21.15.84:0/3185491268 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b3c0877b0 con 0x7f4b4c15b790 2023-08-31T01:59:52.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.077+0000 7f4b4b7fe700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b3806a0e0 0x7f4b3806c5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b40005950 tx=0x7f4b400058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:52.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.081+0000 7f4b33fff700 1 -- 172.21.15.84:0/3185491268 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b3c0532e0 con 0x7f4b4c15b790 2023-08-31T01:59:52.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.271+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b4c04e7c0 con 0x7f4b4c15b790 2023-08-31T01:59:52.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.271+0000 7f4b33fff700 1 -- 172.21.15.84:0/3185491268 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b3c056900 con 0x7f4b4c15b790 2023-08-31T01:59:52.264 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T01:59:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b3806a0e0 msgr2=0x7f4b3806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b3806a0e0 0x7f4b3806c5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b40005950 tx=0x7f4b400058e0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c15b790 msgr2=0x7f4b4c147550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c15b790 0x7f4b4c147550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00c4d0 tx=0x7f4b3c00c890 comp rx=0 tx=0).stop 2023-08-31T01:59:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 shutdown_connections 2023-08-31T01:59:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b3806a0e0 0x7f4b3806c5a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b4c15bce0 0x7f4b4c0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b4c0ca2d0 0x7f4b4c0c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 --2- 172.21.15.84:0/3185491268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c15b790 0x7f4b4c147550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 >> 172.21.15.84:0/3185491268 conn(0x7f4b4c0afb00 msgr2=0x7f4b4c14cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 shutdown_connections 2023-08-31T01:59:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.273+0000 7f4b51ce9700 1 -- 172.21.15.84:0/3185491268 wait complete. 2023-08-31T01:59:52.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T01:59:52.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.407+0000 7f7d04c4d700 1 -- 172.21.15.84:0/4022476697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d000ca360 msgr2=0x7f7d000cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.407+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/4022476697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d000ca360 0x7f7d000cbea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d000716f0 tx=0x7f7cf800b380 comp rx=0 tx=0).stop 2023-08-31T01:59:52.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.407+0000 7f7d04c4d700 1 -- 172.21.15.84:0/4022476697 shutdown_connections 2023-08-31T01:59:52.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.407+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/4022476697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d000ca360 0x7f7d000cbea0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.407+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/4022476697 >> v2:172.21.15.170:3300/0 conn(0x7f7d0015b6a0 0x7f7d000707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.407+0000 7f7d04c4d700 1 -- 172.21.15.84:0/4022476697 >> 172.21.15.84:0/4022476697 conn(0x7f7d000caa20 msgr2=0x7f7d000cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:52.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.407+0000 7f7d04c4d700 1 -- 172.21.15.84:0/4022476697 shutdown_connections 2023-08-31T01:59:52.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.407+0000 7f7d04c4d700 1 -- 172.21.15.84:0/4022476697 wait complete. 2023-08-31T01:59:52.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.408+0000 7f7d04c4d700 1 Processor -- start 2023-08-31T01:59:52.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.408+0000 7f7d04c4d700 1 -- start start 2023-08-31T01:59:52.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7d04c4d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d00070d00 0x7f7d00156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:52.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7d04c4d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d000ca360 0x7f7d00159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:52.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7d04c4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d0015b6a0 0x7f7d0015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:52.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7d04c4d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00157410 con 0x7f7d0015b6a0 2023-08-31T01:59:52.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7d04c4d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000c6ac0 con 0x7f7d00070d00 2023-08-31T01:59:52.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7d04c4d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000c6da0 con 0x7f7d000ca360 2023-08-31T01:59:52.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7cfed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d0015b6a0 0x7f7d0015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:52.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7cfed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d0015b6a0 0x7f7d0015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50702/0 (socket says 172.21.15.84:50702) 2023-08-31T01:59:52.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7cfed9d700 1 -- 172.21.15.84:0/841560370 learned_addr learned my addr 172.21.15.84:0/841560370 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:52.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7cfdd9b700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d000ca360 0x7f7d00159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:52.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7cfe59c700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d00070d00 0x7f7d00156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:52.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7cfed9d700 1 -- 172.21.15.84:0/841560370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d000ca360 msgr2=0x7f7d00159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.409+0000 7f7cfed9d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d000ca360 0x7f7d00159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7cfed9d700 1 -- 172.21.15.84:0/841560370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d00070d00 msgr2=0x7f7d00156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7cfed9d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d00070d00 0x7f7d00156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7cfed9d700 1 -- 172.21.15.84:0/841560370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf8009d00 con 0x7f7d0015b6a0 2023-08-31T01:59:52.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7cfed9d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d0015b6a0 0x7f7d0015a1c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d000cb8b0 tx=0x7f7cf80097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:52.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7ceeffd700 1 -- 172.21.15.84:0/841560370 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800e040 con 0x7f7d0015b6a0 2023-08-31T01:59:52.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7ceeffd700 1 -- 172.21.15.84:0/841560370 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7cf801d680 con 0x7f7d0015b6a0 2023-08-31T01:59:52.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d000c7080 con 0x7f7d0015b6a0 2023-08-31T01:59:52.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7ceeffd700 1 -- 172.21.15.84:0/841560370 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf801dad0 con 0x7f7d0015b6a0 2023-08-31T01:59:52.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.410+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d000c76d0 con 0x7f7d0015b6a0 2023-08-31T01:59:52.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.411+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d000c5070 con 0x7f7d0015b6a0 2023-08-31T01:59:52.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.411+0000 7f7ceeffd700 1 -- 172.21.15.84:0/841560370 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7cf801dc30 con 0x7f7d0015b6a0 2023-08-31T01:59:52.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.412+0000 7f7ceeffd700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ce006a0e0 0x7f7ce006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:52.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.412+0000 7f7ceeffd700 1 -- 172.21.15.84:0/841560370 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7cf808a1c0 con 0x7f7d0015b6a0 2023-08-31T01:59:52.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.412+0000 7f7cfe59c700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ce006a0e0 0x7f7ce006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:52.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.412+0000 7f7cfe59c700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ce006a0e0 0x7f7ce006c5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0005e10 tx=0x7f7cf000b390 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:52.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.416+0000 7f7ceeffd700 1 -- 172.21.15.84:0/841560370 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7d000c5070 con 0x7f7d0015b6a0 2023-08-31T01:59:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.649+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d000c5070 con 0x7f7d0015b6a0 2023-08-31T01:59:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.649+0000 7f7ceeffd700 1 -- 172.21.15.84:0/841560370 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f7d000c5070 con 0x7f7d0015b6a0 2023-08-31T01:59:52.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:59:52.645 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-08-31T01:59:52.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ce006a0e0 msgr2=0x7f7ce006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ce006a0e0 0x7f7ce006c5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0005e10 tx=0x7f7cf000b390 comp rx=0 tx=0).stop 2023-08-31T01:59:52.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d0015b6a0 msgr2=0x7f7d0015a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:52.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d0015b6a0 0x7f7d0015a1c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d000cb8b0 tx=0x7f7cf80097c0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 shutdown_connections 2023-08-31T01:59:52.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ce006a0e0 0x7f7ce006c5a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d0015b6a0 0x7f7d0015a1c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d00070d00 0x7f7d00156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 --2- 172.21.15.84:0/841560370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d000ca360 0x7f7d00159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 >> 172.21.15.84:0/841560370 conn(0x7f7d000caa20 msgr2=0x7f7d000ae2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.651+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 shutdown_connections 2023-08-31T01:59:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:52.652+0000 7f7d04c4d700 1 -- 172.21.15.84:0/841560370 wait complete. 2023-08-31T01:59:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2023-08-31T01:59:54.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T01:59:54.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.803+0000 7f639e24b700 1 -- 172.21.15.84:0/1106756553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6380003a00 msgr2=0x7f6380003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:54.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.803+0000 7f639e24b700 1 --2- 172.21.15.84:0/1106756553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6380003a00 0x7f6380003e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c310 tx=0x7f6380005880 comp rx=0 tx=0).stop 2023-08-31T01:59:54.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.803+0000 7f639e24b700 1 -- 172.21.15.84:0/1106756553 shutdown_connections 2023-08-31T01:59:54.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.803+0000 7f639e24b700 1 --2- 172.21.15.84:0/1106756553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6380003a00 0x7f6380003e20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:54.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.803+0000 7f639e24b700 1 -- 172.21.15.84:0/1106756553 >> 172.21.15.84:0/1106756553 conn(0x7f63980caa20 msgr2=0x7f63980cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:54.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.803+0000 7f639e24b700 1 -- 172.21.15.84:0/1106756553 shutdown_connections 2023-08-31T01:59:54.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.803+0000 7f639e24b700 1 -- 172.21.15.84:0/1106756553 wait complete. 2023-08-31T01:59:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.804+0000 7f639e24b700 1 Processor -- start 2023-08-31T01:59:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.804+0000 7f639e24b700 1 -- start start 2023-08-31T01:59:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f639e24b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6380003a00 0x7f6398153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f639e24b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63981e3760 0x7f63981e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f639e24b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63980b1540 0x7f63980b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f639e24b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63981f1970 con 0x7f63981e3760 2023-08-31T01:59:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f639e24b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63981e4100 con 0x7f63980b1540 2023-08-31T01:59:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f639e24b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980b24f0 con 0x7f6380003a00 2023-08-31T01:59:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6396ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63981e3760 0x7f63981e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6396ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63981e3760 0x7f63981e3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50724/0 (socket says 172.21.15.84:50724) 2023-08-31T01:59:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6396ffd700 1 -- 172.21.15.84:0/2764664942 learned_addr learned my addr 172.21.15.84:0/2764664942 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:54.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f63977fe700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6380003a00 0x7f6398153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:54.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6397fff700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63980b1540 0x7f63980b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:54.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6396ffd700 1 -- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6380003a00 msgr2=0x7f6398153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:54.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6396ffd700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6380003a00 0x7f6398153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:54.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6396ffd700 1 -- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63980b1540 msgr2=0x7f63980b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:54.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6396ffd700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63980b1540 0x7f63980b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:54.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6396ffd700 1 -- 172.21.15.84:0/2764664942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63980b2210 con 0x7f63981e3760 2023-08-31T01:59:54.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.805+0000 7f6397fff700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63980b1540 0x7f63980b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T01:59:54.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.806+0000 7f6396ffd700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63981e3760 0x7f63981e3bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6388011990 tx=0x7f6388011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:54.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.806+0000 7f637ffff700 1 -- 172.21.15.84:0/2764664942 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388011ee0 con 0x7f63981e3760 2023-08-31T01:59:54.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.806+0000 7f637ffff700 1 -- 172.21.15.84:0/2764664942 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f638800fd50 con 0x7f63981e3760 2023-08-31T01:59:54.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.806+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63980ab600 con 0x7f63981e3760 2023-08-31T01:59:54.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.806+0000 7f637ffff700 1 -- 172.21.15.84:0/2764664942 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638800fee0 con 0x7f63981e3760 2023-08-31T01:59:54.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.806+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63980abbc0 con 0x7f63981e3760 2023-08-31T01:59:54.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.807+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63980abde0 con 0x7f63981e3760 2023-08-31T01:59:54.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.807+0000 7f637ffff700 1 -- 172.21.15.84:0/2764664942 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6388004280 con 0x7f63981e3760 2023-08-31T01:59:54.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.808+0000 7f637ffff700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f638406a0e0 0x7f638406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:54.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.808+0000 7f637ffff700 1 -- 172.21.15.84:0/2764664942 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6388088df0 con 0x7f63981e3760 2023-08-31T01:59:54.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.808+0000 7f63977fe700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f638406a0e0 0x7f638406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:54.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.808+0000 7f63977fe700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f638406a0e0 0x7f638406c5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f638c000c00 tx=0x7f638c00f000 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:54.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:54.812+0000 7f637ffff700 1 -- 172.21.15.84:0/2764664942 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6388054910 con 0x7f63981e3760 2023-08-31T01:59:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.049+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f639804e7c0 con 0x7f63981e3760 2023-08-31T01:59:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.049+0000 7f637ffff700 1 -- 172.21.15.84:0/2764664942 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f638801e090 con 0x7f63981e3760 2023-08-31T01:59:55.043 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:59:55.043 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-31T01:59:55.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f638406a0e0 msgr2=0x7f638406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f638406a0e0 0x7f638406c5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f638c000c00 tx=0x7f638c00f000 comp rx=0 tx=0).stop 2023-08-31T01:59:55.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63981e3760 msgr2=0x7f63981e3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63981e3760 0x7f63981e3bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6388011990 tx=0x7f6388011ca0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 shutdown_connections 2023-08-31T01:59:55.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f638406a0e0 0x7f638406c5a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63980b1540 0x7f63980b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6380003a00 0x7f6398153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 --2- 172.21.15.84:0/2764664942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63981e3760 0x7f63981e3bc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 >> 172.21.15.84:0/2764664942 conn(0x7f63980caa20 msgr2=0x7f63980b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:55.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 shutdown_connections 2023-08-31T01:59:55.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.052+0000 7f639e24b700 1 -- 172.21.15.84:0/2764664942 wait complete. 2023-08-31T01:59:55.048 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2023-08-31T01:59:55.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T01:59:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.189+0000 7fef17aea700 1 -- 172.21.15.84:0/1642782663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 msgr2=0x7fef100cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.189+0000 7fef17aea700 1 --2- 172.21.15.84:0/1642782663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 0x7fef100cc920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef00005fd0 tx=0x7fef00009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.189+0000 7fef17aea700 1 -- 172.21.15.84:0/1642782663 shutdown_connections 2023-08-31T01:59:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.189+0000 7fef17aea700 1 --2- 172.21.15.84:0/1642782663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 0x7fef100cc920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.189+0000 7fef17aea700 1 --2- 172.21.15.84:0/1642782663 >> v2:172.21.15.170:3300/0 conn(0x7fef100707c0 0x7fef10070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.189+0000 7fef17aea700 1 -- 172.21.15.84:0/1642782663 >> 172.21.15.84:0/1642782663 conn(0x7fef100caa20 msgr2=0x7fef100cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.189+0000 7fef17aea700 1 -- 172.21.15.84:0/1642782663 shutdown_connections 2023-08-31T01:59:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.189+0000 7fef17aea700 1 -- 172.21.15.84:0/1642782663 wait complete. 2023-08-31T01:59:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.190+0000 7fef17aea700 1 Processor -- start 2023-08-31T01:59:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.190+0000 7fef17aea700 1 -- start start 2023-08-31T01:59:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef17aea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef100707c0 0x7fef10144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef17aea700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef100b0df0 0x7fef101f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef17aea700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 0x7fef100c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef17aea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef100c4e90 con 0x7fef100707c0 2023-08-31T01:59:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef17aea700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef100c4310 con 0x7fef100b0df0 2023-08-31T01:59:55.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef17aea700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef100c45f0 con 0x7fef10158220 2023-08-31T01:59:55.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15886700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef100707c0 0x7fef10144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15886700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef100707c0 0x7fef10144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50736/0 (socket says 172.21.15.84:50736) 2023-08-31T01:59:55.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15886700 1 -- 172.21.15.84:0/1753369870 learned_addr learned my addr 172.21.15.84:0/1753369870 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:55.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef16087700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 0x7fef100c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15085700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef100b0df0 0x7fef101f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15886700 1 -- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 msgr2=0x7fef100c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15886700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 0x7fef100c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15886700 1 -- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef100b0df0 msgr2=0x7fef101f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15886700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef100b0df0 0x7fef101f0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef15886700 1 -- 172.21.15.84:0/1753369870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000095f0 con 0x7fef100707c0 2023-08-31T01:59:55.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.191+0000 7fef16087700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 0x7fef100c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T01:59:55.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.192+0000 7fef15886700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef100707c0 0x7fef10144150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef000098e0 tx=0x7fef00003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:55.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.192+0000 7fef067fc700 1 -- 172.21.15.84:0/1753369870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0001c070 con 0x7fef100707c0 2023-08-31T01:59:55.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.192+0000 7fef067fc700 1 -- 172.21.15.84:0/1753369870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef0000b820 con 0x7fef100707c0 2023-08-31T01:59:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.192+0000 7fef067fc700 1 -- 172.21.15.84:0/1753369870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000bc10 con 0x7fef100707c0 2023-08-31T01:59:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.192+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef100c48d0 con 0x7fef100707c0 2023-08-31T01:59:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.192+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef101f13e0 con 0x7fef100707c0 2023-08-31T01:59:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.193+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef10141560 con 0x7fef100707c0 2023-08-31T01:59:55.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.193+0000 7fef067fc700 1 -- 172.21.15.84:0/1753369870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef0000bd70 con 0x7fef100707c0 2023-08-31T01:59:55.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.193+0000 7fef067fc700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feef406a0e0 0x7feef406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.193+0000 7fef15085700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feef406a0e0 0x7feef406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.193+0000 7fef067fc700 1 -- 172.21.15.84:0/1753369870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fef000894e0 con 0x7fef100707c0 2023-08-31T01:59:55.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.194+0000 7fef15085700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feef406a0e0 0x7feef406c5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fef101f4ad0 tx=0x7fef0c009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:55.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.198+0000 7fef067fc700 1 -- 172.21.15.84:0/1753369870 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fef00055020 con 0x7fef100707c0 2023-08-31T01:59:55.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.387+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef1004e7c0 con 0x7fef100707c0 2023-08-31T01:59:55.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.388+0000 7fef067fc700 1 -- 172.21.15.84:0/1753369870 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fef00058640 con 0x7fef100707c0 2023-08-31T01:59:55.381 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:59:55.381 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T01:59:47.512086+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T01:59:55.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feef406a0e0 msgr2=0x7feef406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feef406a0e0 0x7feef406c5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fef101f4ad0 tx=0x7fef0c009040 comp rx=0 tx=0).stop 2023-08-31T01:59:55.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef100707c0 msgr2=0x7fef10144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef100707c0 0x7fef10144150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef000098e0 tx=0x7fef00003d50 comp rx=0 tx=0).stop 2023-08-31T01:59:55.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 shutdown_connections 2023-08-31T01:59:55.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feef406a0e0 0x7feef406c5a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef10158220 0x7fef100c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef100707c0 0x7fef10144150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 --2- 172.21.15.84:0/1753369870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef100b0df0 0x7fef101f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 >> 172.21.15.84:0/1753369870 conn(0x7fef100caa20 msgr2=0x7fef101591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:55.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 shutdown_connections 2023-08-31T01:59:55.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.390+0000 7fef17aea700 1 -- 172.21.15.84:0/1753369870 wait complete. 2023-08-31T01:59:55.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T01:59:55.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T01:59:55.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.527+0000 7fb05babd700 1 -- 172.21.15.84:0/2176183256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb05415bce0 msgr2=0x7fb0540c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.527+0000 7fb05babd700 1 --2- 172.21.15.84:0/2176183256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb05415bce0 0x7fb0540c9bc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0540b0ba0 tx=0x7fb050009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:55.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.527+0000 7fb05babd700 1 -- 172.21.15.84:0/2176183256 shutdown_connections 2023-08-31T01:59:55.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.527+0000 7fb05babd700 1 --2- 172.21.15.84:0/2176183256 >> v2:172.21.15.170:3300/0 conn(0x7fb0540ca100 0x7fb0540c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.527+0000 7fb05babd700 1 --2- 172.21.15.84:0/2176183256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb05415b790 0x7fb05406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.527+0000 7fb05babd700 1 --2- 172.21.15.84:0/2176183256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb05415bce0 0x7fb0540c9bc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.527+0000 7fb05babd700 1 -- 172.21.15.84:0/2176183256 >> 172.21.15.84:0/2176183256 conn(0x7fb0540afb00 msgr2=0x7fb0540aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:55.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.527+0000 7fb05babd700 1 -- 172.21.15.84:0/2176183256 shutdown_connections 2023-08-31T01:59:55.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.528+0000 7fb05babd700 1 -- 172.21.15.84:0/2176183256 wait complete. 2023-08-31T01:59:55.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.529+0000 7fb05babd700 1 Processor -- start 2023-08-31T01:59:55.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.529+0000 7fb05babd700 1 -- start start 2023-08-31T01:59:55.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb05babd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0540ca100 0x7fb054147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb05babd700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb05415b790 0x7fb054147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb05babd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb05415bce0 0x7fb0541491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb05babd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054148dd0 con 0x7fb0540ca100 2023-08-31T01:59:55.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb05babd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054148150 con 0x7fb05415bce0 2023-08-31T01:59:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb05babd700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb054148430 con 0x7fb05415b790 2023-08-31T01:59:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0540ca100 0x7fb054147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0540ca100 0x7fb054147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50748/0 (socket says 172.21.15.84:50748) 2023-08-31T01:59:55.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 -- 172.21.15.84:0/4288141692 learned_addr learned my addr 172.21.15.84:0/4288141692 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:55.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 -- 172.21.15.84:0/4288141692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb05415b790 msgr2=0x7fb054147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb05415b790 0x7fb054147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 -- 172.21.15.84:0/4288141692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb05415bce0 msgr2=0x7fb0541491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb05415bce0 0x7fb0541491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 -- 172.21.15.84:0/4288141692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500095f0 con 0x7fb0540ca100 2023-08-31T01:59:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb059859700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0540ca100 0x7fb054147a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb04400c9b0 tx=0x7fb04400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb04a7fc700 1 -- 172.21.15.84:0/4288141692 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044007b00 con 0x7fb0540ca100 2023-08-31T01:59:55.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb04a7fc700 1 -- 172.21.15.84:0/4288141692 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb044007d50 con 0x7fb0540ca100 2023-08-31T01:59:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb054148710 con 0x7fb0540ca100 2023-08-31T01:59:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb04a7fc700 1 -- 172.21.15.84:0/4288141692 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400f6b0 con 0x7fb0540ca100 2023-08-31T01:59:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.530+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb054147660 con 0x7fb0540ca100 2023-08-31T01:59:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.531+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb054149040 con 0x7fb0540ca100 2023-08-31T01:59:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.532+0000 7fb04a7fc700 1 -- 172.21.15.84:0/4288141692 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb04400f810 con 0x7fb0540ca100 2023-08-31T01:59:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.532+0000 7fb04a7fc700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb03806a0e0 0x7fb03806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.532+0000 7fb04a7fc700 1 -- 172.21.15.84:0/4288141692 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0440888a0 con 0x7fb0540ca100 2023-08-31T01:59:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.532+0000 7fb059058700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb03806a0e0 0x7fb03806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.533+0000 7fb059058700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb03806a0e0 0x7fb03806c5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb0540a6cf0 tx=0x7fb050004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.537+0000 7fb04a7fc700 1 -- 172.21.15.84:0/4288141692 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb0440543d0 con 0x7fb0540ca100 2023-08-31T01:59:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.725+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb05404e7c0 con 0x7fb0540ca100 2023-08-31T01:59:55.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.726+0000 7fb04a7fc700 1 -- 172.21.15.84:0/4288141692 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0440579f0 con 0x7fb0540ca100 2023-08-31T01:59:55.719 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T01:59:55.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb03806a0e0 msgr2=0x7fb03806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb03806a0e0 0x7fb03806c5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb0540a6cf0 tx=0x7fb050004750 comp rx=0 tx=0).stop 2023-08-31T01:59:55.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0540ca100 msgr2=0x7fb054147a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0540ca100 0x7fb054147a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb04400c9b0 tx=0x7fb04400cd70 comp rx=0 tx=0).stop 2023-08-31T01:59:55.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 shutdown_connections 2023-08-31T01:59:55.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb03806a0e0 0x7fb03806c5a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb05415bce0 0x7fb0541491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0540ca100 0x7fb054147a50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 --2- 172.21.15.84:0/4288141692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb05415b790 0x7fb054147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 >> 172.21.15.84:0/4288141692 conn(0x7fb0540afb00 msgr2=0x7fb05415a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:55.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 shutdown_connections 2023-08-31T01:59:55.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.728+0000 7fb05babd700 1 -- 172.21.15.84:0/4288141692 wait complete. 2023-08-31T01:59:55.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T01:59:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.861+0000 7f68ed9da700 1 -- 172.21.15.84:0/3777723095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80cfcc0 msgr2=0x7f68e80d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.861+0000 7f68ed9da700 1 --2- 172.21.15.84:0/3777723095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80cfcc0 0x7f68e80d0170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009fd0 tx=0x7f68e000b380 comp rx=0 tx=0).stop 2023-08-31T01:59:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.861+0000 7f68ed9da700 1 -- 172.21.15.84:0/3777723095 shutdown_connections 2023-08-31T01:59:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.861+0000 7f68ed9da700 1 --2- 172.21.15.84:0/3777723095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80cfcc0 0x7f68e80d0170 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.861+0000 7f68ed9da700 1 --2- 172.21.15.84:0/3777723095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68e80cba20 0x7f68e806a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.861+0000 7f68ed9da700 1 -- 172.21.15.84:0/3777723095 >> 172.21.15.84:0/3777723095 conn(0x7f68e80d11c0 msgr2=0x7f68e80d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.861+0000 7f68ed9da700 1 -- 172.21.15.84:0/3777723095 shutdown_connections 2023-08-31T01:59:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.861+0000 7f68ed9da700 1 -- 172.21.15.84:0/3777723095 wait complete. 2023-08-31T01:59:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.862+0000 7f68ed9da700 1 Processor -- start 2023-08-31T01:59:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.863+0000 7f68ed9da700 1 -- start start 2023-08-31T01:59:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68ed9da700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68e80cba20 0x7f68e81539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68ed9da700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e80cfcc0 0x7f68e81557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68ed9da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e815eac0 0x7f68e81f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68ed9da700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e8143f30 con 0x7f68e815eac0 2023-08-31T01:59:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68ed9da700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e8156e70 con 0x7f68e80cfcc0 2023-08-31T01:59:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68ed9da700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e8156ae0 con 0x7f68e80cba20 2023-08-31T01:59:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e815eac0 0x7f68e81f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e815eac0 0x7f68e81f10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50766/0 (socket says 172.21.15.84:50766) 2023-08-31T01:59:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 -- 172.21.15.84:0/2205494247 learned_addr learned my addr 172.21.15.84:0/2205494247 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e67fc700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e80cfcc0 0x7f68e81557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 -- 172.21.15.84:0/2205494247 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68e80cba20 msgr2=0x7f68e81539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e6ffd700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68e80cba20 0x7f68e81539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68e80cba20 0x7f68e81539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 -- 172.21.15.84:0/2205494247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e80cfcc0 msgr2=0x7f68e81557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e80cfcc0 0x7f68e81557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:55.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 -- 172.21.15.84:0/2205494247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009d00 con 0x7f68e815eac0 2023-08-31T01:59:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68e77fe700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e815eac0 0x7f68e81f10c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f68e80b3db0 tx=0x7f68e0007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68cffff700 1 -- 172.21.15.84:0/2205494247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e000e040 con 0x7f68e815eac0 2023-08-31T01:59:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68cffff700 1 -- 172.21.15.84:0/2205494247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f68e001d890 con 0x7f68e815eac0 2023-08-31T01:59:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e8156240 con 0x7f68e815eac0 2023-08-31T01:59:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68cffff700 1 -- 172.21.15.84:0/2205494247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e001dca0 con 0x7f68e815eac0 2023-08-31T01:59:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.864+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e8156800 con 0x7f68e815eac0 2023-08-31T01:59:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.865+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e8157020 con 0x7f68e815eac0 2023-08-31T01:59:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.866+0000 7f68cffff700 1 -- 172.21.15.84:0/2205494247 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f68e001b450 con 0x7f68e815eac0 2023-08-31T01:59:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.866+0000 7f68cffff700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f68d406a0e0 0x7f68d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.866+0000 7f68cffff700 1 -- 172.21.15.84:0/2205494247 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68e008a1a0 con 0x7f68e815eac0 2023-08-31T01:59:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.866+0000 7f68e6ffd700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f68d406a0e0 0x7f68d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.866+0000 7f68e6ffd700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f68d406a0e0 0x7f68d406c5a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000f60 tx=0x7f68dc009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:55.870+0000 7f68cffff700 1 -- 172.21.15.84:0/2205494247 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f68e8157020 con 0x7f68e815eac0 2023-08-31T01:59:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.061+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f68e8157020 con 0x7f68e815eac0 2023-08-31T01:59:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.062+0000 7f68cffff700 1 -- 172.21.15.84:0/2205494247 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f68e8157020 con 0x7f68e815eac0 2023-08-31T01:59:56.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T01:59:56.055 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-08-31T01:59:56.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T01:59:56.056 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-08-31T01:59:56.056 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-08-31T01:59:56.056 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T01:59:56.056 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-08-31T01:59:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f68d406a0e0 msgr2=0x7f68d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:56.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f68d406a0e0 0x7f68d406c5a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000f60 tx=0x7f68dc009040 comp rx=0 tx=0).stop 2023-08-31T01:59:56.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e815eac0 msgr2=0x7f68e81f10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:56.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e815eac0 0x7f68e81f10c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f68e80b3db0 tx=0x7f68e0007c30 comp rx=0 tx=0).stop 2023-08-31T01:59:56.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 shutdown_connections 2023-08-31T01:59:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f68d406a0e0 0x7f68d406c5a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e815eac0 0x7f68e81f10c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68e80cba20 0x7f68e81539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 --2- 172.21.15.84:0/2205494247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68e80cfcc0 0x7f68e81557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 >> 172.21.15.84:0/2205494247 conn(0x7f68e80d11c0 msgr2=0x7f68e80d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 shutdown_connections 2023-08-31T01:59:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.064+0000 7f68ed9da700 1 -- 172.21.15.84:0/2205494247 wait complete. 2023-08-31T01:59:56.068 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T01:59:56.069 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-31T01:59:56.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.202+0000 7f94c54d2700 1 -- 172.21.15.84:0/1203438280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c00708a0 msgr2=0x7f94c0070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:56.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.202+0000 7f94c54d2700 1 --2- 172.21.15.84:0/1203438280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c00708a0 0x7f94c0070d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94c00ccd60 tx=0x7f94b800b380 comp rx=0 tx=0).stop 2023-08-31T01:59:56.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.202+0000 7f94c54d2700 1 -- 172.21.15.84:0/1203438280 shutdown_connections 2023-08-31T01:59:56.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.203+0000 7f94c54d2700 1 --2- 172.21.15.84:0/1203438280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c00708a0 0x7f94c0070d50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:56.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.203+0000 7f94c54d2700 1 --2- 172.21.15.84:0/1203438280 >> v2:172.21.15.170:3300/0 conn(0x7f94c0155d20 0x7f94c00c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:56.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.203+0000 7f94c54d2700 1 -- 172.21.15.84:0/1203438280 >> 172.21.15.84:0/1203438280 conn(0x7f94c00ce030 msgr2=0x7f94c00ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:56.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.203+0000 7f94c54d2700 1 -- 172.21.15.84:0/1203438280 shutdown_connections 2023-08-31T01:59:56.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.203+0000 7f94c54d2700 1 -- 172.21.15.84:0/1203438280 wait complete. 2023-08-31T01:59:56.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.204+0000 7f94c54d2700 1 Processor -- start 2023-08-31T01:59:56.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.204+0000 7f94c54d2700 1 -- start start 2023-08-31T01:59:56.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94c54d2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c00708a0 0x7f94c00c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:56.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94c54d2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94c0155940 0x7f94c00c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94c54d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c0155d20 0x7f94c014c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94c54d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00c3ff0 con 0x7f94c0155d20 2023-08-31T01:59:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94c54d2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c006b6b0 con 0x7f94c00708a0 2023-08-31T01:59:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94c54d2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c0159c00 con 0x7f94c0155940 2023-08-31T01:59:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94bf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c0155d20 0x7f94c014c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94bf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c0155d20 0x7f94c014c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50780/0 (socket says 172.21.15.84:50780) 2023-08-31T01:59:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94bf7fe700 1 -- 172.21.15.84:0/3795902155 learned_addr learned my addr 172.21.15.84:0/3795902155 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94be7fc700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94c0155940 0x7f94c00c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.205+0000 7f94beffd700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c00708a0 0x7f94c00c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94bf7fe700 1 -- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94c0155940 msgr2=0x7f94c00c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94bf7fe700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94c0155940 0x7f94c00c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94bf7fe700 1 -- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c00708a0 msgr2=0x7f94c00c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94bf7fe700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c00708a0 0x7f94c00c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94bf7fe700 1 -- 172.21.15.84:0/3795902155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8009d00 con 0x7f94c0155d20 2023-08-31T01:59:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94beffd700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c00708a0 0x7f94c00c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T01:59:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94bf7fe700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c0155d20 0x7f94c014c100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94c0071800 tx=0x7f94b8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94a77fe700 1 -- 172.21.15.84:0/3795902155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b800e040 con 0x7f94c0155d20 2023-08-31T01:59:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94a77fe700 1 -- 172.21.15.84:0/3795902155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94b801a6e0 con 0x7f94c0155d20 2023-08-31T01:59:56.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94a77fe700 1 -- 172.21.15.84:0/3795902155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b801ab30 con 0x7f94c0155d20 2023-08-31T01:59:56.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c0159ee0 con 0x7f94c0155d20 2023-08-31T01:59:56.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.206+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c006b990 con 0x7f94c0155d20 2023-08-31T01:59:56.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.207+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c00b1210 con 0x7f94c0155d20 2023-08-31T01:59:56.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.207+0000 7f94a77fe700 1 -- 172.21.15.84:0/3795902155 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f94b801ac90 con 0x7f94c0155d20 2023-08-31T01:59:56.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.208+0000 7f94a77fe700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f94ac06a0e0 0x7f94ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:56.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.208+0000 7f94a77fe700 1 -- 172.21.15.84:0/3795902155 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94b808b900 con 0x7f94c0155d20 2023-08-31T01:59:56.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.208+0000 7f94beffd700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f94ac06a0e0 0x7f94ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:56.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.208+0000 7f94beffd700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f94ac06a0e0 0x7f94ac06c5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000f60 tx=0x7f94b4009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:56.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.212+0000 7f94a77fe700 1 -- 172.21.15.84:0/3795902155 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f94b8057440 con 0x7f94c0155d20 2023-08-31T01:59:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:56.401+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f94c0073a40 con 0x7f94c0155d20 2023-08-31T01:59:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.120+0000 7f94a77fe700 1 -- 172.21.15.84:0/3795902155 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f94b805aa60 con 0x7f94c0155d20 2023-08-31T01:59:57.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f94ac06a0e0 msgr2=0x7f94ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f94ac06a0e0 0x7f94ac06c5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000f60 tx=0x7f94b4009040 comp rx=0 tx=0).stop 2023-08-31T01:59:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c0155d20 msgr2=0x7f94c014c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c0155d20 0x7f94c014c100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94c0071800 tx=0x7f94b8009c30 comp rx=0 tx=0).stop 2023-08-31T01:59:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 shutdown_connections 2023-08-31T01:59:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f94ac06a0e0 0x7f94ac06c5a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94c0155d20 0x7f94c014c100 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c00708a0 0x7f94c00c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 --2- 172.21.15.84:0/3795902155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94c0155940 0x7f94c00c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 >> 172.21.15.84:0/3795902155 conn(0x7f94c00ce030 msgr2=0x7f94c00ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 shutdown_connections 2023-08-31T01:59:57.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.124+0000 7f94c54d2700 1 -- 172.21.15.84:0/3795902155 wait complete. 2023-08-31T01:59:57.120 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-08-31T01:59:57.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-08-31T01:59:57.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.268+0000 7f5e65706700 1 -- 172.21.15.84:0/1963360140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cfcc0 msgr2=0x7f5e600d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:57.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.268+0000 7f5e65706700 1 --2- 172.21.15.84:0/1963360140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cfcc0 0x7f5e600d0110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e60160250 tx=0x7f5e5800b380 comp rx=0 tx=0).stop 2023-08-31T01:59:57.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.268+0000 7f5e65706700 1 -- 172.21.15.84:0/1963360140 shutdown_connections 2023-08-31T01:59:57.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.268+0000 7f5e65706700 1 --2- 172.21.15.84:0/1963360140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cfcc0 0x7f5e600d0110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:57.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.268+0000 7f5e65706700 1 --2- 172.21.15.84:0/1963360140 >> v2:172.21.15.170:3300/0 conn(0x7f5e600cba20 0x7f5e6006a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:57.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.268+0000 7f5e65706700 1 -- 172.21.15.84:0/1963360140 >> 172.21.15.84:0/1963360140 conn(0x7f5e600d11c0 msgr2=0x7f5e600d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:57.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.268+0000 7f5e65706700 1 -- 172.21.15.84:0/1963360140 shutdown_connections 2023-08-31T01:59:57.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.268+0000 7f5e65706700 1 -- 172.21.15.84:0/1963360140 wait complete. 2023-08-31T01:59:57.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e65706700 1 Processor -- start 2023-08-31T01:59:57.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e65706700 1 -- start start 2023-08-31T01:59:57.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e65706700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cba20 0x7f5e60156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e65706700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e600cfcc0 0x7f5e6015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e65706700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e6015eac0 0x7f5e6014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e65706700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60150fa0 con 0x7f5e600cba20 2023-08-31T01:59:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e65706700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6015af70 con 0x7f5e600cfcc0 2023-08-31T01:59:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e65706700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6014f500 con 0x7f5e6015eac0 2023-08-31T01:59:57.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e5effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cba20 0x7f5e60156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:57.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e5effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cba20 0x7f5e60156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50790/0 (socket says 172.21.15.84:50790) 2023-08-31T01:59:57.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.270+0000 7f5e5effd700 1 -- 172.21.15.84:0/4086166556 learned_addr learned my addr 172.21.15.84:0/4086166556 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:57.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5f7fe700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e6015eac0 0x7f5e6014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:57.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5e7fc700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e600cfcc0 0x7f5e6015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:57.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5effd700 1 -- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e6015eac0 msgr2=0x7f5e6014efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:57.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5effd700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e6015eac0 0x7f5e6014efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:57.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5effd700 1 -- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e600cfcc0 msgr2=0x7f5e6015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:57.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5effd700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e600cfcc0 0x7f5e6015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:57.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5effd700 1 -- 172.21.15.84:0/4086166556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009d00 con 0x7f5e600cba20 2023-08-31T01:59:57.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5f7fe700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e6015eac0 0x7f5e6014efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T01:59:57.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e5effd700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cba20 0x7f5e60156e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400b4a0 tx=0x7f5e5400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:57.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e477fe700 1 -- 172.21.15.84:0/4086166556 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54011830 con 0x7f5e600cba20 2023-08-31T01:59:57.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e477fe700 1 -- 172.21.15.84:0/4086166556 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5e54011aa0 con 0x7f5e600cba20 2023-08-31T01:59:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e601574a0 con 0x7f5e600cba20 2023-08-31T01:59:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e477fe700 1 -- 172.21.15.84:0/4086166556 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54010380 con 0x7f5e600cba20 2023-08-31T01:59:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.271+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e60157a60 con 0x7f5e600cba20 2023-08-31T01:59:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.272+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6004e7c0 con 0x7f5e600cba20 2023-08-31T01:59:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.272+0000 7f5e477fe700 1 -- 172.21.15.84:0/4086166556 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5e540104e0 con 0x7f5e600cba20 2023-08-31T01:59:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.273+0000 7f5e477fe700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5e4c06a0e0 0x7f5e4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.273+0000 7f5e477fe700 1 -- 172.21.15.84:0/4086166556 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5e540884d0 con 0x7f5e600cba20 2023-08-31T01:59:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.273+0000 7f5e5e7fc700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5e4c06a0e0 0x7f5e4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.273+0000 7f5e5e7fc700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5e4c06a0e0 0x7f5e4c06c5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e50006fd0 tx=0x7f5e50008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.277+0000 7f5e477fe700 1 -- 172.21.15.84:0/4086166556 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5e54053e80 con 0x7f5e600cba20 2023-08-31T01:59:57.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:57.467+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f5e6006a3b0 con 0x7f5e600cba20 2023-08-31T01:59:57.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:59:57.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:59:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.120+0000 7f5e477fe700 1 -- 172.21.15.84:0/4086166556 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f5e5401e1b0 con 0x7f5e600cba20 2023-08-31T01:59:58.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.125+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5e4c06a0e0 msgr2=0x7f5e4c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:58.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.125+0000 7f5e65706700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5e4c06a0e0 0x7f5e4c06c5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e50006fd0 tx=0x7f5e50008040 comp rx=0 tx=0).stop 2023-08-31T01:59:58.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.125+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cba20 msgr2=0x7f5e60156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:58.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.125+0000 7f5e65706700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cba20 0x7f5e60156e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400b4a0 tx=0x7f5e5400b860 comp rx=0 tx=0).stop 2023-08-31T01:59:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.126+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 shutdown_connections 2023-08-31T01:59:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.126+0000 7f5e65706700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5e4c06a0e0 0x7f5e4c06c5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.126+0000 7f5e65706700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e6015eac0 0x7f5e6014efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.126+0000 7f5e65706700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e600cba20 0x7f5e60156e30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.126+0000 7f5e65706700 1 --2- 172.21.15.84:0/4086166556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e600cfcc0 0x7f5e6015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:58.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.126+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 >> 172.21.15.84:0/4086166556 conn(0x7f5e600d11c0 msgr2=0x7f5e6015b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:58.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.126+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 shutdown_connections 2023-08-31T01:59:58.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.126+0000 7f5e65706700 1 -- 172.21.15.84:0/4086166556 wait complete. 2023-08-31T01:59:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-08-31T01:59:58.139 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T01:59:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.271+0000 7fbf0a01b700 1 -- 172.21.15.84:0/461113032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 msgr2=0x7fbf040b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.271+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/461113032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 0x7fbf040b0020 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf040b19f0 tx=0x7fbef8009c70 comp rx=0 tx=0).stop 2023-08-31T01:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.271+0000 7fbf0a01b700 1 -- 172.21.15.84:0/461113032 shutdown_connections 2023-08-31T01:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.271+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/461113032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 0x7fbf040b0020 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.271+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/461113032 >> v2:172.21.15.170:3300/0 conn(0x7fbf040cd3f0 0x7fbf040cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.271+0000 7fbf0a01b700 1 -- 172.21.15.84:0/461113032 >> 172.21.15.84:0/461113032 conn(0x7fbf040b0c40 msgr2=0x7fbf040b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.271+0000 7fbf0a01b700 1 -- 172.21.15.84:0/461113032 shutdown_connections 2023-08-31T01:59:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.271+0000 7fbf0a01b700 1 -- 172.21.15.84:0/461113032 wait complete. 2023-08-31T01:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.273+0000 7fbf0a01b700 1 Processor -- start 2023-08-31T01:59:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.273+0000 7fbf0a01b700 1 -- start start 2023-08-31T01:59:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf0a01b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040cd3f0 0x7fbf0415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf0a01b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 0x7fbf0414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf0a01b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf0415d750 0x7fbf0406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf0a01b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040c6990 con 0x7fbf04159320 2023-08-31T01:59:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf0a01b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf041f0670 con 0x7fbf040cd3f0 2023-08-31T01:59:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf0a01b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0415b860 con 0x7fbf0415d750 2023-08-31T01:59:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 0x7fbf0414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 0x7fbf0414f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50808/0 (socket says 172.21.15.84:50808) 2023-08-31T01:59:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 -- 172.21.15.84:0/2818015600 learned_addr learned my addr 172.21.15.84:0/2818015600 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf037fe700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040cd3f0 0x7fbf0415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf03fff700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf0415d750 0x7fbf0406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 -- 172.21.15.84:0/2818015600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf0415d750 msgr2=0x7fbf0406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf0415d750 0x7fbf0406e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 -- 172.21.15.84:0/2818015600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040cd3f0 msgr2=0x7fbf0415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040cd3f0 0x7fbf0415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 -- 172.21.15.84:0/2818015600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80095f0 con 0x7fbf04159320 2023-08-31T01:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbf02ffd700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 0x7fbf0414f260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbef400c450 tx=0x7fbef400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.274+0000 7fbeebfff700 1 -- 172.21.15.84:0/2818015600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40052d0 con 0x7fbf04159320 2023-08-31T01:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.275+0000 7fbeebfff700 1 -- 172.21.15.84:0/2818015600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbef4005520 con 0x7fbf04159320 2023-08-31T01:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.275+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf040c6310 con 0x7fbf04159320 2023-08-31T01:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.275+0000 7fbeebfff700 1 -- 172.21.15.84:0/2818015600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40038e0 con 0x7fbf04159320 2023-08-31T01:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.275+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf040c65b0 con 0x7fbf04159320 2023-08-31T01:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.276+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf040c6ad0 con 0x7fbf04159320 2023-08-31T01:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.276+0000 7fbeebfff700 1 -- 172.21.15.84:0/2818015600 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbef4003a40 con 0x7fbf04159320 2023-08-31T01:59:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.276+0000 7fbeebfff700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbef006a0e0 0x7fbef006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.276+0000 7fbf037fe700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbef006a0e0 0x7fbef006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.277+0000 7fbeebfff700 1 -- 172.21.15.84:0/2818015600 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbef4087880 con 0x7fbf04159320 2023-08-31T01:59:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.277+0000 7fbf037fe700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbef006a0e0 0x7fbef006c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbef80098e0 tx=0x7fbef80047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.281+0000 7fbeebfff700 1 -- 172.21.15.84:0/2818015600 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbf040c6ad0 con 0x7fbf04159320 2023-08-31T01:59:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:58.511+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbf040c6ad0 con 0x7fbf04159320 2023-08-31T01:59:59.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.141+0000 7fbeebfff700 1 -- 172.21.15.84:0/2818015600 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbf040c6ad0 con 0x7fbf04159320 2023-08-31T01:59:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.145+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbef006a0e0 msgr2=0x7fbef006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.145+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbef006a0e0 0x7fbef006c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbef80098e0 tx=0x7fbef80047c0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.145+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 msgr2=0x7fbf0414f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.145+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 0x7fbf0414f260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbef400c450 tx=0x7fbef400c760 comp rx=0 tx=0).stop 2023-08-31T01:59:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.146+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 shutdown_connections 2023-08-31T01:59:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.146+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbef006a0e0 0x7fbef006c5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.146+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf0415d750 0x7fbf0406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.146+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040cd3f0 0x7fbf0415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.146+0000 7fbf0a01b700 1 --2- 172.21.15.84:0/2818015600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf04159320 0x7fbf0414f260 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.146+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 >> 172.21.15.84:0/2818015600 conn(0x7fbf040b0c40 msgr2=0x7fbf04158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:59.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.146+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 shutdown_connections 2023-08-31T01:59:59.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.146+0000 7fbf0a01b700 1 -- 172.21.15.84:0/2818015600 wait complete. 2023-08-31T01:59:59.143 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2023-08-31T01:59:59.157 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-08-31T01:59:59.158 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-08-31T01:59:59.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.293+0000 7f08dbc49700 1 -- 172.21.15.84:0/580084984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 msgr2=0x7f08d40b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.293+0000 7f08dbc49700 1 --2- 172.21.15.84:0/580084984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 0x7f08d40b0e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08d00098c0 tx=0x7f08d0009bd0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.293+0000 7f08dbc49700 1 -- 172.21.15.84:0/580084984 shutdown_connections 2023-08-31T01:59:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.293+0000 7f08dbc49700 1 --2- 172.21.15.84:0/580084984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 0x7f08d40b0e00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.293+0000 7f08dbc49700 1 -- 172.21.15.84:0/580084984 >> 172.21.15.84:0/580084984 conn(0x7f08d40caa30 msgr2=0x7f08d40cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T01:59:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.293+0000 7f08dbc49700 1 -- 172.21.15.84:0/580084984 shutdown_connections 2023-08-31T01:59:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.294+0000 7f08dbc49700 1 -- 172.21.15.84:0/580084984 wait complete. 2023-08-31T01:59:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08dbc49700 1 Processor -- start 2023-08-31T01:59:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08dbc49700 1 -- start start 2023-08-31T01:59:59.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08dbc49700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08d40c9d00 0x7f08d40c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:59.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08dbc49700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08d41590f0 0x7f08d41472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:59.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08dbc49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 0x7f08d4147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08dbc49700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d406e040 con 0x7f08d415c8c0 2023-08-31T01:59:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08dbc49700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4144e00 con 0x7f08d41590f0 2023-08-31T01:59:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08dbc49700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41450e0 con 0x7f08d40c9d00 2023-08-31T01:59:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08da1e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 0x7f08d4147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08da1e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 0x7f08d4147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50822/0 (socket says 172.21.15.84:50822) 2023-08-31T01:59:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.295+0000 7f08da1e6700 1 -- 172.21.15.84:0/934955967 learned_addr learned my addr 172.21.15.84:0/934955967 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T01:59:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08d99e5700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08d40c9d00 0x7f08d40c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:59.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08d91e4700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08d41590f0 0x7f08d41472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:59.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08da1e6700 1 -- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08d40c9d00 msgr2=0x7f08d40c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:59.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08da1e6700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08d40c9d00 0x7f08d40c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08da1e6700 1 -- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08d41590f0 msgr2=0x7f08d41472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T01:59:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08da1e6700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08d41590f0 0x7f08d41472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T01:59:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08da1e6700 1 -- 172.21.15.84:0/934955967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d0009520 con 0x7f08d415c8c0 2023-08-31T01:59:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08d99e5700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08d40c9d00 0x7f08d40c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T01:59:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08d91e4700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08d41590f0 0x7f08d41472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T01:59:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08da1e6700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 0x7f08d4147800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00cb40 tx=0x7f08cc00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08ca7fc700 1 -- 172.21.15.84:0/934955967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00ab50 con 0x7f08d415c8c0 2023-08-31T01:59:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08ca7fc700 1 -- 172.21.15.84:0/934955967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f08cc00ada0 con 0x7f08d415c8c0 2023-08-31T01:59:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d41453c0 con 0x7f08d415c8c0 2023-08-31T01:59:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08ca7fc700 1 -- 172.21.15.84:0/934955967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc012680 con 0x7f08d415c8c0 2023-08-31T01:59:59.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.296+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d40c9180 con 0x7f08d415c8c0 2023-08-31T01:59:59.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.297+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d4144f40 con 0x7f08d415c8c0 2023-08-31T01:59:59.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.297+0000 7f08ca7fc700 1 -- 172.21.15.84:0/934955967 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08cc01a3b0 con 0x7f08d415c8c0 2023-08-31T01:59:59.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.298+0000 7f08ca7fc700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f08b806a0e0 0x7f08b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T01:59:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.298+0000 7f08ca7fc700 1 -- 172.21.15.84:0/934955967 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08cc088850 con 0x7f08d415c8c0 2023-08-31T01:59:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.298+0000 7f08d99e5700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f08b806a0e0 0x7f08b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T01:59:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.298+0000 7f08d99e5700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f08b806a0e0 0x7f08b806c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08c4000f60 tx=0x7f08c4009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T01:59:59.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.302+0000 7f08ca7fc700 1 -- 172.21.15.84:0/934955967 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f08d4144f40 con 0x7f08d415c8c0 2023-08-31T01:59:59.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T01:59:59.507+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f08d4144f40 con 0x7f08d415c8c0 2023-08-31T02:00:00.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.126+0000 7f08ca7fc700 1 -- 172.21.15.84:0/934955967 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f08d4144f40 con 0x7f08d415c8c0 2023-08-31T02:00:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f08b806a0e0 msgr2=0x7f08b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f08b806a0e0 0x7f08b806c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08c4000f60 tx=0x7f08c4009040 comp rx=0 tx=0).stop 2023-08-31T02:00:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 msgr2=0x7f08d4147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 0x7f08d4147800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00cb40 tx=0x7f08cc00cf00 comp rx=0 tx=0).stop 2023-08-31T02:00:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 shutdown_connections 2023-08-31T02:00:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f08b806a0e0 0x7f08b806c5a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08d415c8c0 0x7f08d4147800 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08d40c9d00 0x7f08d40c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 --2- 172.21.15.84:0/934955967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08d41590f0 0x7f08d41472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 >> 172.21.15.84:0/934955967 conn(0x7f08d40caa30 msgr2=0x7f08d40b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 shutdown_connections 2023-08-31T02:00:00.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.128+0000 7f08dbc49700 1 -- 172.21.15.84:0/934955967 wait complete. 2023-08-31T02:00:00.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T02:00:00.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.276+0000 7f904164c700 1 -- 172.21.15.84:0/179027411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c15bdd0 msgr2=0x7f903c0c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:00.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.276+0000 7f904164c700 1 --2- 172.21.15.84:0/179027411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c15bdd0 0x7f903c0c7f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9034009f60 tx=0x7f9034009f90 comp rx=0 tx=0).stop 2023-08-31T02:00:00.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.276+0000 7f904164c700 1 -- 172.21.15.84:0/179027411 shutdown_connections 2023-08-31T02:00:00.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.276+0000 7f904164c700 1 --2- 172.21.15.84:0/179027411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c15bdd0 0x7f903c0c7f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:00.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.276+0000 7f904164c700 1 -- 172.21.15.84:0/179027411 >> 172.21.15.84:0/179027411 conn(0x7f903c0c9840 msgr2=0x7f903c0c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:00.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.276+0000 7f904164c700 1 -- 172.21.15.84:0/179027411 shutdown_connections 2023-08-31T02:00:00.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.276+0000 7f904164c700 1 -- 172.21.15.84:0/179027411 wait complete. 2023-08-31T02:00:00.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.277+0000 7f904164c700 1 Processor -- start 2023-08-31T02:00:00.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.277+0000 7f904164c700 1 -- start start 2023-08-31T02:00:00.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f904164c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c06d1d0 0x7f903c0c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:00.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f904164c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c1418a0 0x7f903c157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:00.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f904164c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c15bdd0 0x7f903c13e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f904164c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1f2140 con 0x7f903c1418a0 2023-08-31T02:00:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f904164c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c13ed10 con 0x7f903c15bdd0 2023-08-31T02:00:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f904164c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1f1810 con 0x7f903c06d1d0 2023-08-31T02:00:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c1418a0 0x7f903c157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c1418a0 0x7f903c157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50836/0 (socket says 172.21.15.84:50836) 2023-08-31T02:00:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903a7fc700 1 -- 172.21.15.84:0/1653454478 learned_addr learned my addr 172.21.15.84:0/1653454478 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903b7fe700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c15bdd0 0x7f903c13e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903affd700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c06d1d0 0x7f903c0c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903a7fc700 1 -- 172.21.15.84:0/1653454478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c06d1d0 msgr2=0x7f903c0c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903a7fc700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c06d1d0 0x7f903c0c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:00.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903a7fc700 1 -- 172.21.15.84:0/1653454478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c15bdd0 msgr2=0x7f903c13e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:00.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903a7fc700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c15bdd0 0x7f903c13e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:00.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.278+0000 7f903a7fc700 1 -- 172.21.15.84:0/1653454478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034009c40 con 0x7f903c1418a0 2023-08-31T02:00:00.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.279+0000 7f903a7fc700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c1418a0 0x7f903c157690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9030001eb0 tx=0x7f903000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:00.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.279+0000 7f90237fe700 1 -- 172.21.15.84:0/1653454478 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90300054e0 con 0x7f903c1418a0 2023-08-31T02:00:00.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.279+0000 7f90237fe700 1 -- 172.21.15.84:0/1653454478 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9030003680 con 0x7f903c1418a0 2023-08-31T02:00:00.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.279+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c1f1af0 con 0x7f903c1418a0 2023-08-31T02:00:00.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.279+0000 7f90237fe700 1 -- 172.21.15.84:0/1653454478 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030003a50 con 0x7f903c1418a0 2023-08-31T02:00:00.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.279+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c13ea00 con 0x7f903c1418a0 2023-08-31T02:00:00.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.280+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c073a40 con 0x7f903c1418a0 2023-08-31T02:00:00.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.280+0000 7f90237fe700 1 -- 172.21.15.84:0/1653454478 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9030003bb0 con 0x7f903c1418a0 2023-08-31T02:00:00.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.280+0000 7f90237fe700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f902806a0e0 0x7f902806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:00.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.281+0000 7f903affd700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f902806a0e0 0x7f902806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:00.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.281+0000 7f90237fe700 1 -- 172.21.15.84:0/1653454478 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f90300879f0 con 0x7f903c1418a0 2023-08-31T02:00:00.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.281+0000 7f903affd700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f902806a0e0 0x7f902806c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f902c007fd0 tx=0x7f902c007ec0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:00.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.285+0000 7f90237fe700 1 -- 172.21.15.84:0/1653454478 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9030053180 con 0x7f903c1418a0 2023-08-31T02:00:00.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:00.477+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f903c06acc0 con 0x7f903c1418a0 2023-08-31T02:00:02.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.159+0000 7f90237fe700 1 -- 172.21.15.84:0/1653454478 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f9030003e60 con 0x7f903c1418a0 2023-08-31T02:00:02.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f902806a0e0 msgr2=0x7f902806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:02.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f902806a0e0 0x7f902806c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f902c007fd0 tx=0x7f902c007ec0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c1418a0 msgr2=0x7f903c157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:02.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c1418a0 0x7f903c157690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9030001eb0 tx=0x7f903000c800 comp rx=0 tx=0).stop 2023-08-31T02:00:02.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 shutdown_connections 2023-08-31T02:00:02.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f902806a0e0 0x7f902806c5a0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f902c007fd0 tx=0x7f902c007ec0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c15bdd0 0x7f903c13e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c06d1d0 0x7f903c0c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 --2- 172.21.15.84:0/1653454478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c1418a0 0x7f903c157690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.165+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 >> 172.21.15.84:0/1653454478 conn(0x7f903c0c9840 msgr2=0x7f903c06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:02.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.166+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 shutdown_connections 2023-08-31T02:00:02.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.166+0000 7f904164c700 1 -- 172.21.15.84:0/1653454478 wait complete. 2023-08-31T02:00:02.161 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' created 2023-08-31T02:00:02.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-08-31T02:00:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.313+0000 7fe77ae4d700 1 -- 172.21.15.84:0/762823000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 msgr2=0x7fe7740b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.313+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/762823000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 0x7fe7740b0e00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe774066200 tx=0x7fe760009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.313+0000 7fe77ae4d700 1 -- 172.21.15.84:0/762823000 shutdown_connections 2023-08-31T02:00:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.313+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/762823000 >> v2:172.21.15.170:3300/0 conn(0x7fe7741590f0 0x7fe7740b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.313+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/762823000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 0x7fe7740b0e00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.313+0000 7fe77ae4d700 1 -- 172.21.15.84:0/762823000 >> 172.21.15.84:0/762823000 conn(0x7fe7740caa30 msgr2=0x7fe7740cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.313+0000 7fe77ae4d700 1 -- 172.21.15.84:0/762823000 shutdown_connections 2023-08-31T02:00:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.313+0000 7fe77ae4d700 1 -- 172.21.15.84:0/762823000 wait complete. 2023-08-31T02:00:02.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.315+0000 7fe77ae4d700 1 Processor -- start 2023-08-31T02:00:02.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.315+0000 7fe77ae4d700 1 -- start start 2023-08-31T02:00:02.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe77ae4d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7740c9d00 0x7fe7740cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:02.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe77ae4d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7741590f0 0x7fe7740c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:02.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe77ae4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 0x7fe7740c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:02.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe77ae4d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740c2310 con 0x7fe77415c8c0 2023-08-31T02:00:02.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe77ae4d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740c49e0 con 0x7fe7740c9d00 2023-08-31T02:00:02.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe77ae4d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740c6950 con 0x7fe7741590f0 2023-08-31T02:00:02.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe7793ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 0x7fe7740c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:02.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe7793ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 0x7fe7740c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50850/0 (socket says 172.21.15.84:50850) 2023-08-31T02:00:02.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe7793ea700 1 -- 172.21.15.84:0/1868123185 learned_addr learned my addr 172.21.15.84:0/1868123185 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:02.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe773fff700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7741590f0 0x7fe7740c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:02.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe778be9700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7740c9d00 0x7fe7740cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:02.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.316+0000 7fe7793ea700 1 -- 172.21.15.84:0/1868123185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7741590f0 msgr2=0x7fe7740c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe7793ea700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7741590f0 0x7fe7740c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe7793ea700 1 -- 172.21.15.84:0/1868123185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7740c9d00 msgr2=0x7fe7740cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe7793ea700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7740c9d00 0x7fe7740cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe7793ea700 1 -- 172.21.15.84:0/1868123185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760009520 con 0x7fe77415c8c0 2023-08-31T02:00:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe7793ea700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 0x7fe7740c44a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe76c007f10 tx=0x7fe76c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe7717fa700 1 -- 172.21.15.84:0/1868123185 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c017070 con 0x7fe77415c8c0 2023-08-31T02:00:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe7717fa700 1 -- 172.21.15.84:0/1868123185 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe76c00f040 con 0x7fe77415c8c0 2023-08-31T02:00:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7740c6c30 con 0x7fe77415c8c0 2023-08-31T02:00:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe7717fa700 1 -- 172.21.15.84:0/1868123185 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c004df0 con 0x7fe77415c8c0 2023-08-31T02:00:02.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.317+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7740c71f0 con 0x7fe77415c8c0 2023-08-31T02:00:02.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.318+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe774073a40 con 0x7fe77415c8c0 2023-08-31T02:00:02.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.318+0000 7fe7717fa700 1 -- 172.21.15.84:0/1868123185 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe76c00db20 con 0x7fe77415c8c0 2023-08-31T02:00:02.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.318+0000 7fe7717fa700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe75806a0e0 0x7fe75806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:02.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.319+0000 7fe7717fa700 1 -- 172.21.15.84:0/1868123185 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fe76c0884a0 con 0x7fe77415c8c0 2023-08-31T02:00:02.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.319+0000 7fe778be9700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe75806a0e0 0x7fe75806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:02.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.319+0000 7fe778be9700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe75806a0e0 0x7fe75806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe768004740 tx=0x7fe768007f40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:02.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.323+0000 7fe7717fa700 1 -- 172.21.15.84:0/1868123185 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe76c053a40 con 0x7fe77415c8c0 2023-08-31T02:00:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:02.514+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fe7740cb940 con 0x7fe77415c8c0 2023-08-31T02:00:02.685 INFO:tasks.ceph.mds.d.smithi170.stderr:2023-08-31T02:00:02.692+0000 7f04d894e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T02:00:03.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.163+0000 7fe7717fa700 1 -- 172.21.15.84:0/1868123185 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe76c020160 con 0x7fe77415c8c0 2023-08-31T02:00:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.168+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe75806a0e0 msgr2=0x7fe75806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.168+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe75806a0e0 0x7fe75806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe768004740 tx=0x7fe768007f40 comp rx=0 tx=0).stop 2023-08-31T02:00:03.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.168+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 msgr2=0x7fe7740c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:03.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.168+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 0x7fe7740c44a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe76c007f10 tx=0x7fe76c00d3b0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.170+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 shutdown_connections 2023-08-31T02:00:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.170+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe75806a0e0 0x7fe75806c5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.170+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe77415c8c0 0x7fe7740c44a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.170+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7740c9d00 0x7fe7740cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.170+0000 7fe77ae4d700 1 --2- 172.21.15.84:0/1868123185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7741590f0 0x7fe7740c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.170+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 >> 172.21.15.84:0/1868123185 conn(0x7fe7740caa30 msgr2=0x7fe7740cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.171+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 shutdown_connections 2023-08-31T02:00:03.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.173+0000 7fe77ae4d700 1 -- 172.21.15.84:0/1868123185 wait complete. 2023-08-31T02:00:03.172 INFO:teuthology.orchestra.run.smithi084.stderr:set pool 4 allow_ec_overwrites to true 2023-08-31T02:00:03.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-08-31T02:00:03.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.330+0000 7f0a90474700 1 -- 172.21.15.84:0/630851989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880b0d90 msgr2=0x7f0a880b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:03.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.330+0000 7f0a90474700 1 --2- 172.21.15.84:0/630851989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880b0d90 0x7f0a880b1220 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009fd0 tx=0x7f0a8000b380 comp rx=0 tx=0).stop 2023-08-31T02:00:03.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.331+0000 7f0a90474700 1 -- 172.21.15.84:0/630851989 shutdown_connections 2023-08-31T02:00:03.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.331+0000 7f0a90474700 1 --2- 172.21.15.84:0/630851989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880b0d90 0x7f0a880b1220 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.331+0000 7f0a90474700 1 --2- 172.21.15.84:0/630851989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a880c4290 0x7f0a880c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.331+0000 7f0a90474700 1 -- 172.21.15.84:0/630851989 >> 172.21.15.84:0/630851989 conn(0x7f0a880ca900 msgr2=0x7f0a880cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.331+0000 7f0a90474700 1 -- 172.21.15.84:0/630851989 shutdown_connections 2023-08-31T02:00:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.331+0000 7f0a90474700 1 -- 172.21.15.84:0/630851989 wait complete. 2023-08-31T02:00:03.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.332+0000 7f0a90474700 1 Processor -- start 2023-08-31T02:00:03.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.332+0000 7f0a90474700 1 -- start start 2023-08-31T02:00:03.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a90474700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a880b0d90 0x7f0a88158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a90474700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a880c4290 0x7f0a881579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a90474700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880cba50 0x7f0a880b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a90474700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8813a820 con 0x7f0a880cba50 2023-08-31T02:00:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a90474700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a88159530 con 0x7f0a880b0d90 2023-08-31T02:00:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a90474700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a88159790 con 0x7f0a880c4290 2023-08-31T02:00:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880cba50 0x7f0a880b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880cba50 0x7f0a880b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50864/0 (socket says 172.21.15.84:50864) 2023-08-31T02:00:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 -- 172.21.15.84:0/3923985303 learned_addr learned my addr 172.21.15.84:0/3923985303 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8e210700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a880b0d90 0x7f0a88158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8da0f700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a880c4290 0x7f0a881579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 -- 172.21.15.84:0/3923985303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a880c4290 msgr2=0x7f0a881579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a880c4290 0x7f0a881579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 -- 172.21.15.84:0/3923985303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a880b0d90 msgr2=0x7f0a88158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a880b0d90 0x7f0a88158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 -- 172.21.15.84:0/3923985303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80009d00 con 0x7f0a880cba50 2023-08-31T02:00:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a8ea11700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880cba50 0x7f0a880b1ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000b780 tx=0x7f0a80009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a7effd700 1 -- 172.21.15.84:0/3923985303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000e040 con 0x7f0a880cba50 2023-08-31T02:00:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a7effd700 1 -- 172.21.15.84:0/3923985303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0a80007a10 con 0x7f0a880cba50 2023-08-31T02:00:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a88159a70 con 0x7f0a880cba50 2023-08-31T02:00:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a7effd700 1 -- 172.21.15.84:0/3923985303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80007e20 con 0x7f0a880cba50 2023-08-31T02:00:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.333+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8815a030 con 0x7f0a880cba50 2023-08-31T02:00:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.334+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8804e7c0 con 0x7f0a880cba50 2023-08-31T02:00:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.335+0000 7f0a7effd700 1 -- 172.21.15.84:0/3923985303 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a80004030 con 0x7f0a880cba50 2023-08-31T02:00:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.335+0000 7f0a7effd700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a6c06a0e0 0x7f0a6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.335+0000 7f0a8e210700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a6c06a0e0 0x7f0a6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.335+0000 7f0a7effd700 1 -- 172.21.15.84:0/3923985303 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f0a8008b780 con 0x7f0a880cba50 2023-08-31T02:00:03.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.335+0000 7f0a8e210700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a6c06a0e0 0x7f0a6c06c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a78004f30 tx=0x7f0a78009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:03.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.339+0000 7f0a7effd700 1 -- 172.21.15.84:0/3923985303 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0a80056d20 con 0x7f0a880cba50 2023-08-31T02:00:03.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:03.575+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f0a880af5d0 con 0x7f0a880cba50 2023-08-31T02:00:04.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.171+0000 7f0a7effd700 1 -- 172.21.15.84:0/3923985303 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0a80017030 con 0x7f0a880cba50 2023-08-31T02:00:04.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a6c06a0e0 msgr2=0x7f0a6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a6c06a0e0 0x7f0a6c06c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a78004f30 tx=0x7f0a78009040 comp rx=0 tx=0).stop 2023-08-31T02:00:04.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880cba50 msgr2=0x7f0a880b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880cba50 0x7f0a880b1ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000b780 tx=0x7f0a80009740 comp rx=0 tx=0).stop 2023-08-31T02:00:04.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 shutdown_connections 2023-08-31T02:00:04.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a6c06a0e0 0x7f0a6c06c5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880cba50 0x7f0a880b1ff0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a880b0d90 0x7f0a88158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 --2- 172.21.15.84:0/3923985303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a880c4290 0x7f0a881579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 >> 172.21.15.84:0/3923985303 conn(0x7f0a880ca900 msgr2=0x7f0a8806d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:04.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 shutdown_connections 2023-08-31T02:00:04.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.174+0000 7f0a90474700 1 -- 172.21.15.84:0/3923985303 wait complete. 2023-08-31T02:00:04.170 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 4 to fsmap 2023-08-31T02:00:04.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:00:04.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 -- 172.21.15.84:0/1687136387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00702b0 msgr2=0x7efce00b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 --2- 172.21.15.84:0/1687136387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00702b0 0x7efce00b24a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efce00b32e0 tx=0x7efcd0009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:04.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 -- 172.21.15.84:0/1687136387 shutdown_connections 2023-08-31T02:00:04.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 --2- 172.21.15.84:0/1687136387 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efce00b29e0 0x7efce0159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 --2- 172.21.15.84:0/1687136387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00702b0 0x7efce00b24a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 --2- 172.21.15.84:0/1687136387 >> v2:172.21.15.170:3300/0 conn(0x7efce00c5500 0x7efce0158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 -- 172.21.15.84:0/1687136387 >> 172.21.15.84:0/1687136387 conn(0x7efce00cd740 msgr2=0x7efce00cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 -- 172.21.15.84:0/1687136387 shutdown_connections 2023-08-31T02:00:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.311+0000 7efce6959700 1 -- 172.21.15.84:0/1687136387 wait complete. 2023-08-31T02:00:04.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.313+0000 7efce6959700 1 Processor -- start 2023-08-31T02:00:04.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.313+0000 7efce6959700 1 -- start start 2023-08-31T02:00:04.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efce6959700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efce00702b0 0x7efce0069e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efce6959700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00b29e0 0x7efce0153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efce6959700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce00c5500 0x7efce00af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efce6959700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c1600 con 0x7efce00b29e0 2023-08-31T02:00:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efce6959700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c1260 con 0x7efce00c5500 2023-08-31T02:00:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efce6959700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce006a4e0 con 0x7efce00702b0 2023-08-31T02:00:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00b29e0 0x7efce0153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00b29e0 0x7efce0153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50878/0 (socket says 172.21.15.84:50878) 2023-08-31T02:00:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 -- 172.21.15.84:0/1519612598 learned_addr learned my addr 172.21.15.84:0/1519612598 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdffff700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efce00702b0 0x7efce0069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:04.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efce4ef6700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce00c5500 0x7efce00af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:04.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 -- 172.21.15.84:0/1519612598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efce00702b0 msgr2=0x7efce0069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efce00702b0 0x7efce0069e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 -- 172.21.15.84:0/1519612598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce00c5500 msgr2=0x7efce00af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce00c5500 0x7efce00af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 -- 172.21.15.84:0/1519612598 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd00095f0 con 0x7efce00b29e0 2023-08-31T02:00:04.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdf7fe700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00b29e0 0x7efce0153cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c970 tx=0x7efcd400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:04.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.314+0000 7efcdcff9700 1 -- 172.21.15.84:0/1519612598 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4004a30 con 0x7efce00b29e0 2023-08-31T02:00:04.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.315+0000 7efcdcff9700 1 -- 172.21.15.84:0/1519612598 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efcd4004c80 con 0x7efce00b29e0 2023-08-31T02:00:04.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.315+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce006a7c0 con 0x7efce00b29e0 2023-08-31T02:00:04.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.315+0000 7efcdcff9700 1 -- 172.21.15.84:0/1519612598 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4005280 con 0x7efce00b29e0 2023-08-31T02:00:04.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.315+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce006aaa0 con 0x7efce00b29e0 2023-08-31T02:00:04.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.316+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce00c1740 con 0x7efce00b29e0 2023-08-31T02:00:04.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.316+0000 7efcdcff9700 1 -- 172.21.15.84:0/1519612598 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efcd40053e0 con 0x7efce00b29e0 2023-08-31T02:00:04.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.316+0000 7efcdcff9700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efccc06a0e0 0x7efccc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:04.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.317+0000 7efcdffff700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efccc06a0e0 0x7efccc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:04.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.317+0000 7efcdcff9700 1 -- 172.21.15.84:0/1519612598 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efcd40888b0 con 0x7efce00b29e0 2023-08-31T02:00:04.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.317+0000 7efcdffff700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efccc06a0e0 0x7efccc06c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcd0000c00 tx=0x7efcd00047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:04.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.321+0000 7efcdcff9700 1 -- 172.21.15.84:0/1519612598 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efce00c1740 con 0x7efce00b29e0 2023-08-31T02:00:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.550+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efce00c1740 con 0x7efce00b29e0 2023-08-31T02:00:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.550+0000 7efcdcff9700 1 -- 172.21.15.84:0/1519612598 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4877 (secure 0 0 0) 0x7efce00c1740 con 0x7efce00b29e0 2023-08-31T02:00:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:04.544 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:04.160267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-31T02:00:04.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efccc06a0e0 msgr2=0x7efccc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efccc06a0e0 0x7efccc06c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcd0000c00 tx=0x7efcd00047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00b29e0 msgr2=0x7efce0153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00b29e0 0x7efce0153cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c970 tx=0x7efcd400cc80 comp rx=0 tx=0).stop 2023-08-31T02:00:04.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 shutdown_connections 2023-08-31T02:00:04.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efccc06a0e0 0x7efccc06c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce00c5500 0x7efce00af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efce00702b0 0x7efce0069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 --2- 172.21.15.84:0/1519612598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efce00b29e0 0x7efce0153cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 >> 172.21.15.84:0/1519612598 conn(0x7efce00cd740 msgr2=0x7efce00ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 shutdown_connections 2023-08-31T02:00:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.552+0000 7efce6959700 1 -- 172.21.15.84:0/1519612598 wait complete. 2023-08-31T02:00:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-08-31T02:00:04.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:04.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.685+0000 7f66626c8700 1 -- 172.21.15.84:0/3185985830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f665c0ca030 msgr2=0x7f665c0b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.685+0000 7f66626c8700 1 --2- 172.21.15.84:0/3185985830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f665c0ca030 0x7f665c0b2fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6654009f60 tx=0x7f6654009f90 comp rx=0 tx=0).stop 2023-08-31T02:00:04.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.685+0000 7f66626c8700 1 -- 172.21.15.84:0/3185985830 shutdown_connections 2023-08-31T02:00:04.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.685+0000 7f66626c8700 1 --2- 172.21.15.84:0/3185985830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f665c0ca030 0x7f665c0b2fc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.685+0000 7f66626c8700 1 --2- 172.21.15.84:0/3185985830 >> v2:172.21.15.170:3300/0 conn(0x7f665c0c9c00 0x7f665c0b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.685+0000 7f66626c8700 1 -- 172.21.15.84:0/3185985830 >> 172.21.15.84:0/3185985830 conn(0x7f665c0ca930 msgr2=0x7f665c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:04.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.685+0000 7f66626c8700 1 -- 172.21.15.84:0/3185985830 shutdown_connections 2023-08-31T02:00:04.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.685+0000 7f66626c8700 1 -- 172.21.15.84:0/3185985830 wait complete. 2023-08-31T02:00:04.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.687+0000 7f66626c8700 1 Processor -- start 2023-08-31T02:00:04.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.687+0000 7f66626c8700 1 -- start start 2023-08-31T02:00:04.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f66626c8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f665c0c8500 0x7f665c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f66626c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0c9c00 0x7f665c06a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f66626c8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f665c0ca030 0x7f665c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f66626c8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0abb10 con 0x7f665c0c9c00 2023-08-31T02:00:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f66626c8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0aaa70 con 0x7f665c0ca030 2023-08-31T02:00:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f66626c8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0aad50 con 0x7f665c0c8500 2023-08-31T02:00:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0c9c00 0x7f665c06a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0c9c00 0x7f665c06a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50890/0 (socket says 172.21.15.84:50890) 2023-08-31T02:00:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 -- 172.21.15.84:0/685357368 learned_addr learned my addr 172.21.15.84:0/685357368 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f6660c65700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f665c0ca030 0x7f665c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665bfff700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f665c0c8500 0x7f665c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 -- 172.21.15.84:0/685357368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f665c0c8500 msgr2=0x7f665c14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f665c0c8500 0x7f665c14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 -- 172.21.15.84:0/685357368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f665c0ca030 msgr2=0x7f665c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f665c0ca030 0x7f665c06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 -- 172.21.15.84:0/685357368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654009c40 con 0x7f665c0c9c00 2023-08-31T02:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f665b7fe700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0c9c00 0x7f665c06a230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f664c00e970 tx=0x7f664c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f6658ff9700 1 -- 172.21.15.84:0/685357368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c009790 con 0x7f665c0c9c00 2023-08-31T02:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f6658ff9700 1 -- 172.21.15.84:0/685357368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f664c00cbd0 con 0x7f665c0c9c00 2023-08-31T02:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c0ab030 con 0x7f665c0c9c00 2023-08-31T02:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f6658ff9700 1 -- 172.21.15.84:0/685357368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c004020 con 0x7f665c0c9c00 2023-08-31T02:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.688+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c0ab5f0 con 0x7f665c0c9c00 2023-08-31T02:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.689+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c04e7c0 con 0x7f665c0c9c00 2023-08-31T02:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.690+0000 7f6658ff9700 1 -- 172.21.15.84:0/685357368 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f664c004180 con 0x7f665c0c9c00 2023-08-31T02:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.690+0000 7f6658ff9700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f664806a0e0 0x7f664806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.690+0000 7f6658ff9700 1 -- 172.21.15.84:0/685357368 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f664c014070 con 0x7f665c0c9c00 2023-08-31T02:00:04.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.690+0000 7f665bfff700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f664806a0e0 0x7f664806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:04.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.690+0000 7f665bfff700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f664806a0e0 0x7f664806c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6650004740 tx=0x7f6650009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:04.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.694+0000 7f6658ff9700 1 -- 172.21.15.84:0/685357368 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f664c054630 con 0x7f665c0c9c00 2023-08-31T02:00:04.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.881+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f665c0cb840 con 0x7f665c0c9c00 2023-08-31T02:00:04.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.882+0000 7f6658ff9700 1 -- 172.21.15.84:0/685357368 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f664c057c50 con 0x7f665c0c9c00 2023-08-31T02:00:04.875 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:04.876 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:04.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f664806a0e0 msgr2=0x7f664806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f664806a0e0 0x7f664806c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6650004740 tx=0x7f6650009040 comp rx=0 tx=0).stop 2023-08-31T02:00:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0c9c00 msgr2=0x7f665c06a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0c9c00 0x7f665c06a230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f664c00e970 tx=0x7f664c00ed30 comp rx=0 tx=0).stop 2023-08-31T02:00:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 shutdown_connections 2023-08-31T02:00:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f664806a0e0 0x7f664806c5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f665c0ca030 0x7f665c06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f665c0c8500 0x7f665c14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 --2- 172.21.15.84:0/685357368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0c9c00 0x7f665c06a230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 >> 172.21.15.84:0/685357368 conn(0x7f665c0ca930 msgr2=0x7f665c0c6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 shutdown_connections 2023-08-31T02:00:04.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:04.884+0000 7f66626c8700 1 -- 172.21.15.84:0/685357368 wait complete. 2023-08-31T02:00:04.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:05.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.019+0000 7f4b0b85d700 1 -- 172.21.15.84:0/4207764090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b4800 msgr2=0x7f4b040b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.019+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/4207764090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b4800 0x7f4b040b2cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009f60 tx=0x7f4afc009f90 comp rx=0 tx=0).stop 2023-08-31T02:00:05.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.019+0000 7f4b0b85d700 1 -- 172.21.15.84:0/4207764090 shutdown_connections 2023-08-31T02:00:05.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.019+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/4207764090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b4800 0x7f4b040b2cb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.019+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/4207764090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b040b03c0 0x7f4b040b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.019+0000 7f4b0b85d700 1 -- 172.21.15.84:0/4207764090 >> 172.21.15.84:0/4207764090 conn(0x7f4b040cdcb0 msgr2=0x7f4b040ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:05.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.019+0000 7f4b0b85d700 1 -- 172.21.15.84:0/4207764090 shutdown_connections 2023-08-31T02:00:05.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.019+0000 7f4b0b85d700 1 -- 172.21.15.84:0/4207764090 wait complete. 2023-08-31T02:00:05.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.020+0000 7f4b0b85d700 1 Processor -- start 2023-08-31T02:00:05.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b0b85d700 1 -- start start 2023-08-31T02:00:05.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b0b85d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b03c0 0x7f4b040cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b0b85d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b040b4800 0x7f4b040c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b0b85d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b0415b320 0x7f4b040c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b0b85d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040c52a0 con 0x7f4b040b03c0 2023-08-31T02:00:05.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b0b85d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040c5520 con 0x7f4b0415b320 2023-08-31T02:00:05.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b0b85d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040c5800 con 0x7f4b040b4800 2023-08-31T02:00:05.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b095f9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b03c0 0x7f4b040cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b095f9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b03c0 0x7f4b040cae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50902/0 (socket says 172.21.15.84:50902) 2023-08-31T02:00:05.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.021+0000 7f4b095f9700 1 -- 172.21.15.84:0/1837076996 learned_addr learned my addr 172.21.15.84:0/1837076996 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:05.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b095f9700 1 -- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b040b4800 msgr2=0x7f4b040c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b09dfa700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b0415b320 0x7f4b040c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b08df8700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b040b4800 0x7f4b040c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b095f9700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b040b4800 0x7f4b040c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b095f9700 1 -- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b0415b320 msgr2=0x7f4b040c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b095f9700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b0415b320 0x7f4b040c65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b095f9700 1 -- 172.21.15.84:0/1837076996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc009c40 con 0x7f4b040b03c0 2023-08-31T02:00:05.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b08df8700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b040b4800 0x7f4b040c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:05.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b095f9700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b03c0 0x7f4b040cae40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c550 tx=0x7f4af400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:05.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4af9ffb700 1 -- 172.21.15.84:0/1837076996 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af40054e0 con 0x7f4b040b03c0 2023-08-31T02:00:05.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4af9ffb700 1 -- 172.21.15.84:0/1837076996 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4af4003680 con 0x7f4b040b03c0 2023-08-31T02:00:05.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b040c5ae0 con 0x7f4b040b03c0 2023-08-31T02:00:05.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4af9ffb700 1 -- 172.21.15.84:0/1837076996 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4003a90 con 0x7f4b040b03c0 2023-08-31T02:00:05.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.022+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b040c60a0 con 0x7f4b040b03c0 2023-08-31T02:00:05.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.023+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0404e7c0 con 0x7f4b040b03c0 2023-08-31T02:00:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.023+0000 7f4af9ffb700 1 -- 172.21.15.84:0/1837076996 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4af4003bf0 con 0x7f4b040b03c0 2023-08-31T02:00:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.024+0000 7f4af9ffb700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ae806a0e0 0x7f4ae806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.024+0000 7f4af9ffb700 1 -- 172.21.15.84:0/1837076996 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4af4087d70 con 0x7f4b040b03c0 2023-08-31T02:00:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.024+0000 7f4b08df8700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ae806a0e0 0x7f4ae806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.024+0000 7f4b08df8700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ae806a0e0 0x7f4ae806c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b00005fd0 tx=0x7f4b00005e40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.028+0000 7f4af9ffb700 1 -- 172.21.15.84:0/1837076996 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4af4053260 con 0x7f4b040b03c0 2023-08-31T02:00:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.224+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b040c6bc0 con 0x7f4b040b03c0 2023-08-31T02:00:05.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.225+0000 7f4af9ffb700 1 -- 172.21.15.84:0/1837076996 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f4af4017020 con 0x7f4b040b03c0 2023-08-31T02:00:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:05.222 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ae806a0e0 msgr2=0x7f4ae806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ae806a0e0 0x7f4ae806c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b00005fd0 tx=0x7f4b00005e40 comp rx=0 tx=0).stop 2023-08-31T02:00:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b03c0 msgr2=0x7f4b040cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b03c0 0x7f4b040cae40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c550 tx=0x7f4af400c910 comp rx=0 tx=0).stop 2023-08-31T02:00:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 shutdown_connections 2023-08-31T02:00:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ae806a0e0 0x7f4ae806c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b0415b320 0x7f4b040c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b040b03c0 0x7f4b040cae40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 --2- 172.21.15.84:0/1837076996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b040b4800 0x7f4b040c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 >> 172.21.15.84:0/1837076996 conn(0x7f4b040cdcb0 msgr2=0x7f4b040b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 shutdown_connections 2023-08-31T02:00:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.228+0000 7f4b0b85d700 1 -- 172.21.15.84:0/1837076996 wait complete. 2023-08-31T02:00:05.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:00:05.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.375+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/2714608842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280cc920 msgr2=0x7f0a280c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.375+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/2714608842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280cc920 0x7f0a280c9ac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a180098c0 tx=0x7f0a18009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.375+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/2714608842 shutdown_connections 2023-08-31T02:00:05.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.375+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/2714608842 >> v2:172.21.15.170:3300/0 conn(0x7f0a280707c0 0x7f0a28070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.375+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/2714608842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280cc920 0x7f0a280c9ac0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.375+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/2714608842 >> 172.21.15.84:0/2714608842 conn(0x7f0a280caa20 msgr2=0x7f0a280cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:05.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.375+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/2714608842 shutdown_connections 2023-08-31T02:00:05.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.375+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/2714608842 wait complete. 2023-08-31T02:00:05.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.376+0000 7f0a2f4d1700 1 Processor -- start 2023-08-31T02:00:05.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2f4d1700 1 -- start start 2023-08-31T02:00:05.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2f4d1700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280707c0 0x7f0a280c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2f4d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a280cc920 0x7f0a281ee430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2f4d1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a28158220 0x7f0a280c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2f4d1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280c6e70 con 0x7f0a280cc920 2023-08-31T02:00:05.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2f4d1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a281ef5c0 con 0x7f0a28158220 2023-08-31T02:00:05.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2f4d1700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a281eeef0 con 0x7f0a280707c0 2023-08-31T02:00:05.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2ca6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a280cc920 0x7f0a281ee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2ca6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a280cc920 0x7f0a281ee430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50916/0 (socket says 172.21.15.84:50916) 2023-08-31T02:00:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.377+0000 7f0a2ca6c700 1 -- 172.21.15.84:0/390166440 learned_addr learned my addr 172.21.15.84:0/390166440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2d26d700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280707c0 0x7f0a280c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2da6e700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a28158220 0x7f0a280c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2ca6c700 1 -- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280707c0 msgr2=0x7f0a280c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2ca6c700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280707c0 0x7f0a280c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2ca6c700 1 -- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a28158220 msgr2=0x7f0a280c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2ca6c700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a28158220 0x7f0a280c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2ca6c700 1 -- 172.21.15.84:0/390166440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a18009520 con 0x7f0a280cc920 2023-08-31T02:00:05.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2d26d700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280707c0 0x7f0a280c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:05.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2ca6c700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a280cc920 0x7f0a281ee430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009230 tx=0x7f0a1800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:05.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a1dffb700 1 -- 172.21.15.84:0/390166440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1800fdf0 con 0x7f0a280cc920 2023-08-31T02:00:05.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a1dffb700 1 -- 172.21.15.84:0/390166440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0a18004830 con 0x7f0a280cc920 2023-08-31T02:00:05.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a281ef1d0 con 0x7f0a280cc920 2023-08-31T02:00:05.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a1dffb700 1 -- 172.21.15.84:0/390166440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18004c40 con 0x7f0a280cc920 2023-08-31T02:00:05.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.378+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a281efaf0 con 0x7f0a280cc920 2023-08-31T02:00:05.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.379+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a281efce0 con 0x7f0a280cc920 2023-08-31T02:00:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.380+0000 7f0a1dffb700 1 -- 172.21.15.84:0/390166440 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a18004da0 con 0x7f0a280cc920 2023-08-31T02:00:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.380+0000 7f0a1dffb700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a0c06a0e0 0x7f0a0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.380+0000 7f0a1dffb700 1 -- 172.21.15.84:0/390166440 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a1808c4c0 con 0x7f0a280cc920 2023-08-31T02:00:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.380+0000 7f0a2d26d700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a0c06a0e0 0x7f0a0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.380+0000 7f0a2d26d700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a0c06a0e0 0x7f0a0c06c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0a2815a630 tx=0x7f0a24009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.384+0000 7f0a1dffb700 1 -- 172.21.15.84:0/390166440 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0a18057a40 con 0x7f0a280cc920 2023-08-31T02:00:05.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.617+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a2804e7c0 con 0x7f0a280cc920 2023-08-31T02:00:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.618+0000 7f0a1dffb700 1 -- 172.21.15.84:0/390166440 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f0a1805b060 con 0x7f0a280cc920 2023-08-31T02:00:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:05.611 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:04.160267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-31T02:00:05.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a0c06a0e0 msgr2=0x7f0a0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a0c06a0e0 0x7f0a0c06c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0a2815a630 tx=0x7f0a24009040 comp rx=0 tx=0).stop 2023-08-31T02:00:05.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a280cc920 msgr2=0x7f0a281ee430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a280cc920 0x7f0a281ee430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009230 tx=0x7f0a1800f740 comp rx=0 tx=0).stop 2023-08-31T02:00:05.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 shutdown_connections 2023-08-31T02:00:05.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0a0c06a0e0 0x7f0a0c06c5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a28158220 0x7f0a280c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a280707c0 0x7f0a280c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 --2- 172.21.15.84:0/390166440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a280cc920 0x7f0a281ee430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 >> 172.21.15.84:0/390166440 conn(0x7f0a280caa20 msgr2=0x7f0a28157350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 shutdown_connections 2023-08-31T02:00:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.620+0000 7f0a2f4d1700 1 -- 172.21.15.84:0/390166440 wait complete. 2023-08-31T02:00:05.616 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-08-31T02:00:05.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:05.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.753+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/3045815608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 msgr2=0x7f5bc4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.753+0000 7f5bdaf4b700 1 --2- 172.21.15.84:0/3045815608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 0x7f5bc4004cd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009bb0 tx=0x7f5bc4005880 comp rx=0 tx=0).stop 2023-08-31T02:00:05.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.753+0000 7f5bd94e8700 1 -- 172.21.15.84:0/3045815608 reap_dead start 2023-08-31T02:00:05.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.753+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/3045815608 shutdown_connections 2023-08-31T02:00:05.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.753+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/3045815608 >> 172.21.15.84:0/3045815608 conn(0x7f5bd40caa20 msgr2=0x7f5bd40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:05.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.753+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/3045815608 shutdown_connections 2023-08-31T02:00:05.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.753+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/3045815608 wait complete. 2023-08-31T02:00:05.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.755+0000 7f5bdaf4b700 1 Processor -- start 2023-08-31T02:00:05.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.755+0000 7f5bdaf4b700 1 -- start start 2023-08-31T02:00:05.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.755+0000 7f5bdaf4b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 0x7f5bd41545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.755+0000 7f5bdaf4b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bd40c3ab0 0x7f5bd406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.755+0000 7f5bdaf4b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bd40c3f30 0x7f5bd406a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.755+0000 7f5bdaf4b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41541a0 con 0x7f5bc4004850 2023-08-31T02:00:05.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.755+0000 7f5bdaf4b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4153520 con 0x7f5bd40c3f30 2023-08-31T02:00:05.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.755+0000 7f5bdaf4b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4153800 con 0x7f5bd40c3ab0 2023-08-31T02:00:05.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 0x7f5bd41545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 0x7f5bd41545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50934/0 (socket says 172.21.15.84:50934) 2023-08-31T02:00:05.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 -- 172.21.15.84:0/2470193016 learned_addr learned my addr 172.21.15.84:0/2470193016 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:05.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 -- 172.21.15.84:0/2470193016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bd40c3ab0 msgr2=0x7f5bd406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bd40c3ab0 0x7f5bd406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 -- 172.21.15.84:0/2470193016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bd40c3f30 msgr2=0x7f5bd406a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bd40c3f30 0x7f5bd406a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 -- 172.21.15.84:0/2470193016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4153ae0 con 0x7f5bc4004850 2023-08-31T02:00:05.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd8ce7700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 0x7f5bd41545c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800e6d0 tx=0x7f5bc800ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:05.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd17fa700 1 -- 172.21.15.84:0/2470193016 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8010890 con 0x7f5bc4004850 2023-08-31T02:00:05.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd17fa700 1 -- 172.21.15.84:0/2470193016 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5bc8010ae0 con 0x7f5bc4004850 2023-08-31T02:00:05.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd4153dc0 con 0x7f5bc4004850 2023-08-31T02:00:05.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bd17fa700 1 -- 172.21.15.84:0/2470193016 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8010e90 con 0x7f5bc4004850 2023-08-31T02:00:05.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.756+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd4155490 con 0x7f5bc4004850 2023-08-31T02:00:05.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.757+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd41542e0 con 0x7f5bc4004850 2023-08-31T02:00:05.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.757+0000 7f5bd17fa700 1 -- 172.21.15.84:0/2470193016 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5bc8011460 con 0x7f5bc4004850 2023-08-31T02:00:05.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.758+0000 7f5bd17fa700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5bb806a0e0 0x7f5bb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:05.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.758+0000 7f5bd3fff700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5bb806a0e0 0x7f5bb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:05.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.758+0000 7f5bd17fa700 1 -- 172.21.15.84:0/2470193016 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5bc8088e50 con 0x7f5bc4004850 2023-08-31T02:00:05.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.758+0000 7f5bd3fff700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5bb806a0e0 0x7f5bb806c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4143c10 tx=0x7f5bc00047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:05.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.762+0000 7f5bd17fa700 1 -- 172.21.15.84:0/2470193016 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5bd41542e0 con 0x7f5bc4004850 2023-08-31T02:00:05.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.951+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bd41542e0 con 0x7f5bc4004850 2023-08-31T02:00:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.952+0000 7f5bd17fa700 1 -- 172.21.15.84:0/2470193016 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f5bd41542e0 con 0x7f5bc4004850 2023-08-31T02:00:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:05.945 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:05.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5bb806a0e0 msgr2=0x7f5bb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5bb806a0e0 0x7f5bb806c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4143c10 tx=0x7f5bc00047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 msgr2=0x7f5bd41545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:05.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 0x7f5bd41545c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800e6d0 tx=0x7f5bc800ea90 comp rx=0 tx=0).stop 2023-08-31T02:00:05.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 shutdown_connections 2023-08-31T02:00:05.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5bb806a0e0 0x7f5bb806c5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bd40c3f30 0x7f5bd406a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bc4004850 0x7f5bd41545c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 --2- 172.21.15.84:0/2470193016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bd40c3ab0 0x7f5bd406a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:05.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 >> 172.21.15.84:0/2470193016 conn(0x7f5bd40caa20 msgr2=0x7f5bd415a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:05.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 shutdown_connections 2023-08-31T02:00:05.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:05.954+0000 7f5bdaf4b700 1 -- 172.21.15.84:0/2470193016 wait complete. 2023-08-31T02:00:06.362 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T01:59:58.513035+0000', 'modified': '2023-08-31T02:00:04.160267+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4362}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4362': {'gid': 4362, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6835/2233754260', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6833', 'nonce': 2233754260}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 2233754260}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-08-31T02:00:06.363 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T02:00:06.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-31T02:00:06.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.495+0000 7f29784bd700 1 -- 172.21.15.84:0/1643802946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29700c99b0 msgr2=0x7f29700708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.495+0000 7f29784bd700 1 --2- 172.21.15.84:0/1643802946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29700c99b0 0x7f29700708a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f296c0098c0 tx=0x7f296c009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.496+0000 7f29784bd700 1 -- 172.21.15.84:0/1643802946 shutdown_connections 2023-08-31T02:00:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.496+0000 7f29784bd700 1 --2- 172.21.15.84:0/1643802946 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2970158120 0x7f29700b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.496+0000 7f29784bd700 1 --2- 172.21.15.84:0/1643802946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29700c99b0 0x7f29700708a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.496+0000 7f29784bd700 1 -- 172.21.15.84:0/1643802946 >> 172.21.15.84:0/1643802946 conn(0x7f29700cdeb0 msgr2=0x7f29700ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.496+0000 7f29784bd700 1 -- 172.21.15.84:0/1643802946 shutdown_connections 2023-08-31T02:00:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.496+0000 7f29784bd700 1 -- 172.21.15.84:0/1643802946 wait complete. 2023-08-31T02:00:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.497+0000 7f29784bd700 1 Processor -- start 2023-08-31T02:00:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.497+0000 7f29784bd700 1 -- start start 2023-08-31T02:00:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f29784bd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29700b0d00 0x7f29700c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f29784bd700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29700c99b0 0x7f29700c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f29784bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2970158120 0x7f297006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f29784bd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c6db0 con 0x7f2970158120 2023-08-31T02:00:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f29784bd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c57d0 con 0x7f29700b0d00 2023-08-31T02:00:06.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f29784bd700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c5ab0 con 0x7f29700c99b0 2023-08-31T02:00:06.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2970158120 0x7f297006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2970158120 0x7f297006d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50952/0 (socket says 172.21.15.84:50952) 2023-08-31T02:00:06.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 -- 172.21.15.84:0/174851528 learned_addr learned my addr 172.21.15.84:0/174851528 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:06.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 -- 172.21.15.84:0/174851528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29700c99b0 msgr2=0x7f29700c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2975a58700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29700c99b0 0x7f29700c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976259700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29700b0d00 0x7f29700c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29700c99b0 0x7f29700c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 -- 172.21.15.84:0/174851528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29700b0d00 msgr2=0x7f29700c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29700b0d00 0x7f29700c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 -- 172.21.15.84:0/174851528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c009520 con 0x7f2970158120 2023-08-31T02:00:06.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2976a5a700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2970158120 0x7f297006d8a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f296800c7c0 tx=0x7f296800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:06.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2966ffd700 1 -- 172.21.15.84:0/174851528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968003e30 con 0x7f2970158120 2023-08-31T02:00:06.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2966ffd700 1 -- 172.21.15.84:0/174851528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2968005070 con 0x7f2970158120 2023-08-31T02:00:06.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f29784bd700 1 -- 172.21.15.84:0/174851528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29700c5d90 con 0x7f2970158120 2023-08-31T02:00:06.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f2966ffd700 1 -- 172.21.15.84:0/174851528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968005480 con 0x7f2970158120 2023-08-31T02:00:06.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.498+0000 7f29784bd700 1 -- 172.21.15.84:0/174851528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700c6350 con 0x7f2970158120 2023-08-31T02:00:06.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.500+0000 7f2966ffd700 1 -- 172.21.15.84:0/174851528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f29680055e0 con 0x7f2970158120 2023-08-31T02:00:06.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.500+0000 7f2966ffd700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f295406a0e0 0x7f295406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.500+0000 7f2966ffd700 1 -- 172.21.15.84:0/174851528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29680884f0 con 0x7f2970158120 2023-08-31T02:00:06.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.500+0000 7f2976259700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f295406a0e0 0x7f295406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.501+0000 7f2976259700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f295406a0e0 0x7f295406c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2960005950 tx=0x7f29600058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:06.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.502+0000 7f2984660b80 1 Processor -- start 2023-08-31T02:00:06.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.502+0000 7f2984660b80 1 -- start start 2023-08-31T02:00:06.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2984660b80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x5654401027c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2984660b80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654400e08a0 0x5654400de630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2984660b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2984660b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544003b730 con 0x56544010a4a0 2023-08-31T02:00:06.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2984660b80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x565440039050 con 0x5654401023e0 2023-08-31T02:00:06.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2984660b80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x565440034940 con 0x5654400e08a0 2023-08-31T02:00:06.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400e0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50960/0 (socket says 172.21.15.84:50960) 2023-08-31T02:00:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 -- 172.21.15.84:0/2873816517 learned_addr learned my addr 172.21.15.84:0/2873816517 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976259700 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x5654401027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2975a58700 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654400e08a0 0x5654400de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 -- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654400e08a0 msgr2=0x5654400de630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654400e08a0 0x5654400de630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 -- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 msgr2=0x5654401027c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x5654401027c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 -- 172.21.15.84:0/2873816517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56543feb45e0 con 0x56544010a4a0 2023-08-31T02:00:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2975a58700 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654400e08a0 0x5654400de630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976259700 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x5654401027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.503+0000 7f2976a5a700 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400e0f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f296805ef80 tx=0x7f296800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f467b38636db8537 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2953fff700 1 -- 172.21.15.84:0/2873816517 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968057730 con 0x56544010a4a0 2023-08-31T02:00:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2953fff700 1 -- 172.21.15.84:0/2873816517 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f296805f4b0 con 0x56544010a4a0 2023-08-31T02:00:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2953fff700 1 -- 172.21.15.84:0/2873816517 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296805b150 con 0x56544010a4a0 2023-08-31T02:00:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 -- 172.21.15.84:0/2873816517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 msgr2=0x5654400e0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400e0f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f296805ef80 tx=0x7f296800f000 comp rx=0 tx=0).stop 2023-08-31T02:00:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 -- 172.21.15.84:0/2873816517 shutdown_connections 2023-08-31T02:00:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400e0f50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x5654401027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 --2- 172.21.15.84:0/2873816517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654400e08a0 0x5654400de630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 -- 172.21.15.84:0/2873816517 >> 172.21.15.84:0/2873816517 conn(0x565440057090 msgr2=0x5654401281c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 -- 172.21.15.84:0/2873816517 shutdown_connections 2023-08-31T02:00:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.504+0000 7f2984660b80 1 -- 172.21.15.84:0/2873816517 wait complete. 2023-08-31T02:00:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.505+0000 7f2984660b80 1 -- start start 2023-08-31T02:00:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.505+0000 7f2984660b80 1 Processor -- start 2023-08-31T02:00:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2984660b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x565440111010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2984660b80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654401218f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2984660b80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56544010a4a0 0x5654400ff940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2984660b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543ffd2b60 con 0x5654400e08a0 2023-08-31T02:00:06.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2984660b80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543ffd2860 con 0x56544010a4a0 2023-08-31T02:00:06.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2984660b80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x56543feb68d0 con 0x5654401023e0 2023-08-31T02:00:06.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2984660b80 10 client.0 _ll_register_callbacks cb 0x56543ff1ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T02:00:06.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976259700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x565440111010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976259700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x565440111010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50962/0 (socket says 172.21.15.84:50962) 2023-08-31T02:00:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976259700 1 -- 172.21.15.84:0/4274302533 learned_addr learned my addr 172.21.15.84:0/4274302533 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2975a58700 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654401218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976a5a700 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56544010a4a0 0x5654400ff940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976259700 1 -- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 msgr2=0x5654401218f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976259700 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654401218f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976259700 1 -- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56544010a4a0 msgr2=0x5654400ff940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976259700 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56544010a4a0 0x5654400ff940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2976259700 1 -- 172.21.15.84:0/4274302533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700c6350 con 0x5654400e08a0 2023-08-31T02:00:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.506+0000 7f2975a58700 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654401218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:06.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2976259700 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x565440111010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f29600117a0 tx=0x7f2960004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cca7247ab14e4c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:06.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f29517fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-08-31T02:00:06.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f29517fa700 1 -- 172.21.15.84:0/4274302533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296001f830 con 0x5654400e08a0 2023-08-31T02:00:06.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f29517fa700 1 -- 172.21.15.84:0/4274302533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f296001f990 con 0x5654400e08a0 2023-08-31T02:00:06.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 1 -- 172.21.15.84:0/4274302533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654400d5970 con 0x5654400e08a0 2023-08-31T02:00:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f29517fa700 1 -- 172.21.15.84:0/4274302533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f296001fb50 con 0x5654400e08a0 2023-08-31T02:00:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 10 client.4503 fetch_fsmap learned FSMap version 7 2023-08-31T02:00:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 1 -- 172.21.15.84:0/4274302533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56543fe60d90 con 0x5654400e08a0 2023-08-31T02:00:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f29517fa700 1 -- 172.21.15.84:0/4274302533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5654400d5970 con 0x5654400e08a0 2023-08-31T02:00:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f29517fa700 1 -- 172.21.15.84:0/4274302533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f296001fcb0 con 0x5654400e08a0 2023-08-31T02:00:06.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 10 client.4503 fetch_fsmap finished waiting for FSMap version 7 2023-08-31T02:00:06.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 10 client.4503 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-31T02:00:06.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 20 client.4503 populate_metadata read hostname 'smithi084' 2023-08-31T02:00:06.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x56544010f820 0x56544013b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 4 client.4503 mds_command: new command op to 4362 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T02:00:06.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2984660b80 1 -- 172.21.15.84:0/4274302533 --> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56544002d920 con 0x56544010f820 2023-08-31T02:00:06.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.507+0000 7f2975a58700 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x56544010f820 0x56544013b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.508+0000 7f29517fa700 10 client.4503 ms_handle_connect on v2:172.21.15.170:6833/2233754260 2023-08-31T02:00:06.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.508+0000 7f2975a58700 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x56544010f820 0x56544013b460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=835b100911898fe2 server_cookie=c3d8167daffc1227 in_seq=0 out_seq=0 2023-08-31T02:00:06.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.508+0000 7f29517fa700 1 -- 172.21.15.84:0/4274302533 <== mds.0 v2:172.21.15.170:6833/2233754260 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56544002d920 con 0x56544010f820 2023-08-31T02:00:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.508+0000 7f29517fa700 10 client.4503 handle_command_reply: tid=0 2023-08-31T02:00:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.508+0000 7f2984660b80 1 client.4503 shutdown 2023-08-31T02:00:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 -- 172.21.15.84:0/4274302533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 msgr2=0x565440111010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x565440111010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f29600117a0 tx=0x7f2960004750 comp rx=0 tx=0).stop 2023-08-31T02:00:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 -- 172.21.15.84:0/4274302533 shutdown_connections 2023-08-31T02:00:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56544010a4a0 0x5654400ff940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x565440111010 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x56544010f820 0x56544013b460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 --2- 172.21.15.84:0/4274302533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654401218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f29517fa700 0 client.4503 ms_handle_reset on v2:172.21.15.170:6833/2233754260 2023-08-31T02:00:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 -- 172.21.15.84:0/4274302533 >> 172.21.15.84:0/4274302533 conn(0x565440057090 msgr2=0x5654400e0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 -- 172.21.15.84:0/4274302533 shutdown_connections 2023-08-31T02:00:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 1 -- 172.21.15.84:0/4274302533 wait complete. 2023-08-31T02:00:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.509+0000 7f2984660b80 20 client.4503 trim_cache size 0 max 16384 2023-08-31T02:00:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.526+0000 7f2984660b80 1 Processor -- start 2023-08-31T02:00:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.526+0000 7f2984660b80 1 -- start start 2023-08-31T02:00:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2984660b80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654400e08a0 0x5654400ff360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2984660b80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654400ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2984660b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400dd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2984660b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654400e32a0 con 0x56544010a4a0 2023-08-31T02:00:06.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2984660b80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654400b88a0 con 0x5654400e08a0 2023-08-31T02:00:06.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2984660b80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x56544010bc10 con 0x5654401023e0 2023-08-31T02:00:06.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2976a5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400dd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2976a5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400dd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50972/0 (socket says 172.21.15.84:50972) 2023-08-31T02:00:06.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2976a5a700 1 -- 172.21.15.84:0/1206175144 learned_addr learned my addr 172.21.15.84:0/1206175144 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:06.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2975a58700 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654400ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2976259700 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654400e08a0 0x5654400ff360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.527+0000 7f2976a5a700 1 -- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 msgr2=0x5654400ff8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:06.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2976a5a700 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654400ff8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2976a5a700 1 -- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654400e08a0 msgr2=0x5654400ff360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:06.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2976a5a700 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654400e08a0 0x5654400ff360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2976a5a700 1 -- 172.21.15.84:0/1206175144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56543fe49c10 con 0x56544010a4a0 2023-08-31T02:00:06.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2976259700 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654400e08a0 0x5654400ff360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:06.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2976a5a700 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400dd160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2968057670 tx=0x7f2968003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab5433e39d031ae server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:06.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2964da2700 1 -- 172.21.15.84:0/1206175144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968057730 con 0x56544010a4a0 2023-08-31T02:00:06.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2964da2700 1 -- 172.21.15.84:0/1206175144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2968055ad0 con 0x56544010a4a0 2023-08-31T02:00:06.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2964da2700 1 -- 172.21.15.84:0/1206175144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296805b150 con 0x56544010a4a0 2023-08-31T02:00:06.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 -- 172.21.15.84:0/1206175144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 msgr2=0x5654400dd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400dd160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2968057670 tx=0x7f2968003f90 comp rx=0 tx=0).stop 2023-08-31T02:00:06.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 -- 172.21.15.84:0/1206175144 shutdown_connections 2023-08-31T02:00:06.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56544010a4a0 0x5654400dd160 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654400e08a0 0x5654400ff360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 --2- 172.21.15.84:0/1206175144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5654401023e0 0x5654400ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 -- 172.21.15.84:0/1206175144 >> 172.21.15.84:0/1206175144 conn(0x565440057090 msgr2=0x56544011f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:06.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 -- 172.21.15.84:0/1206175144 shutdown_connections 2023-08-31T02:00:06.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.528+0000 7f2984660b80 1 -- 172.21.15.84:0/1206175144 wait complete. 2023-08-31T02:00:06.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.529+0000 7f2984660b80 1 -- start start 2023-08-31T02:00:06.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.529+0000 7f2984660b80 1 Processor -- start 2023-08-31T02:00:06.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2984660b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x5654401087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2984660b80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x565440108d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2984660b80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56544010a4a0 0x56544012b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2984660b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x565440191740 con 0x5654400e08a0 2023-08-31T02:00:06.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2984660b80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654400ff6a0 con 0x5654401023e0 2023-08-31T02:00:06.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2984660b80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x56544011db50 con 0x56544010a4a0 2023-08-31T02:00:06.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2984660b80 10 client.0 _ll_register_callbacks cb 0x7f296000ed90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T02:00:06.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x5654401087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x5654401087f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50976/0 (socket says 172.21.15.84:50976) 2023-08-31T02:00:06.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 -- 172.21.15.84:0/4282301564 learned_addr learned my addr 172.21.15.84:0/4282301564 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:06.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2975a58700 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x565440108d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976a5a700 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56544010a4a0 0x56544012b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 -- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56544010a4a0 msgr2=0x56544012b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:06.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56544010a4a0 0x56544012b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 -- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 msgr2=0x565440108d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x565440108d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 -- 172.21.15.84:0/4282301564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56543feb45e0 con 0x5654400e08a0 2023-08-31T02:00:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2975a58700 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x565440108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f2976259700 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x5654401087f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f296002c040 tx=0x7f296000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed8fbf053a74317 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f29517fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-08-31T02:00:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.530+0000 7f29517fa700 1 -- 172.21.15.84:0/4282301564 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960037070 con 0x5654400e08a0 2023-08-31T02:00:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f29517fa700 1 -- 172.21.15.84:0/4282301564 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f296001f630 con 0x5654400e08a0 2023-08-31T02:00:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 1 -- 172.21.15.84:0/4282301564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f296805f4b0 con 0x5654400e08a0 2023-08-31T02:00:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f29517fa700 1 -- 172.21.15.84:0/4282301564 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f296001f7f0 con 0x5654400e08a0 2023-08-31T02:00:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 10 client.4509 fetch_fsmap learned FSMap version 7 2023-08-31T02:00:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 1 -- 172.21.15.84:0/4282301564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56543fe87200 con 0x5654400e08a0 2023-08-31T02:00:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f29517fa700 1 -- 172.21.15.84:0/4282301564 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f296805f4b0 con 0x5654400e08a0 2023-08-31T02:00:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f29517fa700 1 -- 172.21.15.84:0/4282301564 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f296001f950 con 0x5654400e08a0 2023-08-31T02:00:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 10 client.4509 fetch_fsmap finished waiting for FSMap version 7 2023-08-31T02:00:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 10 client.4509 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-31T02:00:06.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 20 client.4509 populate_metadata read hostname 'smithi084' 2023-08-31T02:00:06.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x56544012bc80 0x56544012c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 4 client.4509 mds_command: new command op to 4362 tid=0[{"prefix": "status"}] 2023-08-31T02:00:06.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2984660b80 1 -- 172.21.15.84:0/4282301564 --> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56543ffee000 con 0x56544012bc80 2023-08-31T02:00:06.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2975a58700 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x56544012bc80 0x56544012c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f2975a58700 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x56544012bc80 0x56544012c060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ecffc10b640094 server_cookie=8c8f5ae37cf50bfc in_seq=0 out_seq=0 2023-08-31T02:00:06.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.531+0000 7f29517fa700 10 client.4509 ms_handle_connect on v2:172.21.15.170:6833/2233754260 2023-08-31T02:00:06.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f29517fa700 1 -- 172.21.15.84:0/4282301564 <== mds.0 v2:172.21.15.170:6833/2233754260 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x56543ffee000 con 0x56544012bc80 2023-08-31T02:00:06.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f29517fa700 10 client.4509 handle_command_reply: tid=0 2023-08-31T02:00:06.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 client.4509 shutdown 2023-08-31T02:00:06.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 -- 172.21.15.84:0/4282301564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 msgr2=0x5654401087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x5654401087f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f296002c040 tx=0x7f296000e890 comp rx=0 tx=0).stop 2023-08-31T02:00:06.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 -- 172.21.15.84:0/4282301564 shutdown_connections 2023-08-31T02:00:06.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x56544012bc80 0x56544012c060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56544010a4a0 0x56544012b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f29517fa700 0 client.4509 ms_handle_reset on v2:172.21.15.170:6833/2233754260 2023-08-31T02:00:06.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654400e08a0 0x5654401087f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 --2- 172.21.15.84:0/4282301564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654401023e0 0x565440108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 -- 172.21.15.84:0/4282301564 >> 172.21.15.84:0/4282301564 conn(0x565440057090 msgr2=0x5654400dd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:06.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 -- 172.21.15.84:0/4282301564 shutdown_connections 2023-08-31T02:00:06.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 1 -- 172.21.15.84:0/4282301564 wait complete. 2023-08-31T02:00:06.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f2984660b80 20 client.4509 trim_cache size 0 max 16384 2023-08-31T02:00:06.547 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:00:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3192a6ac-325f-4185-9b3a-d848f695e6dd", 2023-08-31T02:00:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-08-31T02:00:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4362, 2023-08-31T02:00:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-08-31T02:00:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-08-31T02:00:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-08-31T02:00:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 7.396702457, 2023-08-31T02:00:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 7, 2023-08-31T02:00:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 26, 2023-08-31T02:00:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 26, 2023-08-31T02:00:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 14.840043516 2023-08-31T02:00:06.550 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:00:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f29784bd700 1 -- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f295406a0e0 msgr2=0x7f295406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f29784bd700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f295406a0e0 0x7f295406c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2960005950 tx=0x7f29600058e0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f29784bd700 1 -- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2970158120 msgr2=0x7f297006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.532+0000 7f29784bd700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2970158120 0x7f297006d8a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f296800c7c0 tx=0x7f296800cb80 comp rx=0 tx=0).stop 2023-08-31T02:00:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.533+0000 7f29784bd700 1 -- 172.21.15.84:0/174851528 shutdown_connections 2023-08-31T02:00:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.533+0000 7f29784bd700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f295406a0e0 0x7f295406c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.533+0000 7f29784bd700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2970158120 0x7f297006d8a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.533+0000 7f29784bd700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29700b0d00 0x7f29700c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.533+0000 7f29784bd700 1 --2- 172.21.15.84:0/174851528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29700c99b0 0x7f29700c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.533+0000 7f29784bd700 1 -- 172.21.15.84:0/174851528 >> 172.21.15.84:0/174851528 conn(0x7f29700cdeb0 msgr2=0x7f2970157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:06.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.533+0000 7f29784bd700 1 -- 172.21.15.84:0/174851528 shutdown_connections 2023-08-31T02:00:06.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.533+0000 7f29784bd700 1 -- 172.21.15.84:0/174851528 wait complete. 2023-08-31T02:00:06.554 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T02:00:06.555 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-31T02:00:06.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T02:00:06.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.684+0000 7f3ca40dc700 1 -- 172.21.15.84:0/598526460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88004d90 msgr2=0x7f3c88005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.684+0000 7f3ca40dc700 1 --2- 172.21.15.84:0/598526460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88004d90 0x7f3c88005210 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c650 tx=0x7f3c88005880 comp rx=0 tx=0).stop 2023-08-31T02:00:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.684+0000 7f3ca2679700 1 -- 172.21.15.84:0/598526460 reap_dead start 2023-08-31T02:00:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.684+0000 7f3ca40dc700 1 -- 172.21.15.84:0/598526460 shutdown_connections 2023-08-31T02:00:06.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.684+0000 7f3ca40dc700 1 -- 172.21.15.84:0/598526460 >> 172.21.15.84:0/598526460 conn(0x7f3c9c0caa20 msgr2=0x7f3c9c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.684+0000 7f3ca40dc700 1 -- 172.21.15.84:0/598526460 shutdown_connections 2023-08-31T02:00:06.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.684+0000 7f3ca40dc700 1 -- 172.21.15.84:0/598526460 wait complete. 2023-08-31T02:00:06.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.686+0000 7f3ca40dc700 1 Processor -- start 2023-08-31T02:00:06.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.686+0000 7f3ca40dc700 1 -- start start 2023-08-31T02:00:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca40dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c0b19b0 0x7f3c9c1e3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca40dc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c9c1e0bc0 0x7f3c9c1e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca40dc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c9c0b1d90 0x7f3c9c1f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca40dc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c1e1820 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca40dc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c1eec00 con 0x7f3c9c1e0bc0 2023-08-31T02:00:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca40dc700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c1eeee0 con 0x7f3c9c0b1d90 2023-08-31T02:00:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c0b19b0 0x7f3c9c1e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c0b19b0 0x7f3c9c1e3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50996/0 (socket says 172.21.15.84:50996) 2023-08-31T02:00:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 -- 172.21.15.84:0/3973069741 learned_addr learned my addr 172.21.15.84:0/3973069741 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca2679700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c9c0b1d90 0x7f3c9c1f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1677700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c9c1e0bc0 0x7f3c9c1e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 -- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c9c0b1d90 msgr2=0x7f3c9c1f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c9c0b1d90 0x7f3c9c1f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 -- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c9c1e0bc0 msgr2=0x7f3c9c1e12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c9c1e0bc0 0x7f3c9c1e12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 -- 172.21.15.84:0/3973069741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c1ef1c0 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca2679700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c9c0b1d90 0x7f3c9c1f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1677700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c9c1e0bc0 0x7f3c9c1e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca1e78700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c0b19b0 0x7f3c9c1e3510 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800dee0 tx=0x7f3c9800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3c927fc700 1 -- 172.21.15.84:0/3973069741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9800bb60 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3c927fc700 1 -- 172.21.15.84:0/3973069741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3c98016070 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c1ef4a0 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.687+0000 7f3c927fc700 1 -- 172.21.15.84:0/3973069741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004830 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.688+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c1f26a0 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.688+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c04e7c0 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.689+0000 7f3c927fc700 1 -- 172.21.15.84:0/3973069741 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c98004990 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.689+0000 7f3c927fc700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c8006a0e0 0x7f3c8006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.689+0000 7f3c927fc700 1 -- 172.21.15.84:0/3973069741 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c98018070 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.689+0000 7f3ca1677700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c8006a0e0 0x7f3c8006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.690+0000 7f3ca1677700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c8006a0e0 0x7f3c8006c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0aea10 tx=0x7f3c8c00b2e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.693+0000 7f3c927fc700 1 -- 172.21.15.84:0/3973069741 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c98056390 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.926+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c9c06b870 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.926+0000 7f3c927fc700 1 -- 172.21.15.84:0/3973069741 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3c980599b0 con 0x7f3c9c0b19b0 2023-08-31T02:00:06.919 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T02:00:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c8006a0e0 msgr2=0x7f3c8006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c8006a0e0 0x7f3c8006c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0aea10 tx=0x7f3c8c00b2e0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c0b19b0 msgr2=0x7f3c9c1e3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c0b19b0 0x7f3c9c1e3510 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800dee0 tx=0x7f3c9800fce0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 shutdown_connections 2023-08-31T02:00:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c8006a0e0 0x7f3c8006c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c9c0b1d90 0x7f3c9c1f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c0b19b0 0x7f3c9c1e3510 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 --2- 172.21.15.84:0/3973069741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c9c1e0bc0 0x7f3c9c1e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 >> 172.21.15.84:0/3973069741 conn(0x7f3c9c0caa20 msgr2=0x7f3c9c0ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 shutdown_connections 2023-08-31T02:00:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:06.928+0000 7f3ca40dc700 1 -- 172.21.15.84:0/3973069741 wait complete. 2023-08-31T02:00:06.933 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T02:00:06.933 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T02:00:06.934 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-08-31T02:00:06.934 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-08-31T02:00:06.934 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-31T02:00:06.934 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T02:00:06.935 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T02:00:06.935 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T02:00:06.935 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-08-31T02:00:06.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:06.936 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-08-31T02:00:06.953 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:06.954 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:06.954 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:06.954 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:06.954 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:06.955 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:06.955 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:06.956 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:06.956 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:06.956 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T02:00:06.956 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:06.956 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T02:00:06.957 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-08-31T02:00:06.957 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ecad:a98e:85e8:7ebe/64 scope link noprefixroute 2023-08-31T02:00:06.957 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:06.958 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T02:00:06.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:06.958 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:06.959 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:06.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-08-31T02:00:06.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-08-31T02:00:06.960 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-08-31T02:00:06.960 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T02:00:06.960 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:07.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:07.111 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T02:00:07.141 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-08-31T02:00:07.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:07.142 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-08-31T02:00:07.213 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-08-31T02:00:07.213 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T02:00:07.214 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T02:00:07.214 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T02:00:07.214 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T02:00:07.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:07.215 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:07.215 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:07.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T02:00:07.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T02:00:07.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T02:00:07.217 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:07.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:07.449 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-08-31T02:00:07.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:07.467 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-08-31T02:00:07.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:07.523 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:07.523 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:07.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-31T02:00:07.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-08-31T02:00:07.525 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:07.617 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-08-31T02:00:07.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:07.618 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:07.618 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:07.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-08-31T02:00:07.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T02:00:07.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-08-31T02:00:07.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-08-31T02:00:07.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-08-31T02:00:07.620 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:07.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:07.805 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:07.806 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:07.806 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-08-31T02:00:07.807 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T02:00:07.807 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:07.905 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-08-31T02:00:07.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:07.906 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-08-31T02:00:07.926 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-08-31T02:00:07.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:07.927 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-08-31T02:00:07.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-08-31T02:00:08.049 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:08.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:08.115 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:08.116 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:08.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:08.118 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-08-31T02:00:08.174 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T02:00:08.175 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-08-31T02:00:08.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-08-31T02:00:08.243 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:08.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:08.309 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:08.310 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:08.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:08.311 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-08-31T02:00:08.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:2023-08-31T02:00:08.323+0000 7f54aad005c0 -1 init, newargv = 0x55ac66a40e70 newargc=15 2023-08-31T02:00:08.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[111268]: starting ceph client 2023-08-31T02:00:08.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[111268]: starting fuse 2023-08-31T02:00:08.332 INFO:teuthology.orchestra.run.smithi084.stdout:47 2023-08-31T02:00:08.332 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-31T02:00:08.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-08-31T02:00:08.333 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-08-31T02:00:08.333 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-08-31T02:00:08.333 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-08-31T02:00:08.334 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-08-31T02:00:08.334 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:08.335 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-08-31T02:00:08.335 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-08-31T02:00:08.335 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-08-31T02:00:08.336 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-08-31T02:00:08.336 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:08.336 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-08-31T02:00:08.337 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-08-31T02:00:08.337 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-08-31T02:00:08.337 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-08-31T02:00:08.338 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:08.338 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-08-31T02:00:08.339 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T02:00:08.339 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T02:00:08.339 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T02:00:08.340 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-08-31T02:00:08.340 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-08-31T02:00:08.340 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-08-31T02:00:08.341 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T02:00:08.341 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:08.342 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.admin")) 2023-08-31T02:00:08.342 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-08-31T02:00:08.455 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.admin.111268.asok 2023-08-31T02:00:08.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T02:00:08.464 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.111268.asok 2023-08-31T02:00:08.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:08.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.111268.asok status 2023-08-31T02:00:08.619 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:00:08.619 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-08-31T02:00:08.620 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T02:00:08.620 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T02:00:08.620 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "admin", 2023-08-31T02:00:08.621 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-08-31T02:00:08.621 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-08-31T02:00:08.622 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "111268", 2023-08-31T02:00:08.622 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-08-31T02:00:08.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:08.623 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-08-31T02:00:08.623 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-08-31T02:00:08.624 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4521, 2023-08-31T02:00:08.624 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-08-31T02:00:08.625 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-08-31T02:00:08.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-08-31T02:00:08.625 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4521 2023-08-31T02:00:08.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:08.626 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-08-31T02:00:08.626 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-08-31T02:00:08.627 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:00:08.627 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2803816729 2023-08-31T02:00:08.627 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:00:08.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:08.628 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-08-31T02:00:08.629 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-08-31T02:00:08.629 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:00:08.629 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2803816729 2023-08-31T02:00:08.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:08.630 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4521 192.168.0.1:0/2803816729", 2023-08-31T02:00:08.630 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2803816729", 2023-08-31T02:00:08.631 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-08-31T02:00:08.631 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 7, 2023-08-31T02:00:08.631 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 26, 2023-08-31T02:00:08.631 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-08-31T02:00:08.632 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-08-31T02:00:08.632 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-08-31T02:00:08.632 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:00:08.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:08.634 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-08-31T02:00:08.634 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-08-31T02:00:08.651 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-08-31T02:00:08.651 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-08-31T02:00:08.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:08.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-08-31T02:00:08.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:08.720 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-08-31T02:00:08.824 INFO:teuthology.orchestra.run.smithi084.stdout:# file: . 2023-08-31T02:00:08.824 INFO:teuthology.orchestra.run.smithi084.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-08-31T02:00:08.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:08.825 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:00:08.825 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:08.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.012+0000 7f5401f2f700 1 -- 172.21.15.84:0/1275768907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53e8003a00 msgr2=0x7f53e8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.012+0000 7f5401f2f700 1 --2- 172.21.15.84:0/1275768907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53e8003a00 0x7f53e8003e20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009be0 tx=0x7f53e8005880 comp rx=0 tx=0).stop 2023-08-31T02:00:09.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.012+0000 7f53fbfff700 1 -- 172.21.15.84:0/1275768907 reap_dead start 2023-08-31T02:00:09.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.012+0000 7f5401f2f700 1 -- 172.21.15.84:0/1275768907 shutdown_connections 2023-08-31T02:00:09.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.012+0000 7f5401f2f700 1 -- 172.21.15.84:0/1275768907 >> 172.21.15.84:0/1275768907 conn(0x7f53fc0caa20 msgr2=0x7f53fc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:09.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.012+0000 7f5401f2f700 1 -- 172.21.15.84:0/1275768907 shutdown_connections 2023-08-31T02:00:09.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.012+0000 7f5401f2f700 1 -- 172.21.15.84:0/1275768907 wait complete. 2023-08-31T02:00:09.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.013+0000 7f5401f2f700 1 Processor -- start 2023-08-31T02:00:09.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f5401f2f700 1 -- start start 2023-08-31T02:00:09.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f5401f2f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e8003a00 0x7f53fc152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f5401f2f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc1e12b0 0x7f53fc150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f5401f2f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53fc0ae790 0x7f53fc0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f5401f2f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc152880 con 0x7f53fc1e12b0 2023-08-31T02:00:09.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f5401f2f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0af150 con 0x7f53e8003a00 2023-08-31T02:00:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f5401f2f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1e1730 con 0x7f53fc0ae790 2023-08-31T02:00:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f53faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc1e12b0 0x7f53fc150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f53faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc1e12b0 0x7f53fc150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51032/0 (socket says 172.21.15.84:51032) 2023-08-31T02:00:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f53faffd700 1 -- 172.21.15.84:0/1104021804 learned_addr learned my addr 172.21.15.84:0/1104021804 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.014+0000 7f53fb7fe700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e8003a00 0x7f53fc152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53fbfff700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53fc0ae790 0x7f53fc0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53faffd700 1 -- 172.21.15.84:0/1104021804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53fc0ae790 msgr2=0x7f53fc0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53faffd700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53fc0ae790 0x7f53fc0aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53faffd700 1 -- 172.21.15.84:0/1104021804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e8003a00 msgr2=0x7f53fc152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53faffd700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e8003a00 0x7f53fc152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53faffd700 1 -- 172.21.15.84:0/1104021804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc1e1a00 con 0x7f53fc1e12b0 2023-08-31T02:00:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53faffd700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc1e12b0 0x7f53fc150b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f53ec011ae0 tx=0x7f53ec011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53f3fff700 1 -- 172.21.15.84:0/1104021804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00fc60 con 0x7f53fc1e12b0 2023-08-31T02:00:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53f3fff700 1 -- 172.21.15.84:0/1104021804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f53ec00fdc0 con 0x7f53fc1e12b0 2023-08-31T02:00:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc1e1ce0 con 0x7f53fc1e12b0 2023-08-31T02:00:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f53f3fff700 1 -- 172.21.15.84:0/1104021804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec004280 con 0x7f53fc1e12b0 2023-08-31T02:00:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.015+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc1e22a0 con 0x7f53fc1e12b0 2023-08-31T02:00:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.016+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc04e7c0 con 0x7f53fc1e12b0 2023-08-31T02:00:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.016+0000 7f53f3fff700 1 -- 172.21.15.84:0/1104021804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f53ec0043e0 con 0x7f53fc1e12b0 2023-08-31T02:00:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.017+0000 7f53f3fff700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f53dc06a0e0 0x7f53dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.017+0000 7f53fb7fe700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f53dc06a0e0 0x7f53dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.017+0000 7f53f3fff700 1 -- 172.21.15.84:0/1104021804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53ec089160 con 0x7f53fc1e12b0 2023-08-31T02:00:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.017+0000 7f53fb7fe700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f53dc06a0e0 0x7f53dc06c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009be0 tx=0x7f53e4004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:09.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.021+0000 7f53f3fff700 1 -- 172.21.15.84:0/1104021804 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f53ec0546e0 con 0x7f53fc1e12b0 2023-08-31T02:00:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.214+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53fc155010 con 0x7f53fc1e12b0 2023-08-31T02:00:09.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.215+0000 7f53f3fff700 1 -- 172.21.15.84:0/1104021804 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f53ec057d00 con 0x7f53fc1e12b0 2023-08-31T02:00:09.208 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:09.208 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f53dc06a0e0 msgr2=0x7f53dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f53dc06a0e0 0x7f53dc06c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009be0 tx=0x7f53e4004750 comp rx=0 tx=0).stop 2023-08-31T02:00:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc1e12b0 msgr2=0x7f53fc150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc1e12b0 0x7f53fc150b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f53ec011ae0 tx=0x7f53ec011df0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 shutdown_connections 2023-08-31T02:00:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f53dc06a0e0 0x7f53dc06c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53fc0ae790 0x7f53fc0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e8003a00 0x7f53fc152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 --2- 172.21.15.84:0/1104021804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc1e12b0 0x7f53fc150b80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 >> 172.21.15.84:0/1104021804 conn(0x7f53fc0caa20 msgr2=0x7f53fc0b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 shutdown_connections 2023-08-31T02:00:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.217+0000 7f5401f2f700 1 -- 172.21.15.84:0/1104021804 wait complete. 2023-08-31T02:00:09.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:09.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:09.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.357+0000 7f83a9b53700 1 -- 172.21.15.84:0/402834622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 msgr2=0x7f83a40b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.357+0000 7f83a9b53700 1 --2- 172.21.15.84:0/402834622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 0x7f83a40b23a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c7da0 tx=0x7f839c00b330 comp rx=0 tx=0).stop 2023-08-31T02:00:09.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.358+0000 7f83a9b53700 1 -- 172.21.15.84:0/402834622 shutdown_connections 2023-08-31T02:00:09.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.358+0000 7f83a9b53700 1 --2- 172.21.15.84:0/402834622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 0x7f83a40b23a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.358+0000 7f83a9b53700 1 --2- 172.21.15.84:0/402834622 >> v2:172.21.15.170:3300/0 conn(0x7f83a415d7e0 0x7f83a415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.358+0000 7f83a9b53700 1 -- 172.21.15.84:0/402834622 >> 172.21.15.84:0/402834622 conn(0x7f83a40cd980 msgr2=0x7f83a40cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:09.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.358+0000 7f83a9b53700 1 -- 172.21.15.84:0/402834622 shutdown_connections 2023-08-31T02:00:09.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.358+0000 7f83a9b53700 1 -- 172.21.15.84:0/402834622 wait complete. 2023-08-31T02:00:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.359+0000 7f83a9b53700 1 Processor -- start 2023-08-31T02:00:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.359+0000 7f83a9b53700 1 -- start start 2023-08-31T02:00:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a9b53700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a4070040 0x7f83a40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a9b53700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 0x7f83a41f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a9b53700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83a415d7e0 0x7f83a41f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a9b53700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40aae10 con 0x7f83a4156c60 2023-08-31T02:00:09.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a9b53700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40ab040 con 0x7f83a4070040 2023-08-31T02:00:09.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a9b53700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40ab320 con 0x7f83a415d7e0 2023-08-31T02:00:09.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 0x7f83a41f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 0x7f83a41f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51046/0 (socket says 172.21.15.84:51046) 2023-08-31T02:00:09.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 -- 172.21.15.84:0/3274386941 learned_addr learned my addr 172.21.15.84:0/3274386941 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:09.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a37fe700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a4070040 0x7f83a40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a3fff700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83a415d7e0 0x7f83a41f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 -- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83a415d7e0 msgr2=0x7f83a41f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83a415d7e0 0x7f83a41f5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 -- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a4070040 msgr2=0x7f83a40aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a4070040 0x7f83a40aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 -- 172.21.15.84:0/3274386941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009c40 con 0x7f83a4156c60 2023-08-31T02:00:09.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a3fff700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83a415d7e0 0x7f83a41f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:09.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a37fe700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a4070040 0x7f83a40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:09.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a2ffd700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 0x7f83a41f1e50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f838c00b4a0 tx=0x7f838c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:09.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f839bfff700 1 -- 172.21.15.84:0/3274386941 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c011830 con 0x7f83a4156c60 2023-08-31T02:00:09.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f839bfff700 1 -- 172.21.15.84:0/3274386941 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f838c011a80 con 0x7f83a4156c60 2023-08-31T02:00:09.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a40ab600 con 0x7f83a4156c60 2023-08-31T02:00:09.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f839bfff700 1 -- 172.21.15.84:0/3274386941 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c011e90 con 0x7f83a4156c60 2023-08-31T02:00:09.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.360+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a40abbc0 con 0x7f83a4156c60 2023-08-31T02:00:09.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.361+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a40abde0 con 0x7f83a4156c60 2023-08-31T02:00:09.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.362+0000 7f839bfff700 1 -- 172.21.15.84:0/3274386941 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f838c01a400 con 0x7f83a4156c60 2023-08-31T02:00:09.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.362+0000 7f839bfff700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f838406a110 0x7f838406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.362+0000 7f839bfff700 1 -- 172.21.15.84:0/3274386941 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f838c088930 con 0x7f83a4156c60 2023-08-31T02:00:09.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.362+0000 7f83a37fe700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f838406a110 0x7f838406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.362+0000 7f83a37fe700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f838406a110 0x7f838406c5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f839c009f30 tx=0x7f839c004b40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:09.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.366+0000 7f839bfff700 1 -- 172.21.15.84:0/3274386941 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f838c053e30 con 0x7f83a4156c60 2023-08-31T02:00:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.554+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83a404e7c0 con 0x7f83a4156c60 2023-08-31T02:00:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.554+0000 7f839bfff700 1 -- 172.21.15.84:0/3274386941 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f838c057450 con 0x7f83a4156c60 2023-08-31T02:00:09.547 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f838406a110 msgr2=0x7f838406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f838406a110 0x7f838406c5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f839c009f30 tx=0x7f839c004b40 comp rx=0 tx=0).stop 2023-08-31T02:00:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 msgr2=0x7f83a41f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 0x7f83a41f1e50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f838c00b4a0 tx=0x7f838c00b860 comp rx=0 tx=0).stop 2023-08-31T02:00:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 shutdown_connections 2023-08-31T02:00:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f838406a110 0x7f838406c5d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83a415d7e0 0x7f83a41f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a4070040 0x7f83a40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 --2- 172.21.15.84:0/3274386941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83a4156c60 0x7f83a41f1e50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 >> 172.21.15.84:0/3274386941 conn(0x7f83a40cd980 msgr2=0x7f83a4155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 shutdown_connections 2023-08-31T02:00:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.556+0000 7f83a9b53700 1 -- 172.21.15.84:0/3274386941 wait complete. 2023-08-31T02:00:09.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:09.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.693+0000 7f0d47d07700 1 -- 172.21.15.84:0/744931658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d400cd3f0 msgr2=0x7f0d400b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.693+0000 7f0d47d07700 1 --2- 172.21.15.84:0/744931658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d400cd3f0 0x7f0d400b0020 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d400cdf30 tx=0x7f0d30009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.693+0000 7f0d47d07700 1 -- 172.21.15.84:0/744931658 shutdown_connections 2023-08-31T02:00:09.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.693+0000 7f0d47d07700 1 --2- 172.21.15.84:0/744931658 >> v2:172.21.15.170:3300/0 conn(0x7f0d4015d750 0x7f0d400cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.693+0000 7f0d47d07700 1 --2- 172.21.15.84:0/744931658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d400cd3f0 0x7f0d400b0020 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.693+0000 7f0d47d07700 1 -- 172.21.15.84:0/744931658 >> 172.21.15.84:0/744931658 conn(0x7f0d400b0c40 msgr2=0x7f0d400b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:09.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.693+0000 7f0d47d07700 1 -- 172.21.15.84:0/744931658 shutdown_connections 2023-08-31T02:00:09.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.693+0000 7f0d47d07700 1 -- 172.21.15.84:0/744931658 wait complete. 2023-08-31T02:00:09.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.694+0000 7f0d47d07700 1 Processor -- start 2023-08-31T02:00:09.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.694+0000 7f0d47d07700 1 -- start start 2023-08-31T02:00:09.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d47d07700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d400cd3f0 0x7f0d400b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d47d07700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d40159320 0x7f0d4014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d47d07700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d4015d750 0x7f0d4014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d47d07700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4014d3a0 con 0x7f0d40159320 2023-08-31T02:00:09.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d47d07700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40159f00 con 0x7f0d400cd3f0 2023-08-31T02:00:09.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d47d07700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015b6e0 con 0x7f0d4015d750 2023-08-31T02:00:09.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d40159320 0x7f0d4014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d40159320 0x7f0d4014d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51060/0 (socket says 172.21.15.84:51060) 2023-08-31T02:00:09.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 -- 172.21.15.84:0/1504881343 learned_addr learned my addr 172.21.15.84:0/1504881343 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:09.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d462a4700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d4015d750 0x7f0d4014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d45aa3700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d400cd3f0 0x7f0d400b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 -- 172.21.15.84:0/1504881343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d4015d750 msgr2=0x7f0d4014ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d4015d750 0x7f0d4014ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 -- 172.21.15.84:0/1504881343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d400cd3f0 msgr2=0x7f0d400b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d400cd3f0 0x7f0d400b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 -- 172.21.15.84:0/1504881343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d30009520 con 0x7f0d40159320 2023-08-31T02:00:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.695+0000 7f0d452a2700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d40159320 0x7f0d4014d510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0d400cc9e0 tx=0x7f0d30017630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.696+0000 7f0d367fc700 1 -- 172.21.15.84:0/1504881343 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3001c070 con 0x7f0d40159320 2023-08-31T02:00:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.696+0000 7f0d367fc700 1 -- 172.21.15.84:0/1504881343 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0d30017a30 con 0x7f0d40159320 2023-08-31T02:00:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.696+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d40159940 con 0x7f0d40159320 2023-08-31T02:00:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.696+0000 7f0d367fc700 1 -- 172.21.15.84:0/1504881343 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30017e20 con 0x7f0d40159320 2023-08-31T02:00:09.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.696+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4014dcf0 con 0x7f0d40159320 2023-08-31T02:00:09.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.697+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4004e7c0 con 0x7f0d40159320 2023-08-31T02:00:09.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.697+0000 7f0d367fc700 1 -- 172.21.15.84:0/1504881343 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0d3000f460 con 0x7f0d40159320 2023-08-31T02:00:09.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.697+0000 7f0d367fc700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d2406a0e0 0x7f0d2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:09.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.698+0000 7f0d367fc700 1 -- 172.21.15.84:0/1504881343 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d30089bf0 con 0x7f0d40159320 2023-08-31T02:00:09.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.698+0000 7f0d45aa3700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d2406a0e0 0x7f0d2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:09.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.698+0000 7f0d45aa3700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d2406a0e0 0x7f0d2406c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c004740 tx=0x7f0d3c007f40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:09.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.702+0000 7f0d367fc700 1 -- 172.21.15.84:0/1504881343 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0d30055170 con 0x7f0d40159320 2023-08-31T02:00:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.889+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d4015b820 con 0x7f0d40159320 2023-08-31T02:00:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.889+0000 7f0d367fc700 1 -- 172.21.15.84:0/1504881343 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d30058790 con 0x7f0d40159320 2023-08-31T02:00:09.883 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d2406a0e0 msgr2=0x7f0d2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d2406a0e0 0x7f0d2406c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c004740 tx=0x7f0d3c007f40 comp rx=0 tx=0).stop 2023-08-31T02:00:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d40159320 msgr2=0x7f0d4014d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d40159320 0x7f0d4014d510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0d400cc9e0 tx=0x7f0d30017630 comp rx=0 tx=0).stop 2023-08-31T02:00:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 shutdown_connections 2023-08-31T02:00:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d2406a0e0 0x7f0d2406c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d4015d750 0x7f0d4014ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d400cd3f0 0x7f0d400b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 --2- 172.21.15.84:0/1504881343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d40159320 0x7f0d4014d510 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 >> 172.21.15.84:0/1504881343 conn(0x7f0d400b0c40 msgr2=0x7f0d40158660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 shutdown_connections 2023-08-31T02:00:09.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:09.891+0000 7f0d47d07700 1 -- 172.21.15.84:0/1504881343 wait complete. 2023-08-31T02:00:09.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:10.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.028+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/483304334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f01591f0 msgr2=0x7fe0f00af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.028+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/483304334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f01591f0 0x7fe0f00af7f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40098c0 tx=0x7fe0e4009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.029+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/483304334 shutdown_connections 2023-08-31T02:00:10.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.029+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/483304334 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0f00b09b0 0x7fe0f00b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.029+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/483304334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f01591f0 0x7fe0f00af7f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.029+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/483304334 >> 172.21.15.84:0/483304334 conn(0x7fe0f00699a0 msgr2=0x7fe0f0069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:10.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.029+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/483304334 shutdown_connections 2023-08-31T02:00:10.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.029+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/483304334 wait complete. 2023-08-31T02:00:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.030+0000 7fe0f4dd2700 1 Processor -- start 2023-08-31T02:00:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.030+0000 7fe0f4dd2700 1 -- start start 2023-08-31T02:00:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0f4dd2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f00b09b0 0x7fe0f006ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0f4dd2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f00c9780 0x7fe0f006bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0f4dd2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0f01591f0 0x7fe0f00c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0f4dd2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f00c8e70 con 0x7fe0f00c9780 2023-08-31T02:00:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0f4dd2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f00c9110 con 0x7fe0f00b09b0 2023-08-31T02:00:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0f4dd2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f00c93f0 con 0x7fe0f01591f0 2023-08-31T02:00:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f00c9780 0x7fe0f006bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f00c9780 0x7fe0f006bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51074/0 (socket says 172.21.15.84:51074) 2023-08-31T02:00:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 -- 172.21.15.84:0/2694492036 learned_addr learned my addr 172.21.15.84:0/2694492036 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0ee59c700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f00b09b0 0x7fe0f006ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0eed9d700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0f01591f0 0x7fe0f00c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 -- 172.21.15.84:0/2694492036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0f01591f0 msgr2=0x7fe0f00c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0f01591f0 0x7fe0f00c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 -- 172.21.15.84:0/2694492036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f00b09b0 msgr2=0x7fe0f006ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f00b09b0 0x7fe0f006ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 -- 172.21.15.84:0/2694492036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4009520 con 0x7fe0f00c9780 2023-08-31T02:00:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0edd9b700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f00c9780 0x7fe0f006bb40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000c520 tx=0x7fe0e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0deffd700 1 -- 172.21.15.84:0/2694492036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00054e0 con 0x7fe0f00c9780 2023-08-31T02:00:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.031+0000 7fe0deffd700 1 -- 172.21.15.84:0/2694492036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe0e0003680 con 0x7fe0f00c9780 2023-08-31T02:00:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.032+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f006b340 con 0x7fe0f00c9780 2023-08-31T02:00:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.032+0000 7fe0deffd700 1 -- 172.21.15.84:0/2694492036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0003a90 con 0x7fe0f00c9780 2023-08-31T02:00:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.032+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f006d1f0 con 0x7fe0f00c9780 2023-08-31T02:00:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.033+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f006b860 con 0x7fe0f00c9780 2023-08-31T02:00:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.033+0000 7fe0deffd700 1 -- 172.21.15.84:0/2694492036 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe0e0003bf0 con 0x7fe0f00c9780 2023-08-31T02:00:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.033+0000 7fe0deffd700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe0d006a110 0x7fe0d006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.033+0000 7fe0deffd700 1 -- 172.21.15.84:0/2694492036 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0e0087c90 con 0x7fe0f00c9780 2023-08-31T02:00:10.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.033+0000 7fe0ee59c700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe0d006a110 0x7fe0d006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.034+0000 7fe0ee59c700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe0d006a110 0x7fe0d006c5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4000c00 tx=0x7fe0e4019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:10.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.038+0000 7fe0deffd700 1 -- 172.21.15.84:0/2694492036 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe0f006b860 con 0x7fe0f00c9780 2023-08-31T02:00:10.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.226+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0f006b860 con 0x7fe0f00c9780 2023-08-31T02:00:10.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.227+0000 7fe0deffd700 1 -- 172.21.15.84:0/2694492036 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0f006b860 con 0x7fe0f00c9780 2023-08-31T02:00:10.221 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe0d006a110 msgr2=0x7fe0d006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe0d006a110 0x7fe0d006c5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4000c00 tx=0x7fe0e4019040 comp rx=0 tx=0).stop 2023-08-31T02:00:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f00c9780 msgr2=0x7fe0f006bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f00c9780 0x7fe0f006bb40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000c520 tx=0x7fe0e000c830 comp rx=0 tx=0).stop 2023-08-31T02:00:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 shutdown_connections 2023-08-31T02:00:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe0d006a110 0x7fe0d006c5d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0f01591f0 0x7fe0f00c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f00b09b0 0x7fe0f006ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 --2- 172.21.15.84:0/2694492036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0f00c9780 0x7fe0f006bb40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 >> 172.21.15.84:0/2694492036 conn(0x7fe0f00699a0 msgr2=0x7fe0f00c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 shutdown_connections 2023-08-31T02:00:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.229+0000 7fe0f4dd2700 1 -- 172.21.15.84:0/2694492036 wait complete. 2023-08-31T02:00:10.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.366+0000 7f7443efc700 1 -- 172.21.15.84:0/3746822288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7428003a00 msgr2=0x7f7428003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.366+0000 7f7443efc700 1 --2- 172.21.15.84:0/3746822288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7428003a00 0x7f7428003e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f742c00bb90 tx=0x7f7428005880 comp rx=0 tx=0).stop 2023-08-31T02:00:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.366+0000 7f7442499700 1 -- 172.21.15.84:0/3746822288 reap_dead start 2023-08-31T02:00:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.366+0000 7f7443efc700 1 -- 172.21.15.84:0/3746822288 shutdown_connections 2023-08-31T02:00:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.366+0000 7f7443efc700 1 -- 172.21.15.84:0/3746822288 >> 172.21.15.84:0/3746822288 conn(0x7f743c0afb00 msgr2=0x7f743c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:10.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.366+0000 7f7443efc700 1 -- 172.21.15.84:0/3746822288 shutdown_connections 2023-08-31T02:00:10.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.366+0000 7f7443efc700 1 -- 172.21.15.84:0/3746822288 wait complete. 2023-08-31T02:00:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7443efc700 1 Processor -- start 2023-08-31T02:00:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7443efc700 1 -- start start 2023-08-31T02:00:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7443efc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7428003a00 0x7f743c1f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7443efc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f743c151d80 0x7f743c152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7443efc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c0b0e70 0x7f743c0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7443efc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c152740 con 0x7f743c151d80 2023-08-31T02:00:10.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7443efc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0b1ba0 con 0x7f743c0b0e70 2023-08-31T02:00:10.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7443efc700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0b1e80 con 0x7f7428003a00 2023-08-31T02:00:10.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7441497700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f743c151d80 0x7f743c152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7441497700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f743c151d80 0x7f743c152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51094/0 (socket says 172.21.15.84:51094) 2023-08-31T02:00:10.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.368+0000 7f7441497700 1 -- 172.21.15.84:0/2286012919 learned_addr learned my addr 172.21.15.84:0/2286012919 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7441c98700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7428003a00 0x7f743c1f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7442499700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c0b0e70 0x7f743c0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7441497700 1 -- 172.21.15.84:0/2286012919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7428003a00 msgr2=0x7f743c1f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7441497700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7428003a00 0x7f743c1f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7441497700 1 -- 172.21.15.84:0/2286012919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c0b0e70 msgr2=0x7f743c0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7441497700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c0b0e70 0x7f743c0b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7441497700 1 -- 172.21.15.84:0/2286012919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0b2160 con 0x7f743c151d80 2023-08-31T02:00:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7441497700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f743c151d80 0x7f743c152200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f74380066f0 tx=0x7f7438003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f74327fc700 1 -- 172.21.15.84:0/2286012919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438011840 con 0x7f743c151d80 2023-08-31T02:00:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f74327fc700 1 -- 172.21.15.84:0/2286012919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f74380119c0 con 0x7f743c151d80 2023-08-31T02:00:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f74327fc700 1 -- 172.21.15.84:0/2286012919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438011dd0 con 0x7f743c151d80 2023-08-31T02:00:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c0b2440 con 0x7f743c151d80 2023-08-31T02:00:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.369+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c0b1840 con 0x7f743c151d80 2023-08-31T02:00:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.370+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c142790 con 0x7f743c151d80 2023-08-31T02:00:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.370+0000 7f74327fc700 1 -- 172.21.15.84:0/2286012919 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f74380103c0 con 0x7f743c151d80 2023-08-31T02:00:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.371+0000 7f74327fc700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f742006a0e0 0x7f742006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.371+0000 7f74327fc700 1 -- 172.21.15.84:0/2286012919 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7438089650 con 0x7f743c151d80 2023-08-31T02:00:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.371+0000 7f7441c98700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f742006a0e0 0x7f742006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.371+0000 7f7441c98700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f742006a0e0 0x7f742006c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f742c012040 tx=0x7f742c01d040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.375+0000 7f74327fc700 1 -- 172.21.15.84:0/2286012919 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f743c142790 con 0x7f743c151d80 2023-08-31T02:00:10.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.566+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f743c142790 con 0x7f743c151d80 2023-08-31T02:00:10.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.567+0000 7f74327fc700 1 -- 172.21.15.84:0/2286012919 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f743c142790 con 0x7f743c151d80 2023-08-31T02:00:10.560 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:10.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f742006a0e0 msgr2=0x7f742006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f742006a0e0 0x7f742006c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f742c012040 tx=0x7f742c01d040 comp rx=0 tx=0).stop 2023-08-31T02:00:10.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f743c151d80 msgr2=0x7f743c152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f743c151d80 0x7f743c152200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f74380066f0 tx=0x7f7438003960 comp rx=0 tx=0).stop 2023-08-31T02:00:10.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 shutdown_connections 2023-08-31T02:00:10.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f742006a0e0 0x7f742006c5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c0b0e70 0x7f743c0b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7428003a00 0x7f743c1f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 --2- 172.21.15.84:0/2286012919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f743c151d80 0x7f743c152200 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 >> 172.21.15.84:0/2286012919 conn(0x7f743c0afb00 msgr2=0x7f743c0cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:10.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 shutdown_connections 2023-08-31T02:00:10.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.569+0000 7f7443efc700 1 -- 172.21.15.84:0/2286012919 wait complete. 2023-08-31T02:00:10.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:00:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.704+0000 7fcbdb842700 1 -- 172.21.15.84:0/2339458643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbd40cd1f0 msgr2=0x7fcbd40b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.704+0000 7fcbdb842700 1 --2- 172.21.15.84:0/2339458643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbd40cd1f0 0x7fcbd40b0f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009f90 tx=0x7fcbcc00b330 comp rx=0 tx=0).stop 2023-08-31T02:00:10.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.704+0000 7fcbdb842700 1 -- 172.21.15.84:0/2339458643 shutdown_connections 2023-08-31T02:00:10.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.704+0000 7fcbdb842700 1 --2- 172.21.15.84:0/2339458643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbd40cd1f0 0x7fcbd40b0f00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.704+0000 7fcbdb842700 1 --2- 172.21.15.84:0/2339458643 >> v2:172.21.15.170:3300/0 conn(0x7fcbd4159290 0x7fcbd40b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.704+0000 7fcbdb842700 1 -- 172.21.15.84:0/2339458643 >> 172.21.15.84:0/2339458643 conn(0x7fcbd4070860 msgr2=0x7fcbd4070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.704+0000 7fcbdb842700 1 -- 172.21.15.84:0/2339458643 shutdown_connections 2023-08-31T02:00:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.704+0000 7fcbdb842700 1 -- 172.21.15.84:0/2339458643 wait complete. 2023-08-31T02:00:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.706+0000 7fcbdb842700 1 Processor -- start 2023-08-31T02:00:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.706+0000 7fcbdb842700 1 -- start start 2023-08-31T02:00:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.706+0000 7fcbdb842700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbd40716b0 0x7fcbd40c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.706+0000 7fcbdb842700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbd40cd1f0 0x7fcbd40b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.706+0000 7fcbdb842700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd4159290 0x7fcbd4143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.706+0000 7fcbdb842700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd415a5d0 con 0x7fcbd4159290 2023-08-31T02:00:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.706+0000 7fcbdb842700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd415a8b0 con 0x7fcbd40716b0 2023-08-31T02:00:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.706+0000 7fcbdb842700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd415ab90 con 0x7fcbd40cd1f0 2023-08-31T02:00:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd4159290 0x7fcbd4143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd4159290 0x7fcbd4143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51110/0 (socket says 172.21.15.84:51110) 2023-08-31T02:00:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 -- 172.21.15.84:0/4113522708 learned_addr learned my addr 172.21.15.84:0/4113522708 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:10.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd8ddd700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbd40cd1f0 0x7fcbd40b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd95de700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbd40716b0 0x7fcbd40c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 -- 172.21.15.84:0/4113522708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbd40cd1f0 msgr2=0x7fcbd40b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbd40cd1f0 0x7fcbd40b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 -- 172.21.15.84:0/4113522708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbd40716b0 msgr2=0x7fcbd40c1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbd40716b0 0x7fcbd40c1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 -- 172.21.15.84:0/4113522708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc009c40 con 0x7fcbd4159290 2023-08-31T02:00:10.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbd9ddf700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd4159290 0x7fcbd4143490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40b3fb0 tx=0x7fcbcc007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:10.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4113522708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc00e040 con 0x7fcbd4159290 2023-08-31T02:00:10.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4113522708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcbcc01d480 con 0x7fcbd4159290 2023-08-31T02:00:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd415ae70 con 0x7fcbd4159290 2023-08-31T02:00:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.707+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4113522708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc007ea0 con 0x7fcbd4159290 2023-08-31T02:00:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.708+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd4140e30 con 0x7fcbd4159290 2023-08-31T02:00:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.708+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd404e7c0 con 0x7fcbd4159290 2023-08-31T02:00:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.709+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4113522708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcbcc01d890 con 0x7fcbd4159290 2023-08-31T02:00:10.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.709+0000 7fcbc9ffb700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcbb806a0e0 0x7fcbb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.709+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4113522708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbcc08a5d0 con 0x7fcbd4159290 2023-08-31T02:00:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.709+0000 7fcbd95de700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcbb806a0e0 0x7fcbb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.710+0000 7fcbd95de700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcbb806a0e0 0x7fcbb806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009bc0 tx=0x7fcbd0009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.714+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4113522708 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcbcc055ab0 con 0x7fcbd4159290 2023-08-31T02:00:10.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.919+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcbd40cd8e0 con 0x7fcbd4159290 2023-08-31T02:00:10.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.920+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4113522708 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcbcc0590d0 con 0x7fcbd4159290 2023-08-31T02:00:10.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcbb806a0e0 msgr2=0x7fcbb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcbb806a0e0 0x7fcbb806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009bc0 tx=0x7fcbd0009260 comp rx=0 tx=0).stop 2023-08-31T02:00:10.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd4159290 msgr2=0x7fcbd4143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:10.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd4159290 0x7fcbd4143490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40b3fb0 tx=0x7fcbcc007aa0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 shutdown_connections 2023-08-31T02:00:10.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcbb806a0e0 0x7fcbb806c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd4159290 0x7fcbd4143490 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbd40716b0 0x7fcbd40c1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 --2- 172.21.15.84:0/4113522708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbd40cd1f0 0x7fcbd40b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:10.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 >> 172.21.15.84:0/4113522708 conn(0x7fcbd4070860 msgr2=0x7fcbd4154400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:10.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 shutdown_connections 2023-08-31T02:00:10.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:10.922+0000 7fcbdb842700 1 -- 172.21.15.84:0/4113522708 wait complete. 2023-08-31T02:00:10.918 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:00:10.926 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:00:10.927 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:10.945 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.113+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/2746846652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c780707c0 msgr2=0x7f3c78070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.113+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/2746846652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c780707c0 0x7f3c78070c10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c780cb830 tx=0x7f3c7000b380 comp rx=0 tx=0).stop 2023-08-31T02:00:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.114+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/2746846652 shutdown_connections 2023-08-31T02:00:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.114+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/2746846652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c780707c0 0x7f3c78070c10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.114+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/2746846652 >> v2:172.21.15.170:3300/0 conn(0x7f3c78158220 0x7f3c780cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.114+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/2746846652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c780b0df0 0x7f3c780c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.114+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/2746846652 >> 172.21.15.84:0/2746846652 conn(0x7f3c780caa20 msgr2=0x7f3c780cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:11.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.114+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/2746846652 shutdown_connections 2023-08-31T02:00:11.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.114+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/2746846652 wait complete. 2023-08-31T02:00:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.115+0000 7f3c7ce1e700 1 Processor -- start 2023-08-31T02:00:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.115+0000 7f3c7ce1e700 1 -- start start 2023-08-31T02:00:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c7ce1e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c780707c0 0x7f3c78144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c7ce1e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780b0df0 0x7f3c7806a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c7ce1e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c78158220 0x7f3c7806a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c7ce1e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78144c50 con 0x7f3c78158220 2023-08-31T02:00:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c7ce1e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78144950 con 0x7f3c780b0df0 2023-08-31T02:00:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c7ce1e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78147af0 con 0x7f3c780707c0 2023-08-31T02:00:11.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c76d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c78158220 0x7f3c7806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c76d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c78158220 0x7f3c7806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51124/0 (socket says 172.21.15.84:51124) 2023-08-31T02:00:11.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.116+0000 7f3c76d9d700 1 -- 172.21.15.84:0/1117693427 learned_addr learned my addr 172.21.15.84:0/1117693427 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:11.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c75d9b700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780b0df0 0x7f3c7806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c7659c700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c780707c0 0x7f3c78144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c76d9d700 1 -- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c780707c0 msgr2=0x7f3c78144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c76d9d700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c780707c0 0x7f3c78144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c76d9d700 1 -- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780b0df0 msgr2=0x7f3c7806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c76d9d700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780b0df0 0x7f3c7806a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c76d9d700 1 -- 172.21.15.84:0/1117693427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70009d00 con 0x7f3c78158220 2023-08-31T02:00:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c7659c700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c780707c0 0x7f3c78144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c76d9d700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c78158220 0x7f3c7806a770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009fd0 tx=0x7f3c70007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:11.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c66ffd700 1 -- 172.21.15.84:0/1117693427 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000e040 con 0x7f3c78158220 2023-08-31T02:00:11.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c66ffd700 1 -- 172.21.15.84:0/1117693427 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3c7001d890 con 0x7f3c78158220 2023-08-31T02:00:11.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c78144ef0 con 0x7f3c78158220 2023-08-31T02:00:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c66ffd700 1 -- 172.21.15.84:0/1117693427 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7001dca0 con 0x7f3c78158220 2023-08-31T02:00:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.117+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c781454b0 con 0x7f3c78158220 2023-08-31T02:00:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.118+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7804e7c0 con 0x7f3c78158220 2023-08-31T02:00:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.118+0000 7f3c66ffd700 1 -- 172.21.15.84:0/1117693427 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c7001b450 con 0x7f3c78158220 2023-08-31T02:00:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.119+0000 7f3c66ffd700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c5806a0e0 0x7f3c5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.119+0000 7f3c66ffd700 1 -- 172.21.15.84:0/1117693427 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c7008a420 con 0x7f3c78158220 2023-08-31T02:00:11.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.119+0000 7f3c7659c700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c5806a0e0 0x7f3c5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.119+0000 7f3c7659c700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c5806a0e0 0x7f3c5806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c005fd0 tx=0x7f3c6c005e40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:11.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.123+0000 7f3c66ffd700 1 -- 172.21.15.84:0/1117693427 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c700559c0 con 0x7f3c78158220 2023-08-31T02:00:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.324+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c780662e0 con 0x7f3c78158220 2023-08-31T02:00:11.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.325+0000 7f3c66ffd700 1 -- 172.21.15.84:0/1117693427 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f3c70058fe0 con 0x7f3c78158220 2023-08-31T02:00:11.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c5806a0e0 msgr2=0x7f3c5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c5806a0e0 0x7f3c5806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c005fd0 tx=0x7f3c6c005e40 comp rx=0 tx=0).stop 2023-08-31T02:00:11.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c78158220 msgr2=0x7f3c7806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c78158220 0x7f3c7806a770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009fd0 tx=0x7f3c70007c10 comp rx=0 tx=0).stop 2023-08-31T02:00:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 shutdown_connections 2023-08-31T02:00:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3c5806a0e0 0x7f3c5806c5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c78158220 0x7f3c7806a770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c780707c0 0x7f3c78144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 --2- 172.21.15.84:0/1117693427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780b0df0 0x7f3c7806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 >> 172.21.15.84:0/1117693427 conn(0x7f3c780caa20 msgr2=0x7f3c780cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:11.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 shutdown_connections 2023-08-31T02:00:11.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.327+0000 7f3c7ce1e700 1 -- 172.21.15.84:0/1117693427 wait complete. 2023-08-31T02:00:11.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:11.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:11.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.466+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2258879683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6b00b1910 msgr2=0x7fa6b00718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.466+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2258879683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6b00b1910 0x7fa6b00718b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0005fd0 tx=0x7fa6a0009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.466+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2258879683 shutdown_connections 2023-08-31T02:00:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.466+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2258879683 >> v2:172.21.15.170:3300/0 conn(0x7fa6b00b0d00 0x7fa6b00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.466+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2258879683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6b00b1910 0x7fa6b00718b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.466+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2258879683 >> 172.21.15.84:0/2258879683 conn(0x7fa6b00ca930 msgr2=0x7fa6b00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:11.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.466+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2258879683 shutdown_connections 2023-08-31T02:00:11.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.466+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2258879683 wait complete. 2023-08-31T02:00:11.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b7ce2700 1 Processor -- start 2023-08-31T02:00:11.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b7ce2700 1 -- start start 2023-08-31T02:00:11.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b7ce2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b00b0d00 0x7fa6b00c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b7ce2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b00b1910 0x7fa6b00acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b7ce2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6b01591d0 0x7fa6b0150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b7ce2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00c1010 con 0x7fa6b00b1910 2023-08-31T02:00:11.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b7ce2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00c8ed0 con 0x7fa6b00b0d00 2023-08-31T02:00:11.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b7ce2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b01e11c0 con 0x7fa6b01591d0 2023-08-31T02:00:11.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.468+0000 7fa6b527d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b00b1910 0x7fa6b00acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b527d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b00b1910 0x7fa6b00acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51140/0 (socket says 172.21.15.84:51140) 2023-08-31T02:00:11.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b527d700 1 -- 172.21.15.84:0/2398688349 learned_addr learned my addr 172.21.15.84:0/2398688349 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:11.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b627f700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6b01591d0 0x7fa6b0150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b5a7e700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b00b0d00 0x7fa6b00c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b527d700 1 -- 172.21.15.84:0/2398688349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6b01591d0 msgr2=0x7fa6b0150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b527d700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6b01591d0 0x7fa6b0150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b527d700 1 -- 172.21.15.84:0/2398688349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b00b0d00 msgr2=0x7fa6b00c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b527d700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b00b0d00 0x7fa6b00c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b527d700 1 -- 172.21.15.84:0/2398688349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00095f0 con 0x7fa6b00b1910 2023-08-31T02:00:11.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b527d700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b00b1910 0x7fa6b00acc10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00098e0 tx=0x7fa6a0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:11.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6a67fc700 1 -- 172.21.15.84:0/2398688349 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a001d070 con 0x7fa6b00b1910 2023-08-31T02:00:11.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6a67fc700 1 -- 172.21.15.84:0/2398688349 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa6a000b820 con 0x7fa6b00b1910 2023-08-31T02:00:11.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6a67fc700 1 -- 172.21.15.84:0/2398688349 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00045f0 con 0x7fa6b00b1910 2023-08-31T02:00:11.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b00ad150 con 0x7fa6b00b1910 2023-08-31T02:00:11.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.469+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b00c85a0 con 0x7fa6b00b1910 2023-08-31T02:00:11.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.470+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b00c9040 con 0x7fa6b00b1910 2023-08-31T02:00:11.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.471+0000 7fa6a67fc700 1 -- 172.21.15.84:0/2398688349 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6a000bc10 con 0x7fa6b00b1910 2023-08-31T02:00:11.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.471+0000 7fa6a67fc700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa69406a0e0 0x7fa69406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.471+0000 7fa6a67fc700 1 -- 172.21.15.84:0/2398688349 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa6a0089930 con 0x7fa6b00b1910 2023-08-31T02:00:11.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.471+0000 7fa6b5a7e700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa69406a0e0 0x7fa69406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.471+0000 7fa6b5a7e700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa69406a0e0 0x7fa69406c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00b13b0 tx=0x7fa6ac009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:11.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.475+0000 7fa6a67fc700 1 -- 172.21.15.84:0/2398688349 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa6a0054eb0 con 0x7fa6b00b1910 2023-08-31T02:00:11.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.665+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6b004e7c0 con 0x7fa6b00b1910 2023-08-31T02:00:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.665+0000 7fa6a67fc700 1 -- 172.21.15.84:0/2398688349 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6a0026020 con 0x7fa6b00b1910 2023-08-31T02:00:11.658 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa69406a0e0 msgr2=0x7fa69406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa69406a0e0 0x7fa69406c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00b13b0 tx=0x7fa6ac009040 comp rx=0 tx=0).stop 2023-08-31T02:00:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b00b1910 msgr2=0x7fa6b00acc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b00b1910 0x7fa6b00acc10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00098e0 tx=0x7fa6a0003d00 comp rx=0 tx=0).stop 2023-08-31T02:00:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 shutdown_connections 2023-08-31T02:00:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa69406a0e0 0x7fa69406c5a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6b01591d0 0x7fa6b0150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b00b0d00 0x7fa6b00c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 --2- 172.21.15.84:0/2398688349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b00b1910 0x7fa6b00acc10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 >> 172.21.15.84:0/2398688349 conn(0x7fa6b00ca930 msgr2=0x7fa6b0071630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:11.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 shutdown_connections 2023-08-31T02:00:11.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.667+0000 7fa6b7ce2700 1 -- 172.21.15.84:0/2398688349 wait complete. 2023-08-31T02:00:11.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.803+0000 7fb63555c700 1 -- 172.21.15.84:0/3806794119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015b790 msgr2=0x7fb63006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.803+0000 7fb63555c700 1 --2- 172.21.15.84:0/3806794119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015b790 0x7fb63006c720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6240098c0 tx=0x7fb624009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.803+0000 7fb63555c700 1 -- 172.21.15.84:0/3806794119 shutdown_connections 2023-08-31T02:00:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.803+0000 7fb63555c700 1 --2- 172.21.15.84:0/3806794119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6300ca2d0 0x7fb6300cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.803+0000 7fb63555c700 1 --2- 172.21.15.84:0/3806794119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015b790 0x7fb63006c720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.804+0000 7fb63555c700 1 -- 172.21.15.84:0/3806794119 >> 172.21.15.84:0/3806794119 conn(0x7fb6300afb00 msgr2=0x7fb6300aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.804+0000 7fb63555c700 1 -- 172.21.15.84:0/3806794119 shutdown_connections 2023-08-31T02:00:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.804+0000 7fb63555c700 1 -- 172.21.15.84:0/3806794119 wait complete. 2023-08-31T02:00:11.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.805+0000 7fb63555c700 1 Processor -- start 2023-08-31T02:00:11.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.805+0000 7fb63555c700 1 -- start start 2023-08-31T02:00:11.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb63555c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6300ca2d0 0x7fb6301f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb63555c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63015b790 0x7fb6300c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb63555c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015bce0 0x7fb63015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb63555c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300b29e0 con 0x7fb63015bce0 2023-08-31T02:00:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb63555c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300b3c60 con 0x7fb63015b790 2023-08-31T02:00:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb63555c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6301f3a40 con 0x7fb6300ca2d0 2023-08-31T02:00:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015bce0 0x7fb63015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015bce0 0x7fb63015a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51156/0 (socket says 172.21.15.84:51156) 2023-08-31T02:00:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 -- 172.21.15.84:0/3757857581 learned_addr learned my addr 172.21.15.84:0/3757857581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62effd700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6300ca2d0 0x7fb6301f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 -- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6300ca2d0 msgr2=0x7fb6301f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62e7fc700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63015b790 0x7fb6300c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6300ca2d0 0x7fb6301f3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 -- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63015b790 msgr2=0x7fb6300c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63015b790 0x7fb6300c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 -- 172.21.15.84:0/3757857581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624009520 con 0x7fb63015bce0 2023-08-31T02:00:11.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62effd700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6300ca2d0 0x7fb6301f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:11.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62e7fc700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63015b790 0x7fb6300c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:11.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb62f7fe700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015bce0 0x7fb63015a010 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb628007f40 tx=0x7fb62800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:11.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb6177fe700 1 -- 172.21.15.84:0/3757857581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628017070 con 0x7fb63015bce0 2023-08-31T02:00:11.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb6177fe700 1 -- 172.21.15.84:0/3757857581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb62800f040 con 0x7fb63015bce0 2023-08-31T02:00:11.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6300b2bc0 con 0x7fb63015bce0 2023-08-31T02:00:11.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb6177fe700 1 -- 172.21.15.84:0/3757857581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800dbd0 con 0x7fb63015bce0 2023-08-31T02:00:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.806+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6300b3180 con 0x7fb63015bce0 2023-08-31T02:00:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.807+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63004e7c0 con 0x7fb63015bce0 2023-08-31T02:00:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.808+0000 7fb6177fe700 1 -- 172.21.15.84:0/3757857581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb62800dd30 con 0x7fb63015bce0 2023-08-31T02:00:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.808+0000 7fb6177fe700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb61c06a0e0 0x7fb61c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.808+0000 7fb6177fe700 1 -- 172.21.15.84:0/3757857581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6280886f0 con 0x7fb63015bce0 2023-08-31T02:00:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.808+0000 7fb62effd700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb61c06a0e0 0x7fb61c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:11.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.809+0000 7fb62effd700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb61c06a0e0 0x7fb61c06c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb624009230 tx=0x7fb6240047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:11.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:11.812+0000 7fb6177fe700 1 -- 172.21.15.84:0/3757857581 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb628053b40 con 0x7fb63015bce0 2023-08-31T02:00:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.002+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6300718b0 con 0x7fb63015bce0 2023-08-31T02:00:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.002+0000 7fb6177fe700 1 -- 172.21.15.84:0/3757857581 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb628057160 con 0x7fb63015bce0 2023-08-31T02:00:11.995 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb61c06a0e0 msgr2=0x7fb61c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb61c06a0e0 0x7fb61c06c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb624009230 tx=0x7fb6240047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015bce0 msgr2=0x7fb63015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015bce0 0x7fb63015a010 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb628007f40 tx=0x7fb62800d3b0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 shutdown_connections 2023-08-31T02:00:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb61c06a0e0 0x7fb61c06c5a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb63015bce0 0x7fb63015a010 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6300ca2d0 0x7fb6301f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 --2- 172.21.15.84:0/3757857581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63015b790 0x7fb6300c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 >> 172.21.15.84:0/3757857581 conn(0x7fb6300afb00 msgr2=0x7fb6300c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 shutdown_connections 2023-08-31T02:00:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.004+0000 7fb63555c700 1 -- 172.21.15.84:0/3757857581 wait complete. 2023-08-31T02:00:12.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.142+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1116099360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f580d0da0 msgr2=0x7f8f580cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.142+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1116099360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f580d0da0 0x7f8f580cf590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009f60 tx=0x7f8f50009f90 comp rx=0 tx=0).stop 2023-08-31T02:00:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.142+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1116099360 shutdown_connections 2023-08-31T02:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.142+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1116099360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f580d0da0 0x7f8f580cf590 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.142+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1116099360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f580b33e0 0x7f8f580b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.142+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1116099360 >> 172.21.15.84:0/1116099360 conn(0x7f8f580cdcd0 msgr2=0x7f8f580ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.142+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1116099360 shutdown_connections 2023-08-31T02:00:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.142+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1116099360 wait complete. 2023-08-31T02:00:12.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.144+0000 7f8f5ddc8700 1 Processor -- start 2023-08-31T02:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.144+0000 7f8f5ddc8700 1 -- start start 2023-08-31T02:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f5ddc8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f580b33e0 0x7f8f58155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f5ddc8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f580d0da0 0x7f8f580c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f5ddc8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f5815b4d0 0x7f8f58156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f5ddc8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58155560 con 0x7f8f5815b4d0 2023-08-31T02:00:12.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f5ddc8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f581e4810 con 0x7f8f580d0da0 2023-08-31T02:00:12.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f5ddc8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f581e4af0 con 0x7f8f580b33e0 2023-08-31T02:00:12.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f5815b4d0 0x7f8f58156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f5815b4d0 0x7f8f58156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51170/0 (socket says 172.21.15.84:51170) 2023-08-31T02:00:12.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 -- 172.21.15.84:0/1241218555 learned_addr learned my addr 172.21.15.84:0/1241218555 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:12.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f577fe700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f580b33e0 0x7f8f58155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f56ffd700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f580d0da0 0x7f8f580c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 -- 172.21.15.84:0/1241218555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f580b33e0 msgr2=0x7f8f58155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f580b33e0 0x7f8f58155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 -- 172.21.15.84:0/1241218555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f580d0da0 msgr2=0x7f8f580c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f580d0da0 0x7f8f580c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 -- 172.21.15.84:0/1241218555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f50009c40 con 0x7f8f5815b4d0 2023-08-31T02:00:12.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f57fff700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f5815b4d0 0x7f8f58156c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000b6c0 tx=0x7f8f50007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:12.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f3ffff700 1 -- 172.21.15.84:0/1241218555 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5000e040 con 0x7f8f5815b4d0 2023-08-31T02:00:12.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f3ffff700 1 -- 172.21.15.84:0/1241218555 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f50003c00 con 0x7f8f5815b4d0 2023-08-31T02:00:12.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f581e4dd0 con 0x7f8f5815b4d0 2023-08-31T02:00:12.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.145+0000 7f8f3ffff700 1 -- 172.21.15.84:0/1241218555 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50004030 con 0x7f8f5815b4d0 2023-08-31T02:00:12.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.146+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f581e5390 con 0x7f8f5815b4d0 2023-08-31T02:00:12.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.146+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5804e7c0 con 0x7f8f5815b4d0 2023-08-31T02:00:12.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.147+0000 7f8f3ffff700 1 -- 172.21.15.84:0/1241218555 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8f500041b0 con 0x7f8f5815b4d0 2023-08-31T02:00:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.147+0000 7f8f3ffff700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8f4406a0e0 0x7f8f4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.147+0000 7f8f3ffff700 1 -- 172.21.15.84:0/1241218555 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f5008a730 con 0x7f8f5815b4d0 2023-08-31T02:00:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.147+0000 7f8f577fe700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8f4406a0e0 0x7f8f4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.148+0000 7f8f577fe700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8f4406a0e0 0x7f8f4406c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c001090 tx=0x7f8f4c009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:12.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.152+0000 7f8f3ffff700 1 -- 172.21.15.84:0/1241218555 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8f50055c20 con 0x7f8f5815b4d0 2023-08-31T02:00:12.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.339+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f5815ea90 con 0x7f8f5815b4d0 2023-08-31T02:00:12.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.339+0000 7f8f3ffff700 1 -- 172.21.15.84:0/1241218555 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f50059240 con 0x7f8f5815b4d0 2023-08-31T02:00:12.333 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8f4406a0e0 msgr2=0x7f8f4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8f4406a0e0 0x7f8f4406c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c001090 tx=0x7f8f4c009040 comp rx=0 tx=0).stop 2023-08-31T02:00:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f5815b4d0 msgr2=0x7f8f58156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f5815b4d0 0x7f8f58156c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000b6c0 tx=0x7f8f50007aa0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 shutdown_connections 2023-08-31T02:00:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8f4406a0e0 0x7f8f4406c5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f5815b4d0 0x7f8f58156c40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f580b33e0 0x7f8f58155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 --2- 172.21.15.84:0/1241218555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f580d0da0 0x7f8f580c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 >> 172.21.15.84:0/1241218555 conn(0x7f8f580cdcd0 msgr2=0x7f8f5815dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 shutdown_connections 2023-08-31T02:00:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.342+0000 7f8f5ddc8700 1 -- 172.21.15.84:0/1241218555 wait complete. 2023-08-31T02:00:12.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:12.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.480+0000 7fd17904b700 1 -- 172.21.15.84:0/267554253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd15c003a30 msgr2=0x7fd15c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.480+0000 7fd17904b700 1 --2- 172.21.15.84:0/267554253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd15c003a30 0x7fd15c003e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd168001830 tx=0x7fd15c005880 comp rx=0 tx=0).stop 2023-08-31T02:00:12.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.480+0000 7fd17359e700 1 -- 172.21.15.84:0/267554253 reap_dead start 2023-08-31T02:00:12.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.480+0000 7fd17904b700 1 -- 172.21.15.84:0/267554253 shutdown_connections 2023-08-31T02:00:12.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.480+0000 7fd17904b700 1 -- 172.21.15.84:0/267554253 >> 172.21.15.84:0/267554253 conn(0x7fd1740cd980 msgr2=0x7fd1740cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:12.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.480+0000 7fd17904b700 1 -- 172.21.15.84:0/267554253 shutdown_connections 2023-08-31T02:00:12.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.480+0000 7fd17904b700 1 -- 172.21.15.84:0/267554253 wait complete. 2023-08-31T02:00:12.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17904b700 1 Processor -- start 2023-08-31T02:00:12.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17904b700 1 -- start start 2023-08-31T02:00:12.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17904b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd15c003a30 0x7fd1740c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17904b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1740ae580 0x7fd1740af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17904b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1740afe00 0x7fd1741f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17904b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740ad4e0 con 0x7fd1740afe00 2023-08-31T02:00:12.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17904b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740ad7c0 con 0x7fd15c003a30 2023-08-31T02:00:12.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17904b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740adaa0 con 0x7fd1740ae580 2023-08-31T02:00:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1740afe00 0x7fd1741f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1740afe00 0x7fd1741f2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51190/0 (socket says 172.21.15.84:51190) 2023-08-31T02:00:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.482+0000 7fd17359e700 1 -- 172.21.15.84:0/592491747 learned_addr learned my addr 172.21.15.84:0/592491747 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd172d9d700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd15c003a30 0x7fd1740c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17259c700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1740ae580 0x7fd1740af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17359e700 1 -- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1740ae580 msgr2=0x7fd1740af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17359e700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1740ae580 0x7fd1740af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17359e700 1 -- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd15c003a30 msgr2=0x7fd1740c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17359e700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd15c003a30 0x7fd1740c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17359e700 1 -- 172.21.15.84:0/592491747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740add80 con 0x7fd1740afe00 2023-08-31T02:00:12.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17259c700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1740ae580 0x7fd1740af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:12.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17359e700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1740afe00 0x7fd1741f2aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd17406e040 tx=0x7fd16c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:12.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd15b7fe700 1 -- 172.21.15.84:0/592491747 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00e050 con 0x7fd1740afe00 2023-08-31T02:00:12.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd15b7fe700 1 -- 172.21.15.84:0/592491747 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd16c00f040 con 0x7fd1740afe00 2023-08-31T02:00:12.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1740ae060 con 0x7fd1740afe00 2023-08-31T02:00:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd15b7fe700 1 -- 172.21.15.84:0/592491747 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c010e10 con 0x7fd1740afe00 2023-08-31T02:00:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.483+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1740aea00 con 0x7fd1740afe00 2023-08-31T02:00:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.484+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1740ae250 con 0x7fd1740afe00 2023-08-31T02:00:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.484+0000 7fd15b7fe700 1 -- 172.21.15.84:0/592491747 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd16c015440 con 0x7fd1740afe00 2023-08-31T02:00:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.485+0000 7fd15b7fe700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd16006a110 0x7fd16006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.485+0000 7fd15b7fe700 1 -- 172.21.15.84:0/592491747 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd16c089180 con 0x7fd1740afe00 2023-08-31T02:00:12.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.485+0000 7fd172d9d700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd16006a110 0x7fd16006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.485+0000 7fd172d9d700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd16006a110 0x7fd16006c5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd168001750 tx=0x7fd16800f000 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:12.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.489+0000 7fd15b7fe700 1 -- 172.21.15.84:0/592491747 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd16c054670 con 0x7fd1740afe00 2023-08-31T02:00:12.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.675+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd17404e7c0 con 0x7fd1740afe00 2023-08-31T02:00:12.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.675+0000 7fd15b7fe700 1 -- 172.21.15.84:0/592491747 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd16c01a070 con 0x7fd1740afe00 2023-08-31T02:00:12.669 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:12.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.677+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd16006a110 msgr2=0x7fd16006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.677+0000 7fd17904b700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd16006a110 0x7fd16006c5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd168001750 tx=0x7fd16800f000 comp rx=0 tx=0).stop 2023-08-31T02:00:12.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.677+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1740afe00 msgr2=0x7fd1741f2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.677+0000 7fd17904b700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1740afe00 0x7fd1741f2aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd17406e040 tx=0x7fd16c007ec0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.678+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 shutdown_connections 2023-08-31T02:00:12.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.678+0000 7fd17904b700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd16006a110 0x7fd16006c5d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.678+0000 7fd17904b700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1740afe00 0x7fd1741f2aa0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.678+0000 7fd17904b700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd15c003a30 0x7fd1740c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.678+0000 7fd17904b700 1 --2- 172.21.15.84:0/592491747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1740ae580 0x7fd1740af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.678+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 >> 172.21.15.84:0/592491747 conn(0x7fd1740cd980 msgr2=0x7fd174154330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.678+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 shutdown_connections 2023-08-31T02:00:12.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.678+0000 7fd17904b700 1 -- 172.21.15.84:0/592491747 wait complete. 2023-08-31T02:00:12.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:00:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.813+0000 7fa8c9e20700 1 -- 172.21.15.84:0/3380672873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8ac004030 msgr2=0x7fa8ac004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.813+0000 7fa8c9e20700 1 --2- 172.21.15.84:0/3380672873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8ac004030 0x7fa8ac004850 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800bb90 tx=0x7fa8ac005880 comp rx=0 tx=0).stop 2023-08-31T02:00:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.813+0000 7fa8c3fff700 1 -- 172.21.15.84:0/3380672873 reap_dead start 2023-08-31T02:00:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.813+0000 7fa8c9e20700 1 -- 172.21.15.84:0/3380672873 shutdown_connections 2023-08-31T02:00:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.813+0000 7fa8c9e20700 1 -- 172.21.15.84:0/3380672873 >> 172.21.15.84:0/3380672873 conn(0x7fa8c40cdeb0 msgr2=0x7fa8c40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.813+0000 7fa8c9e20700 1 -- 172.21.15.84:0/3380672873 shutdown_connections 2023-08-31T02:00:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.813+0000 7fa8c9e20700 1 -- 172.21.15.84:0/3380672873 wait complete. 2023-08-31T02:00:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.815+0000 7fa8c9e20700 1 Processor -- start 2023-08-31T02:00:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.815+0000 7fa8c9e20700 1 -- start start 2023-08-31T02:00:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.815+0000 7fa8c9e20700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ac004030 0x7fa8c41452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.815+0000 7fa8c9e20700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8c41487f0 0x7fa8c4156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.815+0000 7fa8c9e20700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c4157230 0x7fa8c41f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.815+0000 7fa8c9e20700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c41f5ae0 con 0x7fa8c4157230 2023-08-31T02:00:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.815+0000 7fa8c9e20700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4154f50 con 0x7fa8c41487f0 2023-08-31T02:00:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.815+0000 7fa8c9e20700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4147b10 con 0x7fa8ac004030 2023-08-31T02:00:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c4157230 0x7fa8c41f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c4157230 0x7fa8c41f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51208/0 (socket says 172.21.15.84:51208) 2023-08-31T02:00:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 -- 172.21.15.84:0/4092119672 learned_addr learned my addr 172.21.15.84:0/4092119672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c2ffd700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8c41487f0 0x7fa8c4156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c37fe700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ac004030 0x7fa8c41452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 -- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ac004030 msgr2=0x7fa8c41452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ac004030 0x7fa8c41452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 -- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8c41487f0 msgr2=0x7fa8c4156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8c41487f0 0x7fa8c4156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 -- 172.21.15.84:0/4092119672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4145800 con 0x7fa8c4157230 2023-08-31T02:00:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c37fe700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ac004030 0x7fa8c41452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c3fff700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c4157230 0x7fa8c41f4bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40cb9e0 tx=0x7fa8bc006570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8abfff700 1 -- 172.21.15.84:0/4092119672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011840 con 0x7fa8c4157230 2023-08-31T02:00:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c41f5800 con 0x7fa8c4157230 2023-08-31T02:00:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8abfff700 1 -- 172.21.15.84:0/4092119672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa8bc0119c0 con 0x7fa8c4157230 2023-08-31T02:00:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8abfff700 1 -- 172.21.15.84:0/4092119672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011dd0 con 0x7fa8c4157230 2023-08-31T02:00:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.816+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c4147ff0 con 0x7fa8c4157230 2023-08-31T02:00:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.817+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c404e7c0 con 0x7fa8c4157230 2023-08-31T02:00:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.818+0000 7fa8abfff700 1 -- 172.21.15.84:0/4092119672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa8bc01d460 con 0x7fa8c4157230 2023-08-31T02:00:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.818+0000 7fa8abfff700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa8b006a0e0 0x7fa8b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.818+0000 7fa8abfff700 1 -- 172.21.15.84:0/4092119672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8bc089180 con 0x7fa8c4157230 2023-08-31T02:00:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.818+0000 7fa8c37fe700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa8b006a0e0 0x7fa8b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.819+0000 7fa8c37fe700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa8b006a0e0 0x7fa8b006c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40059d0 tx=0x7fa8b4005900 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:12.822+0000 7fa8abfff700 1 -- 172.21.15.84:0/4092119672 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa8bc054670 con 0x7fa8c4157230 2023-08-31T02:00:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.028+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8c40cd330 con 0x7fa8c4157230 2023-08-31T02:00:13.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.029+0000 7fa8abfff700 1 -- 172.21.15.84:0/4092119672 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa8bc057c90 con 0x7fa8c4157230 2023-08-31T02:00:13.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa8b006a0e0 msgr2=0x7fa8b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa8b006a0e0 0x7fa8b006c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40059d0 tx=0x7fa8b4005900 comp rx=0 tx=0).stop 2023-08-31T02:00:13.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c4157230 msgr2=0x7fa8c41f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c4157230 0x7fa8c41f4bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40cb9e0 tx=0x7fa8bc006570 comp rx=0 tx=0).stop 2023-08-31T02:00:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 shutdown_connections 2023-08-31T02:00:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa8b006a0e0 0x7fa8b006c5a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c4157230 0x7fa8c41f4bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ac004030 0x7fa8c41452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 --2- 172.21.15.84:0/4092119672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8c41487f0 0x7fa8c4156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 >> 172.21.15.84:0/4092119672 conn(0x7fa8c40cdeb0 msgr2=0x7fa8c406d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:13.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 shutdown_connections 2023-08-31T02:00:13.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.031+0000 7fa8c9e20700 1 -- 172.21.15.84:0/4092119672 wait complete. 2023-08-31T02:00:13.027 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:00:13.035 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-08-31T02:00:13.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:13.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-08-31T02:00:13.076 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[111268]: fuse finished with error 0 and tester_r 0 2023-08-31T02:00:13.078 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:00:13.107 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:00:13.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:13.108 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-08-31T02:00:13.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 -- 172.21.15.84:0/1152990116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 msgr2=0x7fe6700cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1152990116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 0x7fe6700cc920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6700c5000 tx=0x7fe66c009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 -- 172.21.15.84:0/1152990116 shutdown_connections 2023-08-31T02:00:13.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1152990116 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6700707c0 0x7fe670070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1152990116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 0x7fe6700cc920 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1152990116 >> v2:172.21.15.170:3300/0 conn(0x7fe6700b0df0 0x7fe6700c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 -- 172.21.15.84:0/1152990116 >> 172.21.15.84:0/1152990116 conn(0x7fe6700caa20 msgr2=0x7fe6700cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:13.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 -- 172.21.15.84:0/1152990116 shutdown_connections 2023-08-31T02:00:13.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.346+0000 7fe6777bc700 1 -- 172.21.15.84:0/1152990116 wait complete. 2023-08-31T02:00:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.347+0000 7fe6777bc700 1 Processor -- start 2023-08-31T02:00:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.347+0000 7fe6777bc700 1 -- start start 2023-08-31T02:00:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe6777bc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6700707c0 0x7fe6700ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe6777bc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6700b0df0 0x7fe6701f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe6777bc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 0x7fe6700af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe6777bc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700ad320 con 0x7fe670158220 2023-08-31T02:00:13.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe6777bc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700ab5f0 con 0x7fe6700707c0 2023-08-31T02:00:13.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe6777bc700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700aca80 con 0x7fe6700b0df0 2023-08-31T02:00:13.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675d59700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 0x7fe6700af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:13.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675d59700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 0x7fe6700af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51222/0 (socket says 172.21.15.84:51222) 2023-08-31T02:00:13.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675d59700 1 -- 172.21.15.84:0/1190214480 learned_addr learned my addr 172.21.15.84:0/1190214480 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:13.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675558700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6700707c0 0x7fe6700ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:13.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe674d57700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6700b0df0 0x7fe6701f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:13.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675d59700 1 -- 172.21.15.84:0/1190214480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6700b0df0 msgr2=0x7fe6701f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675d59700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6700b0df0 0x7fe6701f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675d59700 1 -- 172.21.15.84:0/1190214480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6700707c0 msgr2=0x7fe6700ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675d59700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6700707c0 0x7fe6700ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.348+0000 7fe675d59700 1 -- 172.21.15.84:0/1190214480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c0095f0 con 0x7fe670158220 2023-08-31T02:00:13.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.349+0000 7fe675d59700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 0x7fe6700af9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe66800ada0 tx=0x7fe66800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:13.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.349+0000 7fe665ffb700 1 -- 172.21.15.84:0/1190214480 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800f070 con 0x7fe670158220 2023-08-31T02:00:13.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.349+0000 7fe665ffb700 1 -- 172.21.15.84:0/1190214480 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe66800a0d0 con 0x7fe670158220 2023-08-31T02:00:13.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.349+0000 7fe665ffb700 1 -- 172.21.15.84:0/1190214480 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668004e10 con 0x7fe670158220 2023-08-31T02:00:13.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.349+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6700acd60 con 0x7fe670158220 2023-08-31T02:00:13.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.349+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6701f4fa0 con 0x7fe670158220 2023-08-31T02:00:13.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.350+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67004e7c0 con 0x7fe670158220 2023-08-31T02:00:13.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.350+0000 7fe665ffb700 1 -- 172.21.15.84:0/1190214480 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe66800c8d0 con 0x7fe670158220 2023-08-31T02:00:13.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.351+0000 7fe665ffb700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe65406a0e0 0x7fe65406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:13.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.351+0000 7fe665ffb700 1 -- 172.21.15.84:0/1190214480 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe668088260 con 0x7fe670158220 2023-08-31T02:00:13.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.351+0000 7fe675558700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe65406a0e0 0x7fe65406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:13.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.351+0000 7fe675558700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe65406a0e0 0x7fe65406c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0098e0 tx=0x7fe66c019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.355+0000 7fe665ffb700 1 -- 172.21.15.84:0/1190214480 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe6680537e0 con 0x7fe670158220 2023-08-31T02:00:13.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.544+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6700b0bd0 con 0x7fe670158220 2023-08-31T02:00:13.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.545+0000 7fe665ffb700 1 -- 172.21.15.84:0/1190214480 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fe668056e00 con 0x7fe670158220 2023-08-31T02:00:13.542 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:13.543 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:13.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe65406a0e0 msgr2=0x7fe65406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe65406a0e0 0x7fe65406c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0098e0 tx=0x7fe66c019040 comp rx=0 tx=0).stop 2023-08-31T02:00:13.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 msgr2=0x7fe6700af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 0x7fe6700af9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe66800ada0 tx=0x7fe66800c330 comp rx=0 tx=0).stop 2023-08-31T02:00:13.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 shutdown_connections 2023-08-31T02:00:13.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe65406a0e0 0x7fe65406c5a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe670158220 0x7fe6700af9f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6700707c0 0x7fe6700ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 --2- 172.21.15.84:0/1190214480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6700b0df0 0x7fe6701f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 >> 172.21.15.84:0/1190214480 conn(0x7fe6700caa20 msgr2=0x7fe670157230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:13.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 shutdown_connections 2023-08-31T02:00:13.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.548+0000 7fe6777bc700 1 -- 172.21.15.84:0/1190214480 wait complete. 2023-08-31T02:00:13.553 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.682+0000 7fe794543700 1 -- 172.21.15.84:0/1844523035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe778004d90 msgr2=0x7fe778005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.682+0000 7fe794543700 1 --2- 172.21.15.84:0/1844523035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe778004d90 0x7fe778005210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe78400e350 tx=0x7fe778005880 comp rx=0 tx=0).stop 2023-08-31T02:00:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.682+0000 7fe792ae0700 1 -- 172.21.15.84:0/1844523035 reap_dead start 2023-08-31T02:00:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.682+0000 7fe794543700 1 -- 172.21.15.84:0/1844523035 shutdown_connections 2023-08-31T02:00:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.682+0000 7fe794543700 1 -- 172.21.15.84:0/1844523035 >> 172.21.15.84:0/1844523035 conn(0x7fe78c0caa20 msgr2=0x7fe78c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.682+0000 7fe794543700 1 -- 172.21.15.84:0/1844523035 shutdown_connections 2023-08-31T02:00:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.682+0000 7fe794543700 1 -- 172.21.15.84:0/1844523035 wait complete. 2023-08-31T02:00:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe794543700 1 Processor -- start 2023-08-31T02:00:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe794543700 1 -- start start 2023-08-31T02:00:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe794543700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778004d90 0x7fe78c155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe794543700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe78c0c8760 0x7fe78c0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe794543700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0c8bc0 0x7fe78c0b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe794543700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c1f15b0 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe794543700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0ac720 con 0x7fe778004d90 2023-08-31T02:00:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe794543700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0ac9c0 con 0x7fe78c0c8760 2023-08-31T02:00:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe792ae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0c8bc0 0x7fe78c0b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe792ae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0c8bc0 0x7fe78c0b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51242/0 (socket says 172.21.15.84:51242) 2023-08-31T02:00:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.684+0000 7fe792ae0700 1 -- 172.21.15.84:0/4011710545 learned_addr learned my addr 172.21.15.84:0/4011710545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe791ade700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe78c0c8760 0x7fe78c0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe7922df700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778004d90 0x7fe78c155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe792ae0700 1 -- 172.21.15.84:0/4011710545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe78c0c8760 msgr2=0x7fe78c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe792ae0700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe78c0c8760 0x7fe78c0b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe792ae0700 1 -- 172.21.15.84:0/4011710545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778004d90 msgr2=0x7fe78c155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe792ae0700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778004d90 0x7fe78c155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe792ae0700 1 -- 172.21.15.84:0/4011710545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c06ce40 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe792ae0700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0c8bc0 0x7fe78c0b2670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe784002230 tx=0x7fe7840093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe782ffd700 1 -- 172.21.15.84:0/4011710545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784018070 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe782ffd700 1 -- 172.21.15.84:0/4011710545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe784019040 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe782ffd700 1 -- 172.21.15.84:0/4011710545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784003e70 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c0acca0 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.685+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c1589d0 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.686+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c04e7c0 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.686+0000 7fe782ffd700 1 -- 172.21.15.84:0/4011710545 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe784007500 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.687+0000 7fe782ffd700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe77006a110 0x7fe77006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.687+0000 7fe782ffd700 1 -- 172.21.15.84:0/4011710545 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe784089660 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.687+0000 7fe7922df700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe77006a110 0x7fe77006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.687+0000 7fe7922df700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe77006a110 0x7fe77006c5d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe77c001050 tx=0x7fe77c001e70 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.691+0000 7fe782ffd700 1 -- 172.21.15.84:0/4011710545 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe784054be0 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.884+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe78c0caea0 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.885+0000 7fe782ffd700 1 -- 172.21.15.84:0/4011710545 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fe784058200 con 0x7fe78c0c8bc0 2023-08-31T02:00:13.878 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:13.878 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe77006a110 msgr2=0x7fe77006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe77006a110 0x7fe77006c5d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe77c001050 tx=0x7fe77c001e70 comp rx=0 tx=0).stop 2023-08-31T02:00:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0c8bc0 msgr2=0x7fe78c0b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:13.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0c8bc0 0x7fe78c0b2670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe784002230 tx=0x7fe7840093b0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 shutdown_connections 2023-08-31T02:00:13.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe77006a110 0x7fe77006c5d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0c8bc0 0x7fe78c0b2670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778004d90 0x7fe78c155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 --2- 172.21.15.84:0/4011710545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe78c0c8760 0x7fe78c0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:13.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 >> 172.21.15.84:0/4011710545 conn(0x7fe78c0caa20 msgr2=0x7fe78c0af050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:13.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 shutdown_connections 2023-08-31T02:00:13.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:13.887+0000 7fe794543700 1 -- 172.21.15.84:0/4011710545 wait complete. 2023-08-31T02:00:13.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T02:00:14.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.025+0000 7f8025df0700 1 -- 172.21.15.84:0/1978413620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020070040 msgr2=0x7f8020070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:14.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.025+0000 7f8025df0700 1 --2- 172.21.15.84:0/1978413620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020070040 0x7f8020070480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8018009fd0 tx=0x7f801800b380 comp rx=0 tx=0).stop 2023-08-31T02:00:14.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.025+0000 7f8025df0700 1 -- 172.21.15.84:0/1978413620 shutdown_connections 2023-08-31T02:00:14.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.025+0000 7f8025df0700 1 --2- 172.21.15.84:0/1978413620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020070040 0x7f8020070480 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:14.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.025+0000 7f8025df0700 1 --2- 172.21.15.84:0/1978413620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80200b23a0 0x7f802015d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:14.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.025+0000 7f8025df0700 1 -- 172.21.15.84:0/1978413620 >> 172.21.15.84:0/1978413620 conn(0x7f80200cd980 msgr2=0x7f80200cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:14.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.026+0000 7f8025df0700 1 -- 172.21.15.84:0/1978413620 shutdown_connections 2023-08-31T02:00:14.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.026+0000 7f8025df0700 1 -- 172.21.15.84:0/1978413620 wait complete. 2023-08-31T02:00:14.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.027+0000 7f8025df0700 1 Processor -- start 2023-08-31T02:00:14.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.027+0000 7f8025df0700 1 -- start start 2023-08-31T02:00:14.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.027+0000 7f8025df0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020070040 0x7f80200ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:14.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8025df0700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80200b23a0 0x7f80200a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:14.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8025df0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020156c60 0x7f8020154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:14.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8025df0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020155330 con 0x7f8020156c60 2023-08-31T02:00:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8025df0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020154da0 con 0x7f8020070040 2023-08-31T02:00:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8025df0700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80201f1830 con 0x7f80200b23a0 2023-08-31T02:00:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020156c60 0x7f8020154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020156c60 0x7f8020154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51256/0 (socket says 172.21.15.84:51256) 2023-08-31T02:00:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 -- 172.21.15.84:0/2666122648 learned_addr learned my addr 172.21.15.84:0/2666122648 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801effd700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80200b23a0 0x7f80200a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801f7fe700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020070040 0x7f80200ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 -- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80200b23a0 msgr2=0x7f80200a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80200b23a0 0x7f80200a6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 -- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020070040 msgr2=0x7f80200ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:14.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020070040 0x7f80200ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:14.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 -- 172.21.15.84:0/2666122648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009d00 con 0x7f8020156c60 2023-08-31T02:00:14.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801effd700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80200b23a0 0x7f80200a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:14.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801f7fe700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020070040 0x7f80200ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:14.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f801ffff700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020156c60 0x7f8020154860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8020070f10 tx=0x7f8018003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:14.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8007fff700 1 -- 172.21.15.84:0/2666122648 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800e070 con 0x7f8020156c60 2023-08-31T02:00:14.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8007fff700 1 -- 172.21.15.84:0/2666122648 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8018007ac0 con 0x7f8020156c60 2023-08-31T02:00:14.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80200a7560 con 0x7f8020156c60 2023-08-31T02:00:14.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8007fff700 1 -- 172.21.15.84:0/2666122648 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018004030 con 0x7f8020156c60 2023-08-31T02:00:14.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.028+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80200a7b20 con 0x7f8020156c60 2023-08-31T02:00:14.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.029+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802004e7c0 con 0x7f8020156c60 2023-08-31T02:00:14.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.030+0000 7f8007fff700 1 -- 172.21.15.84:0/2666122648 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8018019040 con 0x7f8020156c60 2023-08-31T02:00:14.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.030+0000 7f8007fff700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f800c06a0e0 0x7f800c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:14.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.030+0000 7f8007fff700 1 -- 172.21.15.84:0/2666122648 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8018089e50 con 0x7f8020156c60 2023-08-31T02:00:14.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.030+0000 7f801f7fe700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f800c06a0e0 0x7f800c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:14.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.030+0000 7f801f7fe700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f800c06a0e0 0x7f800c06c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80200af1f0 tx=0x7f8014008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.035+0000 7f8007fff700 1 -- 172.21.15.84:0/2666122648 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8018055350 con 0x7f8020156c60 2023-08-31T02:00:14.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:14.272+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f80200c9770 con 0x7f8020156c60 2023-08-31T02:00:15.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.191+0000 7f8007fff700 1 -- 172.21.15.84:0/2666122648 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f80180212c0 con 0x7f8020156c60 2023-08-31T02:00:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f800c06a0e0 msgr2=0x7f800c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f800c06a0e0 0x7f800c06c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80200af1f0 tx=0x7f8014008040 comp rx=0 tx=0).stop 2023-08-31T02:00:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020156c60 msgr2=0x7f8020154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020156c60 0x7f8020154860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8020070f10 tx=0x7f8018003ef0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 shutdown_connections 2023-08-31T02:00:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f800c06a0e0 0x7f800c06c5a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020156c60 0x7f8020154860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020070040 0x7f80200ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 --2- 172.21.15.84:0/2666122648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80200b23a0 0x7f80200a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.194+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 >> 172.21.15.84:0/2666122648 conn(0x7f80200cd980 msgr2=0x7f80200cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.195+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 shutdown_connections 2023-08-31T02:00:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.195+0000 7f8025df0700 1 -- 172.21.15.84:0/2666122648 wait complete. 2023-08-31T02:00:15.202 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-08-31T02:00:15.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T02:00:15.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.342+0000 7ffac448b700 1 -- 172.21.15.84:0/1329735450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 msgr2=0x7ffabc0704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.342+0000 7ffac448b700 1 --2- 172.21.15.84:0/1329735450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 0x7ffabc0704b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0ca180 tx=0x7ffab400b380 comp rx=0 tx=0).stop 2023-08-31T02:00:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.342+0000 7ffac448b700 1 -- 172.21.15.84:0/1329735450 shutdown_connections 2023-08-31T02:00:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.342+0000 7ffac448b700 1 --2- 172.21.15.84:0/1329735450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 0x7ffabc0704b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.342+0000 7ffac448b700 1 --2- 172.21.15.84:0/1329735450 >> v2:172.21.15.170:3300/0 conn(0x7ffabc156c60 0x7ffabc0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.342+0000 7ffac448b700 1 -- 172.21.15.84:0/1329735450 >> 172.21.15.84:0/1329735450 conn(0x7ffabc0cd980 msgr2=0x7ffabc0cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.342+0000 7ffac448b700 1 -- 172.21.15.84:0/1329735450 shutdown_connections 2023-08-31T02:00:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.342+0000 7ffac448b700 1 -- 172.21.15.84:0/1329735450 wait complete. 2023-08-31T02:00:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.343+0000 7ffac448b700 1 Processor -- start 2023-08-31T02:00:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.343+0000 7ffac448b700 1 -- start start 2023-08-31T02:00:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac448b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 0x7ffabc06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac448b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffabc156c60 0x7ffabc06cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac448b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffabc15d7e0 0x7ffabc1efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac448b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc06a820 con 0x7ffabc070040 2023-08-31T02:00:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac448b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc06aa50 con 0x7ffabc156c60 2023-08-31T02:00:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac448b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc06ad30 con 0x7ffabc15d7e0 2023-08-31T02:00:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2227700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 0x7ffabc06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2227700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 0x7ffabc06a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51266/0 (socket says 172.21.15.84:51266) 2023-08-31T02:00:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2227700 1 -- 172.21.15.84:0/1331862603 learned_addr learned my addr 172.21.15.84:0/1331862603 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2a28700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffabc15d7e0 0x7ffabc1efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac1a26700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffabc156c60 0x7ffabc06cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2227700 1 -- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffabc15d7e0 msgr2=0x7ffabc1efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2227700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffabc15d7e0 0x7ffabc1efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2227700 1 -- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffabc156c60 msgr2=0x7ffabc06cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2227700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffabc156c60 0x7ffabc06cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac2227700 1 -- 172.21.15.84:0/1331862603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4009d00 con 0x7ffabc070040 2023-08-31T02:00:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.344+0000 7ffac1a26700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffabc156c60 0x7ffabc06cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.345+0000 7ffac2227700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 0x7ffabc06a2e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00d980 tx=0x7ffaac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.345+0000 7ffab2ffd700 1 -- 172.21.15.84:0/1331862603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac004a30 con 0x7ffabc070040 2023-08-31T02:00:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.345+0000 7ffab2ffd700 1 -- 172.21.15.84:0/1331862603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffaac004c80 con 0x7ffabc070040 2023-08-31T02:00:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.345+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc06b010 con 0x7ffabc070040 2023-08-31T02:00:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.345+0000 7ffab2ffd700 1 -- 172.21.15.84:0/1331862603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac005280 con 0x7ffabc070040 2023-08-31T02:00:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.345+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc06d2b0 con 0x7ffabc070040 2023-08-31T02:00:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.346+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc0ae1c0 con 0x7ffabc070040 2023-08-31T02:00:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.346+0000 7ffab2ffd700 1 -- 172.21.15.84:0/1331862603 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffaac0053e0 con 0x7ffabc070040 2023-08-31T02:00:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.346+0000 7ffab2ffd700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.347+0000 7ffab2ffd700 1 -- 172.21.15.84:0/1331862603 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffaac088d00 con 0x7ffabc070040 2023-08-31T02:00:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.347+0000 7ffac1a26700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.347+0000 7ffac1a26700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000f60 tx=0x7ffab8009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.351+0000 7ffab2ffd700 1 -- 172.21.15.84:0/1331862603 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffaac0541f0 con 0x7ffabc070040 2023-08-31T02:00:15.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:15.583+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffabc04e7c0 con 0x7ffabc070040 2023-08-31T02:00:16.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.198+0000 7ffab2ffd700 1 -- 172.21.15.84:0/1331862603 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffaac017020 con 0x7ffabc070040 2023-08-31T02:00:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.200+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffaa006a0e0 msgr2=0x7ffaa006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.200+0000 7ffac448b700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000f60 tx=0x7ffab8009040 comp rx=0 tx=0).stop 2023-08-31T02:00:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 msgr2=0x7ffabc06a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 0x7ffabc06a2e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00d980 tx=0x7ffaac00dc90 comp rx=0 tx=0).stop 2023-08-31T02:00:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 shutdown_connections 2023-08-31T02:00:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffabc15d7e0 0x7ffabc1efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffabc070040 0x7ffabc06a2e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 --2- 172.21.15.84:0/1331862603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffabc156c60 0x7ffabc06cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 >> 172.21.15.84:0/1331862603 conn(0x7ffabc0cd980 msgr2=0x7ffabc1e4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 shutdown_connections 2023-08-31T02:00:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.201+0000 7ffac448b700 1 -- 172.21.15.84:0/1331862603 wait complete. 2023-08-31T02:00:16.207 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T02:00:16.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:00:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.344+0000 7fd34134e700 1 -- 172.21.15.84:0/2284622283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd324003a00 msgr2=0x7fd324003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.344+0000 7fd34134e700 1 --2- 172.21.15.84:0/2284622283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd324003a00 0x7fd324003e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd330009be0 tx=0x7fd324005880 comp rx=0 tx=0).stop 2023-08-31T02:00:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.344+0000 7fd33b7fe700 1 -- 172.21.15.84:0/2284622283 reap_dead start 2023-08-31T02:00:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.344+0000 7fd34134e700 1 -- 172.21.15.84:0/2284622283 shutdown_connections 2023-08-31T02:00:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.344+0000 7fd34134e700 1 -- 172.21.15.84:0/2284622283 >> 172.21.15.84:0/2284622283 conn(0x7fd33c0d11c0 msgr2=0x7fd33c0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.344+0000 7fd34134e700 1 -- 172.21.15.84:0/2284622283 shutdown_connections 2023-08-31T02:00:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.344+0000 7fd34134e700 1 -- 172.21.15.84:0/2284622283 wait complete. 2023-08-31T02:00:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.345+0000 7fd34134e700 1 Processor -- start 2023-08-31T02:00:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.345+0000 7fd34134e700 1 -- start start 2023-08-31T02:00:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd34134e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd324003a00 0x7fd33c14d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd34134e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd33c0ab490 0x7fd33c0ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd34134e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd33c0c9880 0x7fd33c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd34134e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0ca240 con 0x7fd33c0ab490 2023-08-31T02:00:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd34134e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c14f690 con 0x7fd324003a00 2023-08-31T02:00:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd34134e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c14ea80 con 0x7fd33c0c9880 2023-08-31T02:00:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd33c0ab490 0x7fd33c0ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd33c0ab490 0x7fd33c0ab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51288/0 (socket says 172.21.15.84:51288) 2023-08-31T02:00:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33a7fc700 1 -- 172.21.15.84:0/1469123983 learned_addr learned my addr 172.21.15.84:0/1469123983 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33affd700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd324003a00 0x7fd33c14d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33b7fe700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd33c0c9880 0x7fd33c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33a7fc700 1 -- 172.21.15.84:0/1469123983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd33c0c9880 msgr2=0x7fd33c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33a7fc700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd33c0c9880 0x7fd33c0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33a7fc700 1 -- 172.21.15.84:0/1469123983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd324003a00 msgr2=0x7fd33c14d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33a7fc700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd324003a00 0x7fd33c14d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.346+0000 7fd33a7fc700 1 -- 172.21.15.84:0/1469123983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c14ed60 con 0x7fd33c0ab490 2023-08-31T02:00:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.347+0000 7fd33a7fc700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd33c0ab490 0x7fd33c0ab910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0066b0 tx=0x7fd32c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.347+0000 7fd3237fe700 1 -- 172.21.15.84:0/1469123983 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c011840 con 0x7fd33c0ab490 2023-08-31T02:00:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.347+0000 7fd3237fe700 1 -- 172.21.15.84:0/1469123983 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd32c0119c0 con 0x7fd33c0ab490 2023-08-31T02:00:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.347+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c14f040 con 0x7fd33c0ab490 2023-08-31T02:00:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.347+0000 7fd3237fe700 1 -- 172.21.15.84:0/1469123983 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c011dd0 con 0x7fd33c0ab490 2023-08-31T02:00:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.347+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c14d8c0 con 0x7fd33c0ab490 2023-08-31T02:00:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.348+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c04e7c0 con 0x7fd33c0ab490 2023-08-31T02:00:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.348+0000 7fd3237fe700 1 -- 172.21.15.84:0/1469123983 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd32c0103c0 con 0x7fd33c0ab490 2023-08-31T02:00:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.349+0000 7fd3237fe700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd32806a0e0 0x7fd32806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.349+0000 7fd33affd700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd32806a0e0 0x7fd32806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.349+0000 7fd3237fe700 1 -- 172.21.15.84:0/1469123983 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd32c089540 con 0x7fd33c0ab490 2023-08-31T02:00:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.349+0000 7fd33affd700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd32806a0e0 0x7fd32806c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd330009be0 tx=0x7fd330004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.353+0000 7fd3237fe700 1 -- 172.21.15.84:0/1469123983 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd32c054a20 con 0x7fd33c0ab490 2023-08-31T02:00:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.586+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd33c06c720 con 0x7fd33c0ab490 2023-08-31T02:00:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.586+0000 7fd3237fe700 1 -- 172.21.15.84:0/1469123983 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fd32c01f090 con 0x7fd33c0ab490 2023-08-31T02:00:16.579 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:16.579 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:16.191493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T02:00:16.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.588+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd32806a0e0 msgr2=0x7fd32806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.588+0000 7fd34134e700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd32806a0e0 0x7fd32806c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd330009be0 tx=0x7fd330004750 comp rx=0 tx=0).stop 2023-08-31T02:00:16.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd33c0ab490 msgr2=0x7fd33c0ab910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd33c0ab490 0x7fd33c0ab910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0066b0 tx=0x7fd32c003960 comp rx=0 tx=0).stop 2023-08-31T02:00:16.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 shutdown_connections 2023-08-31T02:00:16.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd32806a0e0 0x7fd32806c5a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd33c0c9880 0x7fd33c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd324003a00 0x7fd33c14d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 --2- 172.21.15.84:0/1469123983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd33c0ab490 0x7fd33c0ab910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 >> 172.21.15.84:0/1469123983 conn(0x7fd33c0d11c0 msgr2=0x7fd33c15d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:16.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 shutdown_connections 2023-08-31T02:00:16.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.589+0000 7fd34134e700 1 -- 172.21.15.84:0/1469123983 wait complete. 2023-08-31T02:00:16.586 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-08-31T02:00:16.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:16.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.723+0000 7f8a32af6700 1 -- 172.21.15.84:0/2693560569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 msgr2=0x7f8a1c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.723+0000 7f8a32af6700 1 --2- 172.21.15.84:0/2693560569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 0x7f8a1c003e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009be0 tx=0x7f8a1c005880 comp rx=0 tx=0).stop 2023-08-31T02:00:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.723+0000 7f8a32af6700 1 -- 172.21.15.84:0/2693560569 shutdown_connections 2023-08-31T02:00:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.723+0000 7f8a32af6700 1 --2- 172.21.15.84:0/2693560569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 0x7f8a1c003e20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.723+0000 7f8a32af6700 1 -- 172.21.15.84:0/2693560569 >> 172.21.15.84:0/2693560569 conn(0x7f8a2c0caa20 msgr2=0x7f8a2c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.723+0000 7f8a32af6700 1 -- 172.21.15.84:0/2693560569 shutdown_connections 2023-08-31T02:00:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.723+0000 7f8a32af6700 1 -- 172.21.15.84:0/2693560569 wait complete. 2023-08-31T02:00:16.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.724+0000 7f8a32af6700 1 Processor -- start 2023-08-31T02:00:16.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.724+0000 7f8a32af6700 1 -- start start 2023-08-31T02:00:16.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a32af6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 0x7f8a2c1ef410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:16.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a32af6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a2c1f21d0 0x7f8a2c1e1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:16.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a32af6700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a2c1e15d0 0x7f8a2c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:16.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a32af6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1e1ae0 con 0x7f8a1c003a00 2023-08-31T02:00:16.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a32af6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1e1dc0 con 0x7f8a2c1f21d0 2023-08-31T02:00:16.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a32af6700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1e20a0 con 0x7f8a2c1e15d0 2023-08-31T02:00:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a30892700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 0x7f8a2c1ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a30892700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 0x7f8a2c1ef410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51308/0 (socket says 172.21.15.84:51308) 2023-08-31T02:00:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a30892700 1 -- 172.21.15.84:0/2484578565 learned_addr learned my addr 172.21.15.84:0/2484578565 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a31093700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a2c1e15d0 0x7f8a2c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a30892700 1 -- 172.21.15.84:0/2484578565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a2c1e15d0 msgr2=0x7f8a2c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a30892700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a2c1e15d0 0x7f8a2c0c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a30892700 1 -- 172.21.15.84:0/2484578565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a2c1f21d0 msgr2=0x7f8a2c1e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.725+0000 7f8a2bfff700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a2c1f21d0 0x7f8a2c1e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.726+0000 7f8a30892700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a2c1f21d0 0x7f8a2c1e1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.726+0000 7f8a30892700 1 -- 172.21.15.84:0/2484578565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c1e2380 con 0x7f8a1c003a00 2023-08-31T02:00:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.726+0000 7f8a30892700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 0x7f8a2c1ef410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8a20016000 tx=0x7f8a20005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.726+0000 7f8a297fa700 1 -- 172.21.15.84:0/2484578565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20025070 con 0x7f8a1c003a00 2023-08-31T02:00:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.726+0000 7f8a297fa700 1 -- 172.21.15.84:0/2484578565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a20004830 con 0x7f8a1c003a00 2023-08-31T02:00:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.726+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c1e2660 con 0x7f8a1c003a00 2023-08-31T02:00:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.726+0000 7f8a297fa700 1 -- 172.21.15.84:0/2484578565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20004a40 con 0x7f8a1c003a00 2023-08-31T02:00:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.726+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c156cd0 con 0x7f8a1c003a00 2023-08-31T02:00:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.727+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c1e28a0 con 0x7f8a1c003a00 2023-08-31T02:00:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.727+0000 7f8a297fa700 1 -- 172.21.15.84:0/2484578565 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8a20003680 con 0x7f8a1c003a00 2023-08-31T02:00:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.728+0000 7f8a297fa700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8a1006a0e0 0x7f8a1006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:16.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.728+0000 7f8a2bfff700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8a1006a0e0 0x7f8a1006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:16.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.728+0000 7f8a297fa700 1 -- 172.21.15.84:0/2484578565 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a20014070 con 0x7f8a1c003a00 2023-08-31T02:00:16.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.728+0000 7f8a2bfff700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8a1006a0e0 0x7f8a1006c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0ccc30 tx=0x7f8a18000f10 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:16.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.732+0000 7f8a297fa700 1 -- 172.21.15.84:0/2484578565 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8a2c1e28a0 con 0x7f8a1c003a00 2023-08-31T02:00:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.923+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a2c1e28a0 con 0x7f8a1c003a00 2023-08-31T02:00:16.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.924+0000 7f8a297fa700 1 -- 172.21.15.84:0/2484578565 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f8a2c1e28a0 con 0x7f8a1c003a00 2023-08-31T02:00:16.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:16.917 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:16.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8a1006a0e0 msgr2=0x7f8a1006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8a1006a0e0 0x7f8a1006c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0ccc30 tx=0x7f8a18000f10 comp rx=0 tx=0).stop 2023-08-31T02:00:16.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 msgr2=0x7f8a2c1ef410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:16.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 0x7f8a2c1ef410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8a20016000 tx=0x7f8a20005e50 comp rx=0 tx=0).stop 2023-08-31T02:00:16.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 shutdown_connections 2023-08-31T02:00:16.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8a1006a0e0 0x7f8a1006c5a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a2c1e15d0 0x7f8a2c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c003a00 0x7f8a2c1ef410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 --2- 172.21.15.84:0/2484578565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a2c1f21d0 0x7f8a2c1e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:16.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 >> 172.21.15.84:0/2484578565 conn(0x7f8a2c0caa20 msgr2=0x7f8a2c06a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:16.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 shutdown_connections 2023-08-31T02:00:16.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:16.926+0000 7f8a32af6700 1 -- 172.21.15.84:0/2484578565 wait complete. 2023-08-31T02:00:16.931 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T02:00:16.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:00:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.062+0000 7f35b0fd7700 1 -- 172.21.15.84:0/526546321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac0cc920 msgr2=0x7f35ac0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.062+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/526546321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac0cc920 0x7f35ac0c9ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0b40e0 tx=0x7f359c009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.062+0000 7f35b0fd7700 1 -- 172.21.15.84:0/526546321 shutdown_connections 2023-08-31T02:00:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.062+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/526546321 >> v2:172.21.15.170:3300/0 conn(0x7f35ac0707c0 0x7f35ac070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.062+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/526546321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac0cc920 0x7f35ac0c9ac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.062+0000 7f35b0fd7700 1 -- 172.21.15.84:0/526546321 >> 172.21.15.84:0/526546321 conn(0x7f35ac0caa20 msgr2=0x7f35ac0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.062+0000 7f35b0fd7700 1 -- 172.21.15.84:0/526546321 shutdown_connections 2023-08-31T02:00:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.062+0000 7f35b0fd7700 1 -- 172.21.15.84:0/526546321 wait complete. 2023-08-31T02:00:17.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35b0fd7700 1 Processor -- start 2023-08-31T02:00:17.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35b0fd7700 1 -- start start 2023-08-31T02:00:17.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35b0fd7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35ac0707c0 0x7f35ac0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35b0fd7700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35ac0cc920 0x7f35ac0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35b0fd7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac158220 0x7f35ac14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35b0fd7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0b1be0 con 0x7f35ac158220 2023-08-31T02:00:17.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35b0fd7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0ac060 con 0x7f35ac0707c0 2023-08-31T02:00:17.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35b0fd7700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0abd30 con 0x7f35ac0cc920 2023-08-31T02:00:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35aad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac158220 0x7f35ac14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35aad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac158220 0x7f35ac14a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51324/0 (socket says 172.21.15.84:51324) 2023-08-31T02:00:17.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.064+0000 7f35aad9d700 1 -- 172.21.15.84:0/39951241 learned_addr learned my addr 172.21.15.84:0/39951241 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:17.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35a9d9b700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35ac0cc920 0x7f35ac0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35aa59c700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35ac0707c0 0x7f35ac0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35aad9d700 1 -- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35ac0cc920 msgr2=0x7f35ac0b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35aad9d700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35ac0cc920 0x7f35ac0b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35aad9d700 1 -- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35ac0707c0 msgr2=0x7f35ac0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35aad9d700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35ac0707c0 0x7f35ac0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35aad9d700 1 -- 172.21.15.84:0/39951241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c009520 con 0x7f35ac158220 2023-08-31T02:00:17.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35aa59c700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35ac0707c0 0x7f35ac0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:17.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35aad9d700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac158220 0x7f35ac14a9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35a4007f10 tx=0x7f35a400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:17.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f359affd700 1 -- 172.21.15.84:0/39951241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4017070 con 0x7f35ac158220 2023-08-31T02:00:17.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f359affd700 1 -- 172.21.15.84:0/39951241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f35a400f040 con 0x7f35ac158220 2023-08-31T02:00:17.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac0b10a0 con 0x7f35ac158220 2023-08-31T02:00:17.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f359affd700 1 -- 172.21.15.84:0/39951241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4004df0 con 0x7f35ac158220 2023-08-31T02:00:17.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.065+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac0b1620 con 0x7f35ac158220 2023-08-31T02:00:17.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.066+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac0ac1d0 con 0x7f35ac158220 2023-08-31T02:00:17.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.066+0000 7f359affd700 1 -- 172.21.15.84:0/39951241 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f35a400dbd0 con 0x7f35ac158220 2023-08-31T02:00:17.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.067+0000 7f359affd700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f358c06a0e0 0x7f358c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.067+0000 7f359affd700 1 -- 172.21.15.84:0/39951241 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35a40883e0 con 0x7f35ac158220 2023-08-31T02:00:17.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.067+0000 7f35aa59c700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f358c06a0e0 0x7f358c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.067+0000 7f35aa59c700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f358c06a0e0 0x7f358c06c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35a0004740 tx=0x7f35a0009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:17.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.071+0000 7f359affd700 1 -- 172.21.15.84:0/39951241 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f35a4053960 con 0x7f35ac158220 2023-08-31T02:00:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.260+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35ac06d2b0 con 0x7f358c06a0e0 2023-08-31T02:00:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.269+0000 7f359affd700 1 -- 172.21.15.84:0/39951241 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345275 (secure 0 0 0) 0x7f35a00133e0 con 0x7f358c06a0e0 2023-08-31T02:00:17.266 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:17.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f358c06a0e0 msgr2=0x7f358c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f358c06a0e0 0x7f358c06c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35a0004740 tx=0x7f35a0009040 comp rx=0 tx=0).stop 2023-08-31T02:00:17.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac158220 msgr2=0x7f35ac14a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac158220 0x7f35ac14a9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35a4007f10 tx=0x7f35a400d3b0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 shutdown_connections 2023-08-31T02:00:17.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f358c06a0e0 0x7f358c06c5a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35ac158220 0x7f35ac14a9c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35ac0707c0 0x7f35ac0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 --2- 172.21.15.84:0/39951241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35ac0cc920 0x7f35ac0b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 >> 172.21.15.84:0/39951241 conn(0x7f35ac0caa20 msgr2=0x7f35ac0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:17.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 shutdown_connections 2023-08-31T02:00:17.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.273+0000 7f35b0fd7700 1 -- 172.21.15.84:0/39951241 wait complete. 2023-08-31T02:00:17.273 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:00:17.277 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-08-31T02:00:17.053563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219532,"kb_used_data":3368,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755188,"statfs":{"total":773094113280,"available":772869312512,"internally_reserved":0,"allocated":3448832,"data_stored":2049616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181204+0000","last_change":"2023-08-31T01:59:59.153066+0000","last_active":"2023-08-31T02:00:03.181204+0000","last_peered":"2023-08-31T02:00:03.181204+0000","last_clean":"2023-08-31T02:00:03.181204+0000","last_became_active":"2023-08-31T01:59:59.152543+0000","last_became_peered":"2023-08-31T01:59:59.152543+0000","last_unstale":"2023-08-31T02:00:03.181204+0000","last_undegraded":"2023-08-31T02:00:03.181204+0000","last_fullsized":"2023-08-31T02:00:03.181204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:17.842126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183513+0000","last_change":"2023-08-31T01:59:59.132145+0000","last_active":"2023-08-31T02:00:03.183513+0000","last_peered":"2023-08-31T02:00:03.183513+0000","last_clean":"2023-08-31T02:00:03.183513+0000","last_became_active":"2023-08-31T01:59:59.131885+0000","last_became_peered":"2023-08-31T01:59:59.131885+0000","last_unstale":"2023-08-31T02:00:03.183513+0000","last_undegraded":"2023-08-31T02:00:03.183513+0000","last_fullsized":"2023-08-31T02:00:03.183513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169077+0000","last_change":"2023-08-31T01:59:59.131265+0000","last_active":"2023-08-31T02:00:03.169077+0000","last_peered":"2023-08-31T02:00:03.169077+0000","last_clean":"2023-08-31T02:00:03.169077+0000","last_became_active":"2023-08-31T01:59:59.130984+0000","last_became_peered":"2023-08-31T01:59:59.130984+0000","last_unstale":"2023-08-31T02:00:03.169077+0000","last_undegraded":"2023-08-31T02:00:03.169077+0000","last_fullsized":"2023-08-31T02:00:03.169077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:24:58.176806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162779+0000","last_change":"2023-08-31T01:59:59.142792+0000","last_active":"2023-08-31T02:00:03.162779+0000","last_peered":"2023-08-31T02:00:03.162779+0000","last_clean":"2023-08-31T02:00:03.162779+0000","last_became_active":"2023-08-31T01:59:59.142520+0000","last_became_peered":"2023-08-31T01:59:59.142520+0000","last_unstale":"2023-08-31T02:00:03.162779+0000","last_undegraded":"2023-08-31T02:00:03.162779+0000","last_fullsized":"2023-08-31T02:00:03.162779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:46.986597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180530+0000","last_change":"2023-08-31T01:59:59.140365+0000","last_active":"2023-08-31T02:00:03.180530+0000","last_peered":"2023-08-31T02:00:03.180530+0000","last_clean":"2023-08-31T02:00:03.180530+0000","last_became_active":"2023-08-31T01:59:59.140113+0000","last_became_peered":"2023-08-31T01:59:59.140113+0000","last_unstale":"2023-08-31T02:00:03.180530+0000","last_undegraded":"2023-08-31T02:00:03.180530+0000","last_fullsized":"2023-08-31T02:00:03.180530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:55:33.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163582+0000","last_change":"2023-08-31T01:59:59.134781+0000","last_active":"2023-08-31T02:00:03.163582+0000","last_peered":"2023-08-31T02:00:03.163582+0000","last_clean":"2023-08-31T02:00:03.163582+0000","last_became_active":"2023-08-31T01:59:59.134480+0000","last_became_peered":"2023-08-31T01:59:59.134480+0000","last_unstale":"2023-08-31T02:00:03.163582+0000","last_undegraded":"2023-08-31T02:00:03.163582+0000","last_fullsized":"2023-08-31T02:00:03.163582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:56:16.408773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181151+0000","last_change":"2023-08-31T01:59:59.138166+0000","last_active":"2023-08-31T02:00:03.181151+0000","last_peered":"2023-08-31T02:00:03.181151+0000","last_clean":"2023-08-31T02:00:03.181151+0000","last_became_active":"2023-08-31T01:59:59.137906+0000","last_became_peered":"2023-08-31T01:59:59.137906+0000","last_unstale":"2023-08-31T02:00:03.181151+0000","last_undegraded":"2023-08-31T02:00:03.181151+0000","last_fullsized":"2023-08-31T02:00:03.181151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:21:43.096879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162548+0000","last_change":"2023-08-31T01:59:59.139015+0000","last_active":"2023-08-31T02:00:03.162548+0000","last_peered":"2023-08-31T02:00:03.162548+0000","last_clean":"2023-08-31T02:00:03.162548+0000","last_became_active":"2023-08-31T01:59:59.138750+0000","last_became_peered":"2023-08-31T01:59:59.138750+0000","last_unstale":"2023-08-31T02:00:03.162548+0000","last_undegraded":"2023-08-31T02:00:03.162548+0000","last_fullsized":"2023-08-31T02:00:03.162548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:41:19.129611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181131+0000","last_change":"2023-08-31T01:59:59.148629+0000","last_active":"2023-08-31T02:00:03.181131+0000","last_peered":"2023-08-31T02:00:03.181131+0000","last_clean":"2023-08-31T02:00:03.181131+0000","last_became_active":"2023-08-31T01:59:59.148368+0000","last_became_peered":"2023-08-31T01:59:59.148368+0000","last_unstale":"2023-08-31T02:00:03.181131+0000","last_undegraded":"2023-08-31T02:00:03.181131+0000","last_fullsized":"2023-08-31T02:00:03.181131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:37:26.875580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170679+0000","last_change":"2023-08-31T01:59:59.146071+0000","last_active":"2023-08-31T02:00:03.170679+0000","last_peered":"2023-08-31T02:00:03.170679+0000","last_clean":"2023-08-31T02:00:03.170679+0000","last_became_active":"2023-08-31T01:59:59.141603+0000","last_became_peered":"2023-08-31T01:59:59.141603+0000","last_unstale":"2023-08-31T02:00:03.170679+0000","last_undegraded":"2023-08-31T02:00:03.170679+0000","last_fullsized":"2023-08-31T02:00:03.170679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:55:33.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171222+0000","last_change":"2023-08-31T01:59:59.146296+0000","last_active":"2023-08-31T02:00:03.171222+0000","last_peered":"2023-08-31T02:00:03.171222+0000","last_clean":"2023-08-31T02:00:03.171222+0000","last_became_active":"2023-08-31T01:59:59.143079+0000","last_became_peered":"2023-08-31T01:59:59.143079+0000","last_unstale":"2023-08-31T02:00:03.171222+0000","last_undegraded":"2023-08-31T02:00:03.171222+0000","last_fullsized":"2023-08-31T02:00:03.171222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:21:43.096879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167674+0000","last_change":"2023-08-31T01:59:59.144579+0000","last_active":"2023-08-31T02:00:03.167674+0000","last_peered":"2023-08-31T02:00:03.167674+0000","last_clean":"2023-08-31T02:00:03.167674+0000","last_became_active":"2023-08-31T01:59:59.144144+0000","last_became_peered":"2023-08-31T01:59:59.144144+0000","last_unstale":"2023-08-31T02:00:03.167674+0000","last_undegraded":"2023-08-31T02:00:03.167674+0000","last_fullsized":"2023-08-31T02:00:03.167674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:41.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162134+0000","last_change":"2023-08-31T01:59:59.153550+0000","last_active":"2023-08-31T02:00:03.162134+0000","last_peered":"2023-08-31T02:00:03.162134+0000","last_clean":"2023-08-31T02:00:03.162134+0000","last_became_active":"2023-08-31T01:59:59.153324+0000","last_became_peered":"2023-08-31T01:59:59.153324+0000","last_unstale":"2023-08-31T02:00:03.162134+0000","last_undegraded":"2023-08-31T02:00:03.162134+0000","last_fullsized":"2023-08-31T02:00:03.162134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:02:02.199676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167186+0000","last_change":"2023-08-31T01:59:59.140970+0000","last_active":"2023-08-31T02:00:03.167186+0000","last_peered":"2023-08-31T02:00:03.167186+0000","last_clean":"2023-08-31T02:00:03.167186+0000","last_became_active":"2023-08-31T01:59:59.140228+0000","last_became_peered":"2023-08-31T01:59:59.140228+0000","last_unstale":"2023-08-31T02:00:03.167186+0000","last_undegraded":"2023-08-31T02:00:03.167186+0000","last_fullsized":"2023-08-31T02:00:03.167186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:28.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181691+0000","last_change":"2023-08-31T01:59:59.134845+0000","last_active":"2023-08-31T02:00:03.181691+0000","last_peered":"2023-08-31T02:00:03.181691+0000","last_clean":"2023-08-31T02:00:03.181691+0000","last_became_active":"2023-08-31T01:59:59.134582+0000","last_became_peered":"2023-08-31T01:59:59.134582+0000","last_unstale":"2023-08-31T02:00:03.181691+0000","last_undegraded":"2023-08-31T02:00:03.181691+0000","last_fullsized":"2023-08-31T02:00:03.181691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162420+0000","last_change":"2023-08-31T01:59:59.129553+0000","last_active":"2023-08-31T02:00:03.162420+0000","last_peered":"2023-08-31T02:00:03.162420+0000","last_clean":"2023-08-31T02:00:03.162420+0000","last_became_active":"2023-08-31T01:59:59.129229+0000","last_became_peered":"2023-08-31T01:59:59.129229+0000","last_unstale":"2023-08-31T02:00:03.162420+0000","last_undegraded":"2023-08-31T02:00:03.162420+0000","last_fullsized":"2023-08-31T02:00:03.162420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:23:18.368239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163287+0000","last_change":"2023-08-31T01:59:59.143663+0000","last_active":"2023-08-31T02:00:03.163287+0000","last_peered":"2023-08-31T02:00:03.163287+0000","last_clean":"2023-08-31T02:00:03.163287+0000","last_became_active":"2023-08-31T01:59:59.143284+0000","last_became_peered":"2023-08-31T01:59:59.143284+0000","last_unstale":"2023-08-31T02:00:03.163287+0000","last_undegraded":"2023-08-31T02:00:03.163287+0000","last_fullsized":"2023-08-31T02:00:03.163287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:57:18.747036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.173127+0000","last_change":"2023-08-31T01:59:59.149136+0000","last_active":"2023-08-31T02:00:03.173127+0000","last_peered":"2023-08-31T02:00:03.173127+0000","last_clean":"2023-08-31T02:00:03.173127+0000","last_became_active":"2023-08-31T01:59:59.148859+0000","last_became_peered":"2023-08-31T01:59:59.148859+0000","last_unstale":"2023-08-31T02:00:03.173127+0000","last_undegraded":"2023-08-31T02:00:03.173127+0000","last_fullsized":"2023-08-31T02:00:03.173127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:15.781174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180955+0000","last_change":"2023-08-31T01:59:59.140287+0000","last_active":"2023-08-31T02:00:03.180955+0000","last_peered":"2023-08-31T02:00:03.180955+0000","last_clean":"2023-08-31T02:00:03.180955+0000","last_became_active":"2023-08-31T01:59:59.140016+0000","last_became_peered":"2023-08-31T01:59:59.140016+0000","last_unstale":"2023-08-31T02:00:03.180955+0000","last_undegraded":"2023-08-31T02:00:03.180955+0000","last_fullsized":"2023-08-31T02:00:03.180955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:42:39.396804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163349+0000","last_change":"2023-08-31T02:00:03.192225+0000","last_active":"2023-08-31T02:00:04.163349+0000","last_peered":"2023-08-31T02:00:04.163349+0000","last_clean":"2023-08-31T02:00:04.163349+0000","last_became_active":"2023-08-31T02:00:03.191659+0000","last_became_peered":"2023-08-31T02:00:03.191659+0000","last_unstale":"2023-08-31T02:00:04.163349+0000","last_undegraded":"2023-08-31T02:00:04.163349+0000","last_fullsized":"2023-08-31T02:00:04.163349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:07.950758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169428+0000","last_change":"2023-08-31T01:59:58.142347+0000","last_active":"2023-08-31T02:00:03.169428+0000","last_peered":"2023-08-31T02:00:03.169428+0000","last_clean":"2023-08-31T02:00:03.169428+0000","last_became_active":"2023-08-31T01:59:58.142075+0000","last_became_peered":"2023-08-31T01:59:58.142075+0000","last_unstale":"2023-08-31T02:00:03.169428+0000","last_undegraded":"2023-08-31T02:00:03.169428+0000","last_fullsized":"2023-08-31T02:00:03.169428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164531+0000","last_change":"2023-08-31T01:59:59.154639+0000","last_active":"2023-08-31T02:00:03.164531+0000","last_peered":"2023-08-31T02:00:03.164531+0000","last_clean":"2023-08-31T02:00:03.164531+0000","last_became_active":"2023-08-31T01:59:59.154308+0000","last_became_peered":"2023-08-31T01:59:59.154308+0000","last_unstale":"2023-08-31T02:00:03.164531+0000","last_undegraded":"2023-08-31T02:00:03.164531+0000","last_fullsized":"2023-08-31T02:00:03.164531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:23:18.368239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163776+0000","last_change":"2023-08-31T02:00:03.188074+0000","last_active":"2023-08-31T02:00:04.163776+0000","last_peered":"2023-08-31T02:00:04.163776+0000","last_clean":"2023-08-31T02:00:04.163776+0000","last_became_active":"2023-08-31T02:00:03.187698+0000","last_became_peered":"2023-08-31T02:00:03.187698+0000","last_unstale":"2023-08-31T02:00:04.163776+0000","last_undegraded":"2023-08-31T02:00:04.163776+0000","last_fullsized":"2023-08-31T02:00:04.163776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:55:06.805698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164700+0000","last_change":"2023-08-31T01:59:58.132279+0000","last_active":"2023-08-31T02:00:03.164700+0000","last_peered":"2023-08-31T02:00:03.164700+0000","last_clean":"2023-08-31T02:00:03.164700+0000","last_became_active":"2023-08-31T01:59:58.132009+0000","last_became_peered":"2023-08-31T01:59:58.132009+0000","last_unstale":"2023-08-31T02:00:03.164700+0000","last_undegraded":"2023-08-31T02:00:03.164700+0000","last_fullsized":"2023-08-31T02:00:03.164700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:02:21.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169076+0000","last_change":"2023-08-31T01:59:59.135972+0000","last_active":"2023-08-31T02:00:03.169076+0000","last_peered":"2023-08-31T02:00:03.169076+0000","last_clean":"2023-08-31T02:00:03.169076+0000","last_became_active":"2023-08-31T01:59:59.135691+0000","last_became_peered":"2023-08-31T01:59:59.135691+0000","last_unstale":"2023-08-31T02:00:03.169076+0000","last_undegraded":"2023-08-31T02:00:03.169076+0000","last_fullsized":"2023-08-31T02:00:03.169076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:03.652877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164169+0000","last_change":"2023-08-31T02:00:03.192204+0000","last_active":"2023-08-31T02:00:04.164169+0000","last_peered":"2023-08-31T02:00:04.164169+0000","last_clean":"2023-08-31T02:00:04.164169+0000","last_became_active":"2023-08-31T02:00:03.191633+0000","last_became_peered":"2023-08-31T02:00:03.191633+0000","last_unstale":"2023-08-31T02:00:04.164169+0000","last_undegraded":"2023-08-31T02:00:04.164169+0000","last_fullsized":"2023-08-31T02:00:04.164169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180816+0000","last_change":"2023-08-31T01:59:58.143879+0000","last_active":"2023-08-31T02:00:03.180816+0000","last_peered":"2023-08-31T02:00:03.180816+0000","last_clean":"2023-08-31T02:00:03.180816+0000","last_became_active":"2023-08-31T01:59:58.143588+0000","last_became_peered":"2023-08-31T01:59:58.143588+0000","last_unstale":"2023-08-31T02:00:03.180816+0000","last_undegraded":"2023-08-31T02:00:03.180816+0000","last_fullsized":"2023-08-31T02:00:03.180816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:46.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162551+0000","last_change":"2023-08-31T01:59:59.136923+0000","last_active":"2023-08-31T02:00:03.162551+0000","last_peered":"2023-08-31T02:00:03.162551+0000","last_clean":"2023-08-31T02:00:03.162551+0000","last_became_active":"2023-08-31T01:59:59.136667+0000","last_became_peered":"2023-08-31T01:59:59.136667+0000","last_unstale":"2023-08-31T02:00:03.162551+0000","last_undegraded":"2023-08-31T02:00:03.162551+0000","last_fullsized":"2023-08-31T02:00:03.162551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:56:30.420963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163855+0000","last_change":"2023-08-31T02:00:03.174239+0000","last_active":"2023-08-31T02:00:04.163855+0000","last_peered":"2023-08-31T02:00:04.163855+0000","last_clean":"2023-08-31T02:00:04.163855+0000","last_became_active":"2023-08-31T02:00:03.173806+0000","last_became_peered":"2023-08-31T02:00:03.173806+0000","last_unstale":"2023-08-31T02:00:04.163855+0000","last_undegraded":"2023-08-31T02:00:04.163855+0000","last_fullsized":"2023-08-31T02:00:04.163855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:07.292454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180701+0000","last_change":"2023-08-31T01:59:58.142035+0000","last_active":"2023-08-31T02:00:03.180701+0000","last_peered":"2023-08-31T02:00:03.180701+0000","last_clean":"2023-08-31T02:00:03.180701+0000","last_became_active":"2023-08-31T01:59:58.141223+0000","last_became_peered":"2023-08-31T01:59:58.141223+0000","last_unstale":"2023-08-31T02:00:03.180701+0000","last_undegraded":"2023-08-31T02:00:03.180701+0000","last_fullsized":"2023-08-31T02:00:03.180701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:54:24.757437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163587+0000","last_change":"2023-08-31T01:59:59.135949+0000","last_active":"2023-08-31T02:00:03.163587+0000","last_peered":"2023-08-31T02:00:03.163587+0000","last_clean":"2023-08-31T02:00:03.163587+0000","last_became_active":"2023-08-31T01:59:59.135657+0000","last_became_peered":"2023-08-31T01:59:59.135657+0000","last_unstale":"2023-08-31T02:00:03.163587+0000","last_undegraded":"2023-08-31T02:00:03.163587+0000","last_fullsized":"2023-08-31T02:00:03.163587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:05:14.371221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163462+0000","last_change":"2023-08-31T02:00:03.197344+0000","last_active":"2023-08-31T02:00:04.163462+0000","last_peered":"2023-08-31T02:00:04.163462+0000","last_clean":"2023-08-31T02:00:04.163462+0000","last_became_active":"2023-08-31T02:00:03.196881+0000","last_became_peered":"2023-08-31T02:00:03.196881+0000","last_unstale":"2023-08-31T02:00:04.163462+0000","last_undegraded":"2023-08-31T02:00:04.163462+0000","last_fullsized":"2023-08-31T02:00:04.163462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:06:25.721250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162344+0000","last_change":"2023-08-31T01:59:58.141370+0000","last_active":"2023-08-31T02:00:03.162344+0000","last_peered":"2023-08-31T02:00:03.162344+0000","last_clean":"2023-08-31T02:00:03.162344+0000","last_became_active":"2023-08-31T01:59:58.141142+0000","last_became_peered":"2023-08-31T01:59:58.141142+0000","last_unstale":"2023-08-31T02:00:03.162344+0000","last_undegraded":"2023-08-31T02:00:03.162344+0000","last_fullsized":"2023-08-31T02:00:03.162344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:59:13.304994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167343+0000","last_change":"2023-08-31T01:59:59.142375+0000","last_active":"2023-08-31T02:00:03.167343+0000","last_peered":"2023-08-31T02:00:03.167343+0000","last_clean":"2023-08-31T02:00:03.167343+0000","last_became_active":"2023-08-31T01:59:59.142081+0000","last_became_peered":"2023-08-31T01:59:59.142081+0000","last_unstale":"2023-08-31T02:00:03.167343+0000","last_undegraded":"2023-08-31T02:00:03.167343+0000","last_fullsized":"2023-08-31T02:00:03.167343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:11.399572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.243672+0000","last_change":"2023-08-31T02:00:03.187642+0000","last_active":"2023-08-31T02:00:04.243672+0000","last_peered":"2023-08-31T02:00:04.243672+0000","last_clean":"2023-08-31T02:00:04.243672+0000","last_became_active":"2023-08-31T02:00:03.187241+0000","last_became_peered":"2023-08-31T02:00:03.187241+0000","last_unstale":"2023-08-31T02:00:04.243672+0000","last_undegraded":"2023-08-31T02:00:04.243672+0000","last_fullsized":"2023-08-31T02:00:04.243672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:02:06.236563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170304+0000","last_change":"2023-08-31T01:59:58.135240+0000","last_active":"2023-08-31T02:00:03.170304+0000","last_peered":"2023-08-31T02:00:03.170304+0000","last_clean":"2023-08-31T02:00:03.170304+0000","last_became_active":"2023-08-31T01:59:58.134970+0000","last_became_peered":"2023-08-31T01:59:58.134970+0000","last_unstale":"2023-08-31T02:00:03.170304+0000","last_undegraded":"2023-08-31T02:00:03.170304+0000","last_fullsized":"2023-08-31T02:00:03.170304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:27.460329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.168630+0000","last_change":"2023-08-31T01:59:59.136910+0000","last_active":"2023-08-31T02:00:03.168630+0000","last_peered":"2023-08-31T02:00:03.168630+0000","last_clean":"2023-08-31T02:00:03.168630+0000","last_became_active":"2023-08-31T01:59:59.136639+0000","last_became_peered":"2023-08-31T01:59:59.136639+0000","last_unstale":"2023-08-31T02:00:03.168630+0000","last_undegraded":"2023-08-31T02:00:03.168630+0000","last_fullsized":"2023-08-31T02:00:03.168630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242167+0000","last_change":"2023-08-31T02:00:03.191155+0000","last_active":"2023-08-31T02:00:04.242167+0000","last_peered":"2023-08-31T02:00:04.242167+0000","last_clean":"2023-08-31T02:00:04.242167+0000","last_became_active":"2023-08-31T02:00:03.190781+0000","last_became_peered":"2023-08-31T02:00:03.190781+0000","last_unstale":"2023-08-31T02:00:04.242167+0000","last_undegraded":"2023-08-31T02:00:04.242167+0000","last_fullsized":"2023-08-31T02:00:04.242167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161935+0000","last_change":"2023-08-31T01:59:58.136133+0000","last_active":"2023-08-31T02:00:03.161935+0000","last_peered":"2023-08-31T02:00:03.161935+0000","last_clean":"2023-08-31T02:00:03.161935+0000","last_became_active":"2023-08-31T01:59:58.135866+0000","last_became_peered":"2023-08-31T01:59:58.135866+0000","last_unstale":"2023-08-31T02:00:03.161935+0000","last_undegraded":"2023-08-31T02:00:03.161935+0000","last_fullsized":"2023-08-31T02:00:03.161935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:07:34.297167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161781+0000","last_change":"2023-08-31T01:59:59.137046+0000","last_active":"2023-08-31T02:00:03.161781+0000","last_peered":"2023-08-31T02:00:03.161781+0000","last_clean":"2023-08-31T02:00:03.161781+0000","last_became_active":"2023-08-31T01:59:59.136766+0000","last_became_peered":"2023-08-31T01:59:59.136766+0000","last_unstale":"2023-08-31T02:00:03.161781+0000","last_undegraded":"2023-08-31T02:00:03.161781+0000","last_fullsized":"2023-08-31T02:00:03.161781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:36.061031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242413+0000","last_change":"2023-08-31T02:00:03.185467+0000","last_active":"2023-08-31T02:00:04.242413+0000","last_peered":"2023-08-31T02:00:04.242413+0000","last_clean":"2023-08-31T02:00:04.242413+0000","last_became_active":"2023-08-31T02:00:03.185055+0000","last_became_peered":"2023-08-31T02:00:03.185055+0000","last_unstale":"2023-08-31T02:00:04.242413+0000","last_undegraded":"2023-08-31T02:00:04.242413+0000","last_fullsized":"2023-08-31T02:00:04.242413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:12:08.637395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163543+0000","last_change":"2023-08-31T01:59:58.135749+0000","last_active":"2023-08-31T02:00:03.163543+0000","last_peered":"2023-08-31T02:00:03.163543+0000","last_clean":"2023-08-31T02:00:03.163543+0000","last_became_active":"2023-08-31T01:59:58.134641+0000","last_became_peered":"2023-08-31T01:59:58.134641+0000","last_unstale":"2023-08-31T02:00:03.163543+0000","last_undegraded":"2023-08-31T02:00:03.163543+0000","last_fullsized":"2023-08-31T02:00:03.163543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:14.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181824+0000","last_change":"2023-08-31T01:59:59.139726+0000","last_active":"2023-08-31T02:00:03.181824+0000","last_peered":"2023-08-31T02:00:03.181824+0000","last_clean":"2023-08-31T02:00:03.181824+0000","last_became_active":"2023-08-31T01:59:59.139453+0000","last_became_peered":"2023-08-31T01:59:59.139453+0000","last_unstale":"2023-08-31T02:00:03.181824+0000","last_undegraded":"2023-08-31T02:00:03.181824+0000","last_fullsized":"2023-08-31T02:00:03.181824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163132+0000","last_change":"2023-08-31T02:00:03.188588+0000","last_active":"2023-08-31T02:00:04.163132+0000","last_peered":"2023-08-31T02:00:04.163132+0000","last_clean":"2023-08-31T02:00:04.163132+0000","last_became_active":"2023-08-31T02:00:03.187651+0000","last_became_peered":"2023-08-31T02:00:03.187651+0000","last_unstale":"2023-08-31T02:00:04.163132+0000","last_undegraded":"2023-08-31T02:00:04.163132+0000","last_fullsized":"2023-08-31T02:00:04.163132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:58:48.531393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171794+0000","last_change":"2023-08-31T01:59:58.137377+0000","last_active":"2023-08-31T02:00:03.171794+0000","last_peered":"2023-08-31T02:00:03.171794+0000","last_clean":"2023-08-31T02:00:03.171794+0000","last_became_active":"2023-08-31T01:59:58.137080+0000","last_became_peered":"2023-08-31T01:59:58.137080+0000","last_unstale":"2023-08-31T02:00:03.171794+0000","last_undegraded":"2023-08-31T02:00:03.171794+0000","last_fullsized":"2023-08-31T02:00:03.171794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:10.392703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163096+0000","last_change":"2023-08-31T01:59:59.138414+0000","last_active":"2023-08-31T02:00:03.163096+0000","last_peered":"2023-08-31T02:00:03.163096+0000","last_clean":"2023-08-31T02:00:03.163096+0000","last_became_active":"2023-08-31T01:59:59.138115+0000","last_became_peered":"2023-08-31T01:59:59.138115+0000","last_unstale":"2023-08-31T02:00:03.163096+0000","last_undegraded":"2023-08-31T02:00:03.163096+0000","last_fullsized":"2023-08-31T02:00:03.163096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:56:15.505917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163393+0000","last_change":"2023-08-31T02:00:03.177589+0000","last_active":"2023-08-31T02:00:04.163393+0000","last_peered":"2023-08-31T02:00:04.163393+0000","last_clean":"2023-08-31T02:00:04.163393+0000","last_became_active":"2023-08-31T02:00:03.177081+0000","last_became_peered":"2023-08-31T02:00:03.177081+0000","last_unstale":"2023-08-31T02:00:04.163393+0000","last_undegraded":"2023-08-31T02:00:04.163393+0000","last_fullsized":"2023-08-31T02:00:04.163393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:45:19.479655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162995+0000","last_change":"2023-08-31T01:59:58.136589+0000","last_active":"2023-08-31T02:00:03.162995+0000","last_peered":"2023-08-31T02:00:03.162995+0000","last_clean":"2023-08-31T02:00:03.162995+0000","last_became_active":"2023-08-31T01:59:58.136034+0000","last_became_peered":"2023-08-31T01:59:58.136034+0000","last_unstale":"2023-08-31T02:00:03.162995+0000","last_undegraded":"2023-08-31T02:00:03.162995+0000","last_fullsized":"2023-08-31T02:00:03.162995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:19:36.193451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169329+0000","last_change":"2023-08-31T01:59:59.131747+0000","last_active":"2023-08-31T02:00:03.169329+0000","last_peered":"2023-08-31T02:00:03.169329+0000","last_clean":"2023-08-31T02:00:03.169329+0000","last_became_active":"2023-08-31T01:59:59.131269+0000","last_became_peered":"2023-08-31T01:59:59.131269+0000","last_unstale":"2023-08-31T02:00:03.169329+0000","last_undegraded":"2023-08-31T02:00:03.169329+0000","last_fullsized":"2023-08-31T02:00:03.169329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164576+0000","last_change":"2023-08-31T02:00:03.191728+0000","last_active":"2023-08-31T02:00:04.164576+0000","last_peered":"2023-08-31T02:00:04.164576+0000","last_clean":"2023-08-31T02:00:04.164576+0000","last_became_active":"2023-08-31T02:00:03.191327+0000","last_became_peered":"2023-08-31T02:00:03.191327+0000","last_unstale":"2023-08-31T02:00:04.164576+0000","last_undegraded":"2023-08-31T02:00:04.164576+0000","last_fullsized":"2023-08-31T02:00:04.164576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183416+0000","last_change":"2023-08-31T01:59:58.138090+0000","last_active":"2023-08-31T02:00:03.183416+0000","last_peered":"2023-08-31T02:00:03.183416+0000","last_clean":"2023-08-31T02:00:03.183416+0000","last_became_active":"2023-08-31T01:59:58.137733+0000","last_became_peered":"2023-08-31T01:59:58.137733+0000","last_unstale":"2023-08-31T02:00:03.183416+0000","last_undegraded":"2023-08-31T02:00:03.183416+0000","last_fullsized":"2023-08-31T02:00:03.183416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167635+0000","last_change":"2023-08-31T01:59:59.139493+0000","last_active":"2023-08-31T02:00:03.167635+0000","last_peered":"2023-08-31T02:00:03.167635+0000","last_clean":"2023-08-31T02:00:03.167635+0000","last_became_active":"2023-08-31T01:59:59.139019+0000","last_became_peered":"2023-08-31T01:59:59.139019+0000","last_unstale":"2023-08-31T02:00:03.167635+0000","last_undegraded":"2023-08-31T02:00:03.167635+0000","last_fullsized":"2023-08-31T02:00:03.167635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:50:02.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241935+0000","last_change":"2023-08-31T02:00:03.184119+0000","last_active":"2023-08-31T02:00:04.241935+0000","last_peered":"2023-08-31T02:00:04.241935+0000","last_clean":"2023-08-31T02:00:04.241935+0000","last_became_active":"2023-08-31T02:00:03.183557+0000","last_became_peered":"2023-08-31T02:00:03.183557+0000","last_unstale":"2023-08-31T02:00:04.241935+0000","last_undegraded":"2023-08-31T02:00:04.241935+0000","last_fullsized":"2023-08-31T02:00:04.241935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:08.828471+0000","last_change":"2023-08-31T01:59:58.138549+0000","last_active":"2023-08-31T02:00:08.828471+0000","last_peered":"2023-08-31T02:00:08.828471+0000","last_clean":"2023-08-31T02:00:08.828471+0000","last_became_active":"2023-08-31T01:59:58.138254+0000","last_became_peered":"2023-08-31T01:59:58.138254+0000","last_unstale":"2023-08-31T02:00:08.828471+0000","last_undegraded":"2023-08-31T02:00:08.828471+0000","last_fullsized":"2023-08-31T02:00:08.828471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180911+0000","last_change":"2023-08-31T01:59:59.147840+0000","last_active":"2023-08-31T02:00:03.180911+0000","last_peered":"2023-08-31T02:00:03.180911+0000","last_clean":"2023-08-31T02:00:03.180911+0000","last_became_active":"2023-08-31T01:59:59.144815+0000","last_became_peered":"2023-08-31T01:59:59.144815+0000","last_unstale":"2023-08-31T02:00:03.180911+0000","last_undegraded":"2023-08-31T02:00:03.180911+0000","last_fullsized":"2023-08-31T02:00:03.180911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:36:25.930421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.165604+0000","last_change":"2023-08-31T02:00:03.184326+0000","last_active":"2023-08-31T02:00:04.165604+0000","last_peered":"2023-08-31T02:00:04.165604+0000","last_clean":"2023-08-31T02:00:04.165604+0000","last_became_active":"2023-08-31T02:00:03.183699+0000","last_became_peered":"2023-08-31T02:00:03.183699+0000","last_unstale":"2023-08-31T02:00:04.165604+0000","last_undegraded":"2023-08-31T02:00:04.165604+0000","last_fullsized":"2023-08-31T02:00:04.165604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:06:25.721250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169606+0000","last_change":"2023-08-31T01:59:58.135348+0000","last_active":"2023-08-31T02:00:03.169606+0000","last_peered":"2023-08-31T02:00:03.169606+0000","last_clean":"2023-08-31T02:00:03.169606+0000","last_became_active":"2023-08-31T01:59:58.135066+0000","last_became_peered":"2023-08-31T01:59:58.135066+0000","last_unstale":"2023-08-31T02:00:03.169606+0000","last_undegraded":"2023-08-31T02:00:03.169606+0000","last_fullsized":"2023-08-31T02:00:03.169606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:32:56.077806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167015+0000","last_change":"2023-08-31T01:59:59.138162+0000","last_active":"2023-08-31T02:00:03.167015+0000","last_peered":"2023-08-31T02:00:03.167015+0000","last_clean":"2023-08-31T02:00:03.167015+0000","last_became_active":"2023-08-31T01:59:59.137839+0000","last_became_peered":"2023-08-31T01:59:59.137839+0000","last_unstale":"2023-08-31T02:00:03.167015+0000","last_undegraded":"2023-08-31T02:00:03.167015+0000","last_fullsized":"2023-08-31T02:00:03.167015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:47.845392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163987+0000","last_change":"2023-08-31T02:00:03.191406+0000","last_active":"2023-08-31T02:00:04.163987+0000","last_peered":"2023-08-31T02:00:04.163987+0000","last_clean":"2023-08-31T02:00:04.163987+0000","last_became_active":"2023-08-31T02:00:03.188162+0000","last_became_peered":"2023-08-31T02:00:03.188162+0000","last_unstale":"2023-08-31T02:00:04.163987+0000","last_undegraded":"2023-08-31T02:00:04.163987+0000","last_fullsized":"2023-08-31T02:00:04.163987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:47:44.042063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162984+0000","last_change":"2023-08-31T01:59:58.131639+0000","last_active":"2023-08-31T02:00:03.162984+0000","last_peered":"2023-08-31T02:00:03.162984+0000","last_clean":"2023-08-31T02:00:03.162984+0000","last_became_active":"2023-08-31T01:59:58.131381+0000","last_became_peered":"2023-08-31T01:59:58.131381+0000","last_unstale":"2023-08-31T02:00:03.162984+0000","last_undegraded":"2023-08-31T02:00:03.162984+0000","last_fullsized":"2023-08-31T02:00:03.162984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:35.054161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180639+0000","last_change":"2023-08-31T01:59:59.148855+0000","last_active":"2023-08-31T02:00:03.180639+0000","last_peered":"2023-08-31T02:00:03.180639+0000","last_clean":"2023-08-31T02:00:03.180639+0000","last_became_active":"2023-08-31T01:59:59.148596+0000","last_became_peered":"2023-08-31T01:59:59.148596+0000","last_unstale":"2023-08-31T02:00:03.180639+0000","last_undegraded":"2023-08-31T02:00:03.180639+0000","last_fullsized":"2023-08-31T02:00:03.180639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:09:06.788463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163483+0000","last_change":"2023-08-31T02:00:03.188719+0000","last_active":"2023-08-31T02:00:04.163483+0000","last_peered":"2023-08-31T02:00:04.163483+0000","last_clean":"2023-08-31T02:00:04.163483+0000","last_became_active":"2023-08-31T02:00:03.188370+0000","last_became_peered":"2023-08-31T02:00:03.188370+0000","last_unstale":"2023-08-31T02:00:04.163483+0000","last_undegraded":"2023-08-31T02:00:04.163483+0000","last_fullsized":"2023-08-31T02:00:04.163483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:47:24.148482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170323+0000","last_change":"2023-08-31T01:59:58.139072+0000","last_active":"2023-08-31T02:00:03.170323+0000","last_peered":"2023-08-31T02:00:03.170323+0000","last_clean":"2023-08-31T02:00:03.170323+0000","last_became_active":"2023-08-31T01:59:58.138813+0000","last_became_peered":"2023-08-31T01:59:58.138813+0000","last_unstale":"2023-08-31T02:00:03.170323+0000","last_undegraded":"2023-08-31T02:00:03.170323+0000","last_fullsized":"2023-08-31T02:00:03.170323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:54:24.757437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170141+0000","last_change":"2023-08-31T01:59:59.141198+0000","last_active":"2023-08-31T02:00:03.170141+0000","last_peered":"2023-08-31T02:00:03.170141+0000","last_clean":"2023-08-31T02:00:03.170141+0000","last_became_active":"2023-08-31T01:59:59.140699+0000","last_became_peered":"2023-08-31T01:59:59.140699+0000","last_unstale":"2023-08-31T02:00:03.170141+0000","last_undegraded":"2023-08-31T02:00:03.170141+0000","last_fullsized":"2023-08-31T02:00:03.170141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:20:43.299746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242253+0000","last_change":"2023-08-31T02:00:03.179770+0000","last_active":"2023-08-31T02:00:04.242253+0000","last_peered":"2023-08-31T02:00:04.242253+0000","last_clean":"2023-08-31T02:00:04.242253+0000","last_became_active":"2023-08-31T02:00:03.179411+0000","last_became_peered":"2023-08-31T02:00:03.179411+0000","last_unstale":"2023-08-31T02:00:04.242253+0000","last_undegraded":"2023-08-31T02:00:04.242253+0000","last_fullsized":"2023-08-31T02:00:04.242253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171952+0000","last_change":"2023-08-31T01:59:58.137410+0000","last_active":"2023-08-31T02:00:03.171952+0000","last_peered":"2023-08-31T02:00:03.171952+0000","last_clean":"2023-08-31T02:00:03.171952+0000","last_became_active":"2023-08-31T01:59:58.137142+0000","last_became_peered":"2023-08-31T01:59:58.137142+0000","last_unstale":"2023-08-31T02:00:03.171952+0000","last_undegraded":"2023-08-31T02:00:03.171952+0000","last_fullsized":"2023-08-31T02:00:03.171952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:08:55.972594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181767+0000","last_change":"2023-08-31T01:59:59.144857+0000","last_active":"2023-08-31T02:00:03.181767+0000","last_peered":"2023-08-31T02:00:03.181767+0000","last_clean":"2023-08-31T02:00:03.181767+0000","last_became_active":"2023-08-31T01:59:59.144565+0000","last_became_peered":"2023-08-31T01:59:59.144565+0000","last_unstale":"2023-08-31T02:00:03.181767+0000","last_undegraded":"2023-08-31T02:00:03.181767+0000","last_fullsized":"2023-08-31T02:00:03.181767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:20:43.299746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163679+0000","last_change":"2023-08-31T02:00:03.188428+0000","last_active":"2023-08-31T02:00:04.163679+0000","last_peered":"2023-08-31T02:00:04.163679+0000","last_clean":"2023-08-31T02:00:04.163679+0000","last_became_active":"2023-08-31T02:00:03.188066+0000","last_became_peered":"2023-08-31T02:00:03.188066+0000","last_unstale":"2023-08-31T02:00:04.163679+0000","last_undegraded":"2023-08-31T02:00:04.163679+0000","last_fullsized":"2023-08-31T02:00:04.163679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:09:10.825351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167768+0000","last_change":"2023-08-31T01:59:58.135253+0000","last_active":"2023-08-31T02:00:03.167768+0000","last_peered":"2023-08-31T02:00:03.167768+0000","last_clean":"2023-08-31T02:00:03.167768+0000","last_became_active":"2023-08-31T01:59:58.134921+0000","last_became_peered":"2023-08-31T01:59:58.134921+0000","last_unstale":"2023-08-31T02:00:03.167768+0000","last_undegraded":"2023-08-31T02:00:03.167768+0000","last_fullsized":"2023-08-31T02:00:03.167768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180877+0000","last_change":"2023-08-31T01:59:59.145059+0000","last_active":"2023-08-31T02:00:03.180877+0000","last_peered":"2023-08-31T02:00:03.180877+0000","last_clean":"2023-08-31T02:00:03.180877+0000","last_became_active":"2023-08-31T01:59:59.144515+0000","last_became_peered":"2023-08-31T01:59:59.144515+0000","last_unstale":"2023-08-31T02:00:03.180877+0000","last_undegraded":"2023-08-31T02:00:03.180877+0000","last_fullsized":"2023-08-31T02:00:03.180877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:44:59.715888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241799+0000","last_change":"2023-08-31T02:00:03.183733+0000","last_active":"2023-08-31T02:00:04.241799+0000","last_peered":"2023-08-31T02:00:04.241799+0000","last_clean":"2023-08-31T02:00:04.241799+0000","last_became_active":"2023-08-31T02:00:03.182189+0000","last_became_peered":"2023-08-31T02:00:03.182189+0000","last_unstale":"2023-08-31T02:00:04.241799+0000","last_undegraded":"2023-08-31T02:00:04.241799+0000","last_fullsized":"2023-08-31T02:00:04.241799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181991+0000","last_change":"2023-08-31T01:59:58.137521+0000","last_active":"2023-08-31T02:00:03.181991+0000","last_peered":"2023-08-31T02:00:03.181991+0000","last_clean":"2023-08-31T02:00:03.181991+0000","last_became_active":"2023-08-31T01:59:58.137005+0000","last_became_peered":"2023-08-31T01:59:58.137005+0000","last_unstale":"2023-08-31T02:00:03.181991+0000","last_undegraded":"2023-08-31T02:00:03.181991+0000","last_fullsized":"2023-08-31T02:00:03.181991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:46.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163694+0000","last_change":"2023-08-31T01:59:59.146679+0000","last_active":"2023-08-31T02:00:03.163694+0000","last_peered":"2023-08-31T02:00:03.163694+0000","last_clean":"2023-08-31T02:00:03.163694+0000","last_became_active":"2023-08-31T01:59:59.146349+0000","last_became_peered":"2023-08-31T01:59:59.146349+0000","last_unstale":"2023-08-31T02:00:03.163694+0000","last_undegraded":"2023-08-31T02:00:03.163694+0000","last_fullsized":"2023-08-31T02:00:03.163694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:16:30.278083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241357+0000","last_change":"2023-08-31T02:00:03.187301+0000","last_active":"2023-08-31T02:00:04.241357+0000","last_peered":"2023-08-31T02:00:04.241357+0000","last_clean":"2023-08-31T02:00:04.241357+0000","last_became_active":"2023-08-31T02:00:03.186919+0000","last_became_peered":"2023-08-31T02:00:03.186919+0000","last_unstale":"2023-08-31T02:00:04.241357+0000","last_undegraded":"2023-08-31T02:00:04.241357+0000","last_fullsized":"2023-08-31T02:00:04.241357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162774+0000","last_change":"2023-08-31T01:59:58.137889+0000","last_active":"2023-08-31T02:00:03.162774+0000","last_peered":"2023-08-31T02:00:03.162774+0000","last_clean":"2023-08-31T02:00:03.162774+0000","last_became_active":"2023-08-31T01:59:58.137474+0000","last_became_peered":"2023-08-31T01:59:58.137474+0000","last_unstale":"2023-08-31T02:00:03.162774+0000","last_undegraded":"2023-08-31T02:00:03.162774+0000","last_fullsized":"2023-08-31T02:00:03.162774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:58:27.973576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167300+0000","last_change":"2023-08-31T01:59:59.135054+0000","last_active":"2023-08-31T02:00:03.167300+0000","last_peered":"2023-08-31T02:00:03.167300+0000","last_clean":"2023-08-31T02:00:03.167300+0000","last_became_active":"2023-08-31T01:59:59.134692+0000","last_became_peered":"2023-08-31T01:59:59.134692+0000","last_unstale":"2023-08-31T02:00:03.167300+0000","last_undegraded":"2023-08-31T02:00:03.167300+0000","last_fullsized":"2023-08-31T02:00:03.167300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:11.423606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241980+0000","last_change":"2023-08-31T02:00:03.183047+0000","last_active":"2023-08-31T02:00:04.241980+0000","last_peered":"2023-08-31T02:00:04.241980+0000","last_clean":"2023-08-31T02:00:04.241980+0000","last_became_active":"2023-08-31T02:00:03.182647+0000","last_became_peered":"2023-08-31T02:00:03.182647+0000","last_unstale":"2023-08-31T02:00:04.241980+0000","last_undegraded":"2023-08-31T02:00:04.241980+0000","last_fullsized":"2023-08-31T02:00:04.241980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:12:08.637395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182207+0000","last_change":"2023-08-31T01:59:59.127102+0000","last_active":"2023-08-31T02:00:03.182207+0000","last_peered":"2023-08-31T02:00:03.182207+0000","last_clean":"2023-08-31T02:00:03.182207+0000","last_became_active":"2023-08-31T01:59:59.126795+0000","last_became_peered":"2023-08-31T01:59:59.126795+0000","last_unstale":"2023-08-31T02:00:03.182207+0000","last_undegraded":"2023-08-31T02:00:03.182207+0000","last_fullsized":"2023-08-31T02:00:03.182207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:03.652877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.172443+0000","last_change":"2023-08-31T01:59:58.128837+0000","last_active":"2023-08-31T02:00:03.172443+0000","last_peered":"2023-08-31T02:00:03.172443+0000","last_clean":"2023-08-31T02:00:03.172443+0000","last_became_active":"2023-08-31T01:59:58.128553+0000","last_became_peered":"2023-08-31T01:59:58.128553+0000","last_unstale":"2023-08-31T02:00:03.172443+0000","last_undegraded":"2023-08-31T02:00:03.172443+0000","last_fullsized":"2023-08-31T02:00:03.172443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:40:45.576262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242548+0000","last_change":"2023-08-31T02:00:03.183013+0000","last_active":"2023-08-31T02:00:04.242548+0000","last_peered":"2023-08-31T02:00:04.242548+0000","last_clean":"2023-08-31T02:00:04.242548+0000","last_became_active":"2023-08-31T02:00:03.182620+0000","last_became_peered":"2023-08-31T02:00:03.182620+0000","last_unstale":"2023-08-31T02:00:04.242548+0000","last_undegraded":"2023-08-31T02:00:04.242548+0000","last_fullsized":"2023-08-31T02:00:04.242548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162206+0000","last_change":"2023-08-31T01:59:59.135012+0000","last_active":"2023-08-31T02:00:03.162206+0000","last_peered":"2023-08-31T02:00:03.162206+0000","last_clean":"2023-08-31T02:00:03.162206+0000","last_became_active":"2023-08-31T01:59:59.134742+0000","last_became_peered":"2023-08-31T01:59:59.134742+0000","last_unstale":"2023-08-31T02:00:03.162206+0000","last_undegraded":"2023-08-31T02:00:03.162206+0000","last_fullsized":"2023-08-31T02:00:03.162206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:09:03.292169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163085+0000","last_change":"2023-08-31T01:59:58.133974+0000","last_active":"2023-08-31T02:00:03.163085+0000","last_peered":"2023-08-31T02:00:03.163085+0000","last_clean":"2023-08-31T02:00:03.163085+0000","last_became_active":"2023-08-31T01:59:58.133700+0000","last_became_peered":"2023-08-31T01:59:58.133700+0000","last_unstale":"2023-08-31T02:00:03.163085+0000","last_undegraded":"2023-08-31T02:00:03.163085+0000","last_fullsized":"2023-08-31T02:00:03.163085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:28:01.725513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180556+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:00:03.180556+0000","last_peered":"2023-08-31T02:00:03.180556+0000","last_clean":"2023-08-31T02:00:03.180556+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:00:03.180556+0000","last_undegraded":"2023-08-31T02:00:03.180556+0000","last_fullsized":"2023-08-31T02:00:03.180556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242374+0000","last_change":"2023-08-31T02:00:03.185255+0000","last_active":"2023-08-31T02:00:04.242374+0000","last_peered":"2023-08-31T02:00:04.242374+0000","last_clean":"2023-08-31T02:00:04.242374+0000","last_became_active":"2023-08-31T02:00:03.184861+0000","last_became_peered":"2023-08-31T02:00:03.184861+0000","last_unstale":"2023-08-31T02:00:04.242374+0000","last_undegraded":"2023-08-31T02:00:04.242374+0000","last_fullsized":"2023-08-31T02:00:04.242374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167610+0000","last_change":"2023-08-31T01:59:59.135368+0000","last_active":"2023-08-31T02:00:03.167610+0000","last_peered":"2023-08-31T02:00:03.167610+0000","last_clean":"2023-08-31T02:00:03.167610+0000","last_became_active":"2023-08-31T01:59:59.135074+0000","last_became_peered":"2023-08-31T01:59:59.135074+0000","last_unstale":"2023-08-31T02:00:03.167610+0000","last_undegraded":"2023-08-31T02:00:03.167610+0000","last_fullsized":"2023-08-31T02:00:03.167610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:41.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180603+0000","last_change":"2023-08-31T01:59:58.141143+0000","last_active":"2023-08-31T02:00:03.180603+0000","last_peered":"2023-08-31T02:00:03.180603+0000","last_clean":"2023-08-31T02:00:03.180603+0000","last_became_active":"2023-08-31T01:59:58.140680+0000","last_became_peered":"2023-08-31T01:59:58.140680+0000","last_unstale":"2023-08-31T02:00:03.180603+0000","last_undegraded":"2023-08-31T02:00:03.180603+0000","last_fullsized":"2023-08-31T02:00:03.180603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241818+0000","last_change":"2023-08-31T02:00:03.187482+0000","last_active":"2023-08-31T02:00:04.241818+0000","last_peered":"2023-08-31T02:00:04.241818+0000","last_clean":"2023-08-31T02:00:04.241818+0000","last_became_active":"2023-08-31T02:00:03.186856+0000","last_became_peered":"2023-08-31T02:00:03.186856+0000","last_unstale":"2023-08-31T02:00:04.241818+0000","last_undegraded":"2023-08-31T02:00:04.241818+0000","last_fullsized":"2023-08-31T02:00:04.241818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180775+0000","last_change":"2023-08-31T01:59:58.143295+0000","last_active":"2023-08-31T02:00:03.180775+0000","last_peered":"2023-08-31T02:00:03.180775+0000","last_clean":"2023-08-31T02:00:03.180775+0000","last_became_active":"2023-08-31T01:59:58.142985+0000","last_became_peered":"2023-08-31T01:59:58.142985+0000","last_unstale":"2023-08-31T02:00:03.180775+0000","last_undegraded":"2023-08-31T02:00:03.180775+0000","last_fullsized":"2023-08-31T02:00:03.180775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182106+0000","last_change":"2023-08-31T01:59:59.127832+0000","last_active":"2023-08-31T02:00:03.182106+0000","last_peered":"2023-08-31T02:00:03.182106+0000","last_clean":"2023-08-31T02:00:03.182106+0000","last_became_active":"2023-08-31T01:59:59.127564+0000","last_became_peered":"2023-08-31T01:59:59.127564+0000","last_unstale":"2023-08-31T02:00:03.182106+0000","last_undegraded":"2023-08-31T02:00:03.182106+0000","last_fullsized":"2023-08-31T02:00:03.182106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.162998+0000","last_change":"2023-08-31T02:00:03.191988+0000","last_active":"2023-08-31T02:00:04.162998+0000","last_peered":"2023-08-31T02:00:04.162998+0000","last_clean":"2023-08-31T02:00:04.162998+0000","last_became_active":"2023-08-31T02:00:03.191349+0000","last_became_peered":"2023-08-31T02:00:03.191349+0000","last_unstale":"2023-08-31T02:00:04.162998+0000","last_undegraded":"2023-08-31T02:00:04.162998+0000","last_fullsized":"2023-08-31T02:00:04.162998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:00:23.252798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183026+0000","last_change":"2023-08-31T01:59:58.138706+0000","last_active":"2023-08-31T02:00:03.183026+0000","last_peered":"2023-08-31T02:00:03.183026+0000","last_clean":"2023-08-31T02:00:03.183026+0000","last_became_active":"2023-08-31T01:59:58.138320+0000","last_became_peered":"2023-08-31T01:59:58.138320+0000","last_unstale":"2023-08-31T02:00:03.183026+0000","last_undegraded":"2023-08-31T02:00:03.183026+0000","last_fullsized":"2023-08-31T02:00:03.183026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:10.392703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164651+0000","last_change":"2023-08-31T01:59:59.144937+0000","last_active":"2023-08-31T02:00:03.164651+0000","last_peered":"2023-08-31T02:00:03.164651+0000","last_clean":"2023-08-31T02:00:03.164651+0000","last_became_active":"2023-08-31T01:59:59.144653+0000","last_became_peered":"2023-08-31T01:59:59.144653+0000","last_unstale":"2023-08-31T02:00:03.164651+0000","last_undegraded":"2023-08-31T02:00:03.164651+0000","last_fullsized":"2023-08-31T02:00:03.164651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:43:55.591253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163711+0000","last_change":"2023-08-31T02:00:03.185348+0000","last_active":"2023-08-31T02:00:04.163711+0000","last_peered":"2023-08-31T02:00:04.163711+0000","last_clean":"2023-08-31T02:00:04.163711+0000","last_became_active":"2023-08-31T02:00:03.184977+0000","last_became_peered":"2023-08-31T02:00:03.184977+0000","last_unstale":"2023-08-31T02:00:04.163711+0000","last_undegraded":"2023-08-31T02:00:04.163711+0000","last_fullsized":"2023-08-31T02:00:04.163711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:36:29.967309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171706+0000","last_change":"2023-08-31T01:59:58.142445+0000","last_active":"2023-08-31T02:00:03.171706+0000","last_peered":"2023-08-31T02:00:03.171706+0000","last_clean":"2023-08-31T02:00:03.171706+0000","last_became_active":"2023-08-31T01:59:58.142166+0000","last_became_peered":"2023-08-31T01:59:58.142166+0000","last_unstale":"2023-08-31T02:00:03.171706+0000","last_undegraded":"2023-08-31T02:00:03.171706+0000","last_fullsized":"2023-08-31T02:00:03.171706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170228+0000","last_change":"2023-08-31T01:59:59.139657+0000","last_active":"2023-08-31T02:00:03.170228+0000","last_peered":"2023-08-31T02:00:03.170228+0000","last_clean":"2023-08-31T02:00:03.170228+0000","last_became_active":"2023-08-31T01:59:59.139380+0000","last_became_peered":"2023-08-31T01:59:59.139380+0000","last_unstale":"2023-08-31T02:00:03.170228+0000","last_undegraded":"2023-08-31T02:00:03.170228+0000","last_fullsized":"2023-08-31T02:00:03.170228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164032+0000","last_change":"2023-08-31T02:00:03.187756+0000","last_active":"2023-08-31T02:00:04.164032+0000","last_peered":"2023-08-31T02:00:04.164032+0000","last_clean":"2023-08-31T02:00:04.164032+0000","last_became_active":"2023-08-31T02:00:03.187322+0000","last_became_peered":"2023-08-31T02:00:03.187322+0000","last_unstale":"2023-08-31T02:00:04.164032+0000","last_undegraded":"2023-08-31T02:00:04.164032+0000","last_fullsized":"2023-08-31T02:00:04.164032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:37:30.912467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180456+0000","last_change":"2023-08-31T01:59:58.143349+0000","last_active":"2023-08-31T02:00:03.180456+0000","last_peered":"2023-08-31T02:00:03.180456+0000","last_clean":"2023-08-31T02:00:03.180456+0000","last_became_active":"2023-08-31T01:59:58.143019+0000","last_became_peered":"2023-08-31T01:59:58.143019+0000","last_unstale":"2023-08-31T02:00:03.180456+0000","last_undegraded":"2023-08-31T02:00:03.180456+0000","last_fullsized":"2023-08-31T02:00:03.180456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:58:23.430586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167307+0000","last_change":"2023-08-31T01:59:59.137822+0000","last_active":"2023-08-31T02:00:03.167307+0000","last_peered":"2023-08-31T02:00:03.167307+0000","last_clean":"2023-08-31T02:00:03.167307+0000","last_became_active":"2023-08-31T01:59:59.137558+0000","last_became_peered":"2023-08-31T01:59:59.137558+0000","last_unstale":"2023-08-31T02:00:03.167307+0000","last_undegraded":"2023-08-31T02:00:03.167307+0000","last_fullsized":"2023-08-31T02:00:03.167307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:32:57.084676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242210+0000","last_change":"2023-08-31T02:00:03.182827+0000","last_active":"2023-08-31T02:00:04.242210+0000","last_peered":"2023-08-31T02:00:04.242210+0000","last_clean":"2023-08-31T02:00:04.242210+0000","last_became_active":"2023-08-31T02:00:03.182438+0000","last_became_peered":"2023-08-31T02:00:03.182438+0000","last_unstale":"2023-08-31T02:00:04.242210+0000","last_undegraded":"2023-08-31T02:00:04.242210+0000","last_fullsized":"2023-08-31T02:00:04.242210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:22:47.889737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182678+0000","last_change":"2023-08-31T01:59:58.142002+0000","last_active":"2023-08-31T02:00:03.182678+0000","last_peered":"2023-08-31T02:00:03.182678+0000","last_clean":"2023-08-31T02:00:03.182678+0000","last_became_active":"2023-08-31T01:59:58.141736+0000","last_became_peered":"2023-08-31T01:59:58.141736+0000","last_unstale":"2023-08-31T02:00:03.182678+0000","last_undegraded":"2023-08-31T02:00:03.182678+0000","last_fullsized":"2023-08-31T02:00:03.182678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:52.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161862+0000","last_change":"2023-08-31T01:59:59.141837+0000","last_active":"2023-08-31T02:00:03.161862+0000","last_peered":"2023-08-31T02:00:03.161862+0000","last_clean":"2023-08-31T02:00:03.161862+0000","last_became_active":"2023-08-31T01:59:59.141556+0000","last_became_peered":"2023-08-31T01:59:59.141556+0000","last_unstale":"2023-08-31T02:00:03.161862+0000","last_undegraded":"2023-08-31T02:00:03.161862+0000","last_fullsized":"2023-08-31T02:00:03.161862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:49:59.637746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164152+0000","last_change":"2023-08-31T02:00:03.189684+0000","last_active":"2023-08-31T02:00:04.164152+0000","last_peered":"2023-08-31T02:00:04.164152+0000","last_clean":"2023-08-31T02:00:04.164152+0000","last_became_active":"2023-08-31T02:00:03.187373+0000","last_became_peered":"2023-08-31T02:00:03.187373+0000","last_unstale":"2023-08-31T02:00:04.164152+0000","last_undegraded":"2023-08-31T02:00:04.164152+0000","last_fullsized":"2023-08-31T02:00:04.164152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:21.879013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182660+0000","last_change":"2023-08-31T01:59:58.136945+0000","last_active":"2023-08-31T02:00:03.182660+0000","last_peered":"2023-08-31T02:00:03.182660+0000","last_clean":"2023-08-31T02:00:03.182660+0000","last_became_active":"2023-08-31T01:59:58.136593+0000","last_became_peered":"2023-08-31T01:59:58.136593+0000","last_unstale":"2023-08-31T02:00:03.182660+0000","last_undegraded":"2023-08-31T02:00:03.182660+0000","last_fullsized":"2023-08-31T02:00:03.182660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:59:35.632366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162451+0000","last_change":"2023-08-31T01:59:59.137446+0000","last_active":"2023-08-31T02:00:03.162451+0000","last_peered":"2023-08-31T02:00:03.162451+0000","last_clean":"2023-08-31T02:00:03.162451+0000","last_became_active":"2023-08-31T01:59:59.137156+0000","last_became_peered":"2023-08-31T01:59:59.137156+0000","last_unstale":"2023-08-31T02:00:03.162451+0000","last_undegraded":"2023-08-31T02:00:03.162451+0000","last_fullsized":"2023-08-31T02:00:03.162451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:58:28.980446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164210+0000","last_change":"2023-08-31T02:00:03.186822+0000","last_active":"2023-08-31T02:00:04.164210+0000","last_peered":"2023-08-31T02:00:04.164210+0000","last_clean":"2023-08-31T02:00:04.164210+0000","last_became_active":"2023-08-31T02:00:03.186360+0000","last_became_peered":"2023-08-31T02:00:03.186360+0000","last_unstale":"2023-08-31T02:00:04.164210+0000","last_undegraded":"2023-08-31T02:00:04.164210+0000","last_fullsized":"2023-08-31T02:00:04.164210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180642+0000","last_change":"2023-08-31T01:59:58.144977+0000","last_active":"2023-08-31T02:00:03.180642+0000","last_peered":"2023-08-31T02:00:03.180642+0000","last_clean":"2023-08-31T02:00:03.180642+0000","last_became_active":"2023-08-31T01:59:58.144682+0000","last_became_peered":"2023-08-31T01:59:58.144682+0000","last_unstale":"2023-08-31T02:00:03.180642+0000","last_undegraded":"2023-08-31T02:00:03.180642+0000","last_fullsized":"2023-08-31T02:00:03.180642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:54:31.237887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170405+0000","last_change":"2023-08-31T01:59:59.145992+0000","last_active":"2023-08-31T02:00:03.170405+0000","last_peered":"2023-08-31T02:00:03.170405+0000","last_clean":"2023-08-31T02:00:03.170405+0000","last_became_active":"2023-08-31T01:59:59.142856+0000","last_became_peered":"2023-08-31T01:59:59.142856+0000","last_unstale":"2023-08-31T02:00:03.170405+0000","last_undegraded":"2023-08-31T02:00:03.170405+0000","last_fullsized":"2023-08-31T02:00:03.170405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241755+0000","last_change":"2023-08-31T02:00:03.189530+0000","last_active":"2023-08-31T02:00:04.241755+0000","last_peered":"2023-08-31T02:00:04.241755+0000","last_clean":"2023-08-31T02:00:04.241755+0000","last_became_active":"2023-08-31T02:00:03.189045+0000","last_became_peered":"2023-08-31T02:00:03.189045+0000","last_unstale":"2023-08-31T02:00:04.241755+0000","last_undegraded":"2023-08-31T02:00:04.241755+0000","last_fullsized":"2023-08-31T02:00:04.241755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.173234+0000","last_change":"2023-08-31T01:59:58.133537+0000","last_active":"2023-08-31T02:00:03.173234+0000","last_peered":"2023-08-31T02:00:03.173234+0000","last_clean":"2023-08-31T02:00:03.173234+0000","last_became_active":"2023-08-31T01:59:58.133222+0000","last_became_peered":"2023-08-31T01:59:58.133222+0000","last_unstale":"2023-08-31T02:00:03.173234+0000","last_undegraded":"2023-08-31T02:00:03.173234+0000","last_fullsized":"2023-08-31T02:00:03.173234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:17.281385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180864+0000","last_change":"2023-08-31T01:59:59.149486+0000","last_active":"2023-08-31T02:00:03.180864+0000","last_peered":"2023-08-31T02:00:03.180864+0000","last_clean":"2023-08-31T02:00:03.180864+0000","last_became_active":"2023-08-31T01:59:59.149195+0000","last_became_peered":"2023-08-31T01:59:59.149195+0000","last_unstale":"2023-08-31T02:00:03.180864+0000","last_undegraded":"2023-08-31T02:00:03.180864+0000","last_fullsized":"2023-08-31T02:00:03.180864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:55:02.768810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241656+0000","last_change":"2023-08-31T02:00:03.194590+0000","last_active":"2023-08-31T02:00:04.241656+0000","last_peered":"2023-08-31T02:00:04.241656+0000","last_clean":"2023-08-31T02:00:04.241656+0000","last_became_active":"2023-08-31T02:00:03.194028+0000","last_became_peered":"2023-08-31T02:00:03.194028+0000","last_unstale":"2023-08-31T02:00:04.241656+0000","last_undegraded":"2023-08-31T02:00:04.241656+0000","last_fullsized":"2023-08-31T02:00:04.241656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:21.879013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183319+0000","last_change":"2023-08-31T01:59:58.140223+0000","last_active":"2023-08-31T02:00:03.183319+0000","last_peered":"2023-08-31T02:00:03.183319+0000","last_clean":"2023-08-31T02:00:03.183319+0000","last_became_active":"2023-08-31T01:59:58.139966+0000","last_became_peered":"2023-08-31T01:59:58.139966+0000","last_unstale":"2023-08-31T02:00:03.183319+0000","last_undegraded":"2023-08-31T02:00:03.183319+0000","last_fullsized":"2023-08-31T02:00:03.183319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162651+0000","last_change":"2023-08-31T01:59:59.139152+0000","last_active":"2023-08-31T02:00:03.162651+0000","last_peered":"2023-08-31T02:00:03.162651+0000","last_clean":"2023-08-31T02:00:03.162651+0000","last_became_active":"2023-08-31T01:59:59.138887+0000","last_became_peered":"2023-08-31T01:59:59.138887+0000","last_unstale":"2023-08-31T02:00:03.162651+0000","last_undegraded":"2023-08-31T02:00:03.162651+0000","last_fullsized":"2023-08-31T02:00:03.162651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:35:52.979172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164612+0000","last_change":"2023-08-31T02:00:03.182923+0000","last_active":"2023-08-31T02:00:04.164612+0000","last_peered":"2023-08-31T02:00:04.164612+0000","last_clean":"2023-08-31T02:00:04.164612+0000","last_became_active":"2023-08-31T02:00:03.182486+0000","last_became_peered":"2023-08-31T02:00:03.182486+0000","last_unstale":"2023-08-31T02:00:04.164612+0000","last_undegraded":"2023-08-31T02:00:04.164612+0000","last_fullsized":"2023-08-31T02:00:04.164612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:45:19.479655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.176209+0000","last_change":"2023-08-31T01:59:58.130739+0000","last_active":"2023-08-31T02:00:03.176209+0000","last_peered":"2023-08-31T02:00:03.176209+0000","last_clean":"2023-08-31T02:00:03.176209+0000","last_became_active":"2023-08-31T01:59:58.130559+0000","last_became_peered":"2023-08-31T01:59:58.130559+0000","last_unstale":"2023-08-31T02:00:03.176209+0000","last_undegraded":"2023-08-31T02:00:03.176209+0000","last_fullsized":"2023-08-31T02:00:03.176209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:52:30.384278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181104+0000","last_change":"2023-08-31T01:59:59.149408+0000","last_active":"2023-08-31T02:00:03.181104+0000","last_peered":"2023-08-31T02:00:03.181104+0000","last_clean":"2023-08-31T02:00:03.181104+0000","last_became_active":"2023-08-31T01:59:59.149129+0000","last_became_peered":"2023-08-31T01:59:59.149129+0000","last_unstale":"2023-08-31T02:00:03.181104+0000","last_undegraded":"2023-08-31T02:00:03.181104+0000","last_fullsized":"2023-08-31T02:00:03.181104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:03.255566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171183+0000","last_change":"2023-08-31T01:59:59.141296+0000","last_active":"2023-08-31T02:00:03.171183+0000","last_peered":"2023-08-31T02:00:03.171183+0000","last_clean":"2023-08-31T02:00:03.171183+0000","last_became_active":"2023-08-31T01:59:59.141010+0000","last_became_peered":"2023-08-31T01:59:59.141010+0000","last_unstale":"2023-08-31T02:00:03.171183+0000","last_undegraded":"2023-08-31T02:00:03.171183+0000","last_fullsized":"2023-08-31T02:00:03.171183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.172411+0000","last_change":"2023-08-31T01:59:59.129754+0000","last_active":"2023-08-31T02:00:03.172411+0000","last_peered":"2023-08-31T02:00:03.172411+0000","last_clean":"2023-08-31T02:00:03.172411+0000","last_became_active":"2023-08-31T01:59:59.127954+0000","last_became_peered":"2023-08-31T01:59:59.127954+0000","last_unstale":"2023-08-31T02:00:03.172411+0000","last_undegraded":"2023-08-31T02:00:03.172411+0000","last_fullsized":"2023-08-31T02:00:03.172411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:19.243425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162957+0000","last_change":"2023-08-31T01:59:59.139684+0000","last_active":"2023-08-31T02:00:03.162957+0000","last_peered":"2023-08-31T02:00:03.162957+0000","last_clean":"2023-08-31T02:00:03.162957+0000","last_became_active":"2023-08-31T01:59:59.139233+0000","last_became_peered":"2023-08-31T01:59:59.139233+0000","last_unstale":"2023-08-31T02:00:03.162957+0000","last_undegraded":"2023-08-31T02:00:03.162957+0000","last_fullsized":"2023-08-31T02:00:03.162957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:50:06.678223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169434+0000","last_change":"2023-08-31T01:59:59.139203+0000","last_active":"2023-08-31T02:00:03.169434+0000","last_peered":"2023-08-31T02:00:03.169434+0000","last_clean":"2023-08-31T02:00:03.169434+0000","last_became_active":"2023-08-31T01:59:59.138931+0000","last_became_peered":"2023-08-31T01:59:59.138931+0000","last_unstale":"2023-08-31T02:00:03.169434+0000","last_undegraded":"2023-08-31T02:00:03.169434+0000","last_fullsized":"2023-08-31T02:00:03.169434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162361+0000","last_change":"2023-08-31T01:59:59.147334+0000","last_active":"2023-08-31T02:00:03.162361+0000","last_peered":"2023-08-31T02:00:03.162361+0000","last_clean":"2023-08-31T02:00:03.162361+0000","last_became_active":"2023-08-31T01:59:59.146910+0000","last_became_peered":"2023-08-31T01:59:59.146910+0000","last_unstale":"2023-08-31T02:00:03.162361+0000","last_undegraded":"2023-08-31T02:00:03.162361+0000","last_fullsized":"2023-08-31T02:00:03.162361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:56:16.408773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183223+0000","last_change":"2023-08-31T01:59:59.139784+0000","last_active":"2023-08-31T02:00:03.183223+0000","last_peered":"2023-08-31T02:00:03.183223+0000","last_clean":"2023-08-31T02:00:03.183223+0000","last_became_active":"2023-08-31T01:59:59.139504+0000","last_became_peered":"2023-08-31T01:59:59.139504+0000","last_unstale":"2023-08-31T02:00:03.183223+0000","last_undegraded":"2023-08-31T02:00:03.183223+0000","last_fullsized":"2023-08-31T02:00:03.183223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:24:58.176806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171308+0000","last_change":"2023-08-31T01:59:59.146628+0000","last_active":"2023-08-31T02:00:03.171308+0000","last_peered":"2023-08-31T02:00:03.171308+0000","last_clean":"2023-08-31T02:00:03.171308+0000","last_became_active":"2023-08-31T01:59:59.146283+0000","last_became_peered":"2023-08-31T01:59:59.146283+0000","last_unstale":"2023-08-31T02:00:03.171308+0000","last_undegraded":"2023-08-31T02:00:03.171308+0000","last_fullsized":"2023-08-31T02:00:03.171308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164760+0000","last_change":"2023-08-31T01:59:59.142109+0000","last_active":"2023-08-31T02:00:03.164760+0000","last_peered":"2023-08-31T02:00:03.164760+0000","last_clean":"2023-08-31T02:00:03.164760+0000","last_became_active":"2023-08-31T01:59:59.141757+0000","last_became_peered":"2023-08-31T01:59:59.141757+0000","last_unstale":"2023-08-31T02:00:03.164760+0000","last_undegraded":"2023-08-31T02:00:03.164760+0000","last_fullsized":"2023-08-31T02:00:03.164760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:13:24.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163648+0000","last_change":"2023-08-31T01:59:59.142887+0000","last_active":"2023-08-31T02:00:03.163648+0000","last_peered":"2023-08-31T02:00:03.163648+0000","last_clean":"2023-08-31T02:00:03.163648+0000","last_became_active":"2023-08-31T01:59:59.142576+0000","last_became_peered":"2023-08-31T01:59:59.142576+0000","last_unstale":"2023-08-31T02:00:03.163648+0000","last_undegraded":"2023-08-31T02:00:03.163648+0000","last_fullsized":"2023-08-31T02:00:03.163648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:13:24.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162037+0000","last_change":"2023-08-31T01:59:59.144355+0000","last_active":"2023-08-31T02:00:03.162037+0000","last_peered":"2023-08-31T02:00:03.162037+0000","last_clean":"2023-08-31T02:00:03.162037+0000","last_became_active":"2023-08-31T01:59:59.144045+0000","last_became_peered":"2023-08-31T01:59:59.144045+0000","last_unstale":"2023-08-31T02:00:03.162037+0000","last_undegraded":"2023-08-31T02:00:03.162037+0000","last_fullsized":"2023-08-31T02:00:03.162037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:36:58.237436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163460+0000","last_change":"2023-08-31T01:59:59.139501+0000","last_active":"2023-08-31T02:00:03.163460+0000","last_peered":"2023-08-31T02:00:03.163460+0000","last_clean":"2023-08-31T02:00:03.163460+0000","last_became_active":"2023-08-31T01:59:59.138918+0000","last_became_peered":"2023-08-31T01:59:59.138918+0000","last_unstale":"2023-08-31T02:00:03.163460+0000","last_undegraded":"2023-08-31T02:00:03.163460+0000","last_fullsized":"2023-08-31T02:00:03.163460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:43:55.591253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169517+0000","last_change":"2023-08-31T01:59:59.143302+0000","last_active":"2023-08-31T02:00:03.169517+0000","last_peered":"2023-08-31T02:00:03.169517+0000","last_clean":"2023-08-31T02:00:03.169517+0000","last_became_active":"2023-08-31T01:59:59.142853+0000","last_became_peered":"2023-08-31T01:59:59.142853+0000","last_unstale":"2023-08-31T02:00:03.169517+0000","last_undegraded":"2023-08-31T02:00:03.169517+0000","last_fullsized":"2023-08-31T02:00:03.169517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:54:32.244757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170712+0000","last_change":"2023-08-31T01:59:59.144185+0000","last_active":"2023-08-31T02:00:03.170712+0000","last_peered":"2023-08-31T02:00:03.170712+0000","last_clean":"2023-08-31T02:00:03.170712+0000","last_became_active":"2023-08-31T01:59:59.143219+0000","last_became_peered":"2023-08-31T01:59:59.143219+0000","last_unstale":"2023-08-31T02:00:03.170712+0000","last_undegraded":"2023-08-31T02:00:03.170712+0000","last_fullsized":"2023-08-31T02:00:03.170712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":107610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":698400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":698456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":107576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:00:17.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:00:17.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.446+0000 7fa5153ae700 1 -- 172.21.15.84:0/2870856014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 msgr2=0x7fa5100c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.446+0000 7fa5153ae700 1 --2- 172.21.15.84:0/2870856014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 0x7fa5100c9ac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa5000098c0 tx=0x7fa500009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.446+0000 7fa5153ae700 1 -- 172.21.15.84:0/2870856014 shutdown_connections 2023-08-31T02:00:17.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.446+0000 7fa5153ae700 1 --2- 172.21.15.84:0/2870856014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 0x7fa5100c9ac0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.446+0000 7fa5153ae700 1 -- 172.21.15.84:0/2870856014 >> 172.21.15.84:0/2870856014 conn(0x7fa5100caa20 msgr2=0x7fa5100cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.446+0000 7fa5153ae700 1 -- 172.21.15.84:0/2870856014 shutdown_connections 2023-08-31T02:00:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.446+0000 7fa5153ae700 1 -- 172.21.15.84:0/2870856014 wait complete. 2023-08-31T02:00:17.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa5153ae700 1 Processor -- start 2023-08-31T02:00:17.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa5153ae700 1 -- start start 2023-08-31T02:00:17.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa5153ae700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100707c0 0x7fa510157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa5153ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 0x7fa5100c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa5153ae700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa510158220 0x7fa5100ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa5153ae700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa510157a80 con 0x7fa5100cc920 2023-08-31T02:00:17.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa5153ae700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100c8160 con 0x7fa510158220 2023-08-31T02:00:17.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa5153ae700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100c8440 con 0x7fa5100707c0 2023-08-31T02:00:17.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.448+0000 7fa50e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 0x7fa5100c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 0x7fa5100c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51336/0 (socket says 172.21.15.84:51336) 2023-08-31T02:00:17.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50e7fc700 1 -- 172.21.15.84:0/1864420897 learned_addr learned my addr 172.21.15.84:0/1864420897 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:17.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50effd700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100707c0 0x7fa510157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50f7fe700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa510158220 0x7fa5100ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50e7fc700 1 -- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100707c0 msgr2=0x7fa510157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50e7fc700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100707c0 0x7fa510157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50e7fc700 1 -- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa510158220 msgr2=0x7fa5100ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50e7fc700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa510158220 0x7fa5100ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50e7fc700 1 -- 172.21.15.84:0/1864420897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500009520 con 0x7fa5100cc920 2023-08-31T02:00:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50f7fe700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa510158220 0x7fa5100ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa50e7fc700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 0x7fa5100c5070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa500003a50 tx=0x7fa500003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa4f77fe700 1 -- 172.21.15.84:0/1864420897 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50001c070 con 0x7fa5100cc920 2023-08-31T02:00:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa4f77fe700 1 -- 172.21.15.84:0/1864420897 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa50000b6a0 con 0x7fa5100cc920 2023-08-31T02:00:17.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5100c8720 con 0x7fa5100cc920 2023-08-31T02:00:17.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa4f77fe700 1 -- 172.21.15.84:0/1864420897 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000ba90 con 0x7fa5100cc920 2023-08-31T02:00:17.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.449+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5100c8ce0 con 0x7fa5100cc920 2023-08-31T02:00:17.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.450+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51004e7c0 con 0x7fa5100cc920 2023-08-31T02:00:17.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.450+0000 7fa4f77fe700 1 -- 172.21.15.84:0/1864420897 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa500020070 con 0x7fa5100cc920 2023-08-31T02:00:17.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.451+0000 7fa4f77fe700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4fc06a0e0 0x7fa4fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.451+0000 7fa50effd700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4fc06a0e0 0x7fa4fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.451+0000 7fa4f77fe700 1 -- 172.21.15.84:0/1864420897 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa500089ba0 con 0x7fa5100cc920 2023-08-31T02:00:17.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.451+0000 7fa50effd700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4fc06a0e0 0x7fa4fc06c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa510071450 tx=0x7fa504008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:17.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.455+0000 7fa4f77fe700 1 -- 172.21.15.84:0/1864420897 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa500055120 con 0x7fa5100cc920 2023-08-31T02:00:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.641+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5100c9e10 con 0x7fa4fc06a0e0 2023-08-31T02:00:17.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.650+0000 7fa4f77fe700 1 -- 172.21.15.84:0/1864420897 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345275 (secure 0 0 0) 0x7fa5100c9e10 con 0x7fa4fc06a0e0 2023-08-31T02:00:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:17.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4fc06a0e0 msgr2=0x7fa4fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4fc06a0e0 0x7fa4fc06c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa510071450 tx=0x7fa504008040 comp rx=0 tx=0).stop 2023-08-31T02:00:17.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 msgr2=0x7fa5100c5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 0x7fa5100c5070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa500003a50 tx=0x7fa500003e60 comp rx=0 tx=0).stop 2023-08-31T02:00:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 shutdown_connections 2023-08-31T02:00:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4fc06a0e0 0x7fa4fc06c5a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa510158220 0x7fa5100ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100707c0 0x7fa510157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 --2- 172.21.15.84:0/1864420897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5100cc920 0x7fa5100c5070 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 >> 172.21.15.84:0/1864420897 conn(0x7fa5100caa20 msgr2=0x7fa5100b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 shutdown_connections 2023-08-31T02:00:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.654+0000 7fa5153ae700 1 -- 172.21.15.84:0/1864420897 wait complete. 2023-08-31T02:00:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:00:17.658 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-08-31T02:00:17.053563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219532,"kb_used_data":3368,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755188,"statfs":{"total":773094113280,"available":772869312512,"internally_reserved":0,"allocated":3448832,"data_stored":2049616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181204+0000","last_change":"2023-08-31T01:59:59.153066+0000","last_active":"2023-08-31T02:00:03.181204+0000","last_peered":"2023-08-31T02:00:03.181204+0000","last_clean":"2023-08-31T02:00:03.181204+0000","last_became_active":"2023-08-31T01:59:59.152543+0000","last_became_peered":"2023-08-31T01:59:59.152543+0000","last_unstale":"2023-08-31T02:00:03.181204+0000","last_undegraded":"2023-08-31T02:00:03.181204+0000","last_fullsized":"2023-08-31T02:00:03.181204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:17.842126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183513+0000","last_change":"2023-08-31T01:59:59.132145+0000","last_active":"2023-08-31T02:00:03.183513+0000","last_peered":"2023-08-31T02:00:03.183513+0000","last_clean":"2023-08-31T02:00:03.183513+0000","last_became_active":"2023-08-31T01:59:59.131885+0000","last_became_peered":"2023-08-31T01:59:59.131885+0000","last_unstale":"2023-08-31T02:00:03.183513+0000","last_undegraded":"2023-08-31T02:00:03.183513+0000","last_fullsized":"2023-08-31T02:00:03.183513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169077+0000","last_change":"2023-08-31T01:59:59.131265+0000","last_active":"2023-08-31T02:00:03.169077+0000","last_peered":"2023-08-31T02:00:03.169077+0000","last_clean":"2023-08-31T02:00:03.169077+0000","last_became_active":"2023-08-31T01:59:59.130984+0000","last_became_peered":"2023-08-31T01:59:59.130984+0000","last_unstale":"2023-08-31T02:00:03.169077+0000","last_undegraded":"2023-08-31T02:00:03.169077+0000","last_fullsized":"2023-08-31T02:00:03.169077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:24:58.176806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162779+0000","last_change":"2023-08-31T01:59:59.142792+0000","last_active":"2023-08-31T02:00:03.162779+0000","last_peered":"2023-08-31T02:00:03.162779+0000","last_clean":"2023-08-31T02:00:03.162779+0000","last_became_active":"2023-08-31T01:59:59.142520+0000","last_became_peered":"2023-08-31T01:59:59.142520+0000","last_unstale":"2023-08-31T02:00:03.162779+0000","last_undegraded":"2023-08-31T02:00:03.162779+0000","last_fullsized":"2023-08-31T02:00:03.162779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:46.986597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180530+0000","last_change":"2023-08-31T01:59:59.140365+0000","last_active":"2023-08-31T02:00:03.180530+0000","last_peered":"2023-08-31T02:00:03.180530+0000","last_clean":"2023-08-31T02:00:03.180530+0000","last_became_active":"2023-08-31T01:59:59.140113+0000","last_became_peered":"2023-08-31T01:59:59.140113+0000","last_unstale":"2023-08-31T02:00:03.180530+0000","last_undegraded":"2023-08-31T02:00:03.180530+0000","last_fullsized":"2023-08-31T02:00:03.180530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:55:33.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163582+0000","last_change":"2023-08-31T01:59:59.134781+0000","last_active":"2023-08-31T02:00:03.163582+0000","last_peered":"2023-08-31T02:00:03.163582+0000","last_clean":"2023-08-31T02:00:03.163582+0000","last_became_active":"2023-08-31T01:59:59.134480+0000","last_became_peered":"2023-08-31T01:59:59.134480+0000","last_unstale":"2023-08-31T02:00:03.163582+0000","last_undegraded":"2023-08-31T02:00:03.163582+0000","last_fullsized":"2023-08-31T02:00:03.163582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:56:16.408773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181151+0000","last_change":"2023-08-31T01:59:59.138166+0000","last_active":"2023-08-31T02:00:03.181151+0000","last_peered":"2023-08-31T02:00:03.181151+0000","last_clean":"2023-08-31T02:00:03.181151+0000","last_became_active":"2023-08-31T01:59:59.137906+0000","last_became_peered":"2023-08-31T01:59:59.137906+0000","last_unstale":"2023-08-31T02:00:03.181151+0000","last_undegraded":"2023-08-31T02:00:03.181151+0000","last_fullsized":"2023-08-31T02:00:03.181151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:21:43.096879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162548+0000","last_change":"2023-08-31T01:59:59.139015+0000","last_active":"2023-08-31T02:00:03.162548+0000","last_peered":"2023-08-31T02:00:03.162548+0000","last_clean":"2023-08-31T02:00:03.162548+0000","last_became_active":"2023-08-31T01:59:59.138750+0000","last_became_peered":"2023-08-31T01:59:59.138750+0000","last_unstale":"2023-08-31T02:00:03.162548+0000","last_undegraded":"2023-08-31T02:00:03.162548+0000","last_fullsized":"2023-08-31T02:00:03.162548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:41:19.129611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181131+0000","last_change":"2023-08-31T01:59:59.148629+0000","last_active":"2023-08-31T02:00:03.181131+0000","last_peered":"2023-08-31T02:00:03.181131+0000","last_clean":"2023-08-31T02:00:03.181131+0000","last_became_active":"2023-08-31T01:59:59.148368+0000","last_became_peered":"2023-08-31T01:59:59.148368+0000","last_unstale":"2023-08-31T02:00:03.181131+0000","last_undegraded":"2023-08-31T02:00:03.181131+0000","last_fullsized":"2023-08-31T02:00:03.181131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:37:26.875580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170679+0000","last_change":"2023-08-31T01:59:59.146071+0000","last_active":"2023-08-31T02:00:03.170679+0000","last_peered":"2023-08-31T02:00:03.170679+0000","last_clean":"2023-08-31T02:00:03.170679+0000","last_became_active":"2023-08-31T01:59:59.141603+0000","last_became_peered":"2023-08-31T01:59:59.141603+0000","last_unstale":"2023-08-31T02:00:03.170679+0000","last_undegraded":"2023-08-31T02:00:03.170679+0000","last_fullsized":"2023-08-31T02:00:03.170679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:55:33.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171222+0000","last_change":"2023-08-31T01:59:59.146296+0000","last_active":"2023-08-31T02:00:03.171222+0000","last_peered":"2023-08-31T02:00:03.171222+0000","last_clean":"2023-08-31T02:00:03.171222+0000","last_became_active":"2023-08-31T01:59:59.143079+0000","last_became_peered":"2023-08-31T01:59:59.143079+0000","last_unstale":"2023-08-31T02:00:03.171222+0000","last_undegraded":"2023-08-31T02:00:03.171222+0000","last_fullsized":"2023-08-31T02:00:03.171222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:21:43.096879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167674+0000","last_change":"2023-08-31T01:59:59.144579+0000","last_active":"2023-08-31T02:00:03.167674+0000","last_peered":"2023-08-31T02:00:03.167674+0000","last_clean":"2023-08-31T02:00:03.167674+0000","last_became_active":"2023-08-31T01:59:59.144144+0000","last_became_peered":"2023-08-31T01:59:59.144144+0000","last_unstale":"2023-08-31T02:00:03.167674+0000","last_undegraded":"2023-08-31T02:00:03.167674+0000","last_fullsized":"2023-08-31T02:00:03.167674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:41.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162134+0000","last_change":"2023-08-31T01:59:59.153550+0000","last_active":"2023-08-31T02:00:03.162134+0000","last_peered":"2023-08-31T02:00:03.162134+0000","last_clean":"2023-08-31T02:00:03.162134+0000","last_became_active":"2023-08-31T01:59:59.153324+0000","last_became_peered":"2023-08-31T01:59:59.153324+0000","last_unstale":"2023-08-31T02:00:03.162134+0000","last_undegraded":"2023-08-31T02:00:03.162134+0000","last_fullsized":"2023-08-31T02:00:03.162134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:02:02.199676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167186+0000","last_change":"2023-08-31T01:59:59.140970+0000","last_active":"2023-08-31T02:00:03.167186+0000","last_peered":"2023-08-31T02:00:03.167186+0000","last_clean":"2023-08-31T02:00:03.167186+0000","last_became_active":"2023-08-31T01:59:59.140228+0000","last_became_peered":"2023-08-31T01:59:59.140228+0000","last_unstale":"2023-08-31T02:00:03.167186+0000","last_undegraded":"2023-08-31T02:00:03.167186+0000","last_fullsized":"2023-08-31T02:00:03.167186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:28.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181691+0000","last_change":"2023-08-31T01:59:59.134845+0000","last_active":"2023-08-31T02:00:03.181691+0000","last_peered":"2023-08-31T02:00:03.181691+0000","last_clean":"2023-08-31T02:00:03.181691+0000","last_became_active":"2023-08-31T01:59:59.134582+0000","last_became_peered":"2023-08-31T01:59:59.134582+0000","last_unstale":"2023-08-31T02:00:03.181691+0000","last_undegraded":"2023-08-31T02:00:03.181691+0000","last_fullsized":"2023-08-31T02:00:03.181691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162420+0000","last_change":"2023-08-31T01:59:59.129553+0000","last_active":"2023-08-31T02:00:03.162420+0000","last_peered":"2023-08-31T02:00:03.162420+0000","last_clean":"2023-08-31T02:00:03.162420+0000","last_became_active":"2023-08-31T01:59:59.129229+0000","last_became_peered":"2023-08-31T01:59:59.129229+0000","last_unstale":"2023-08-31T02:00:03.162420+0000","last_undegraded":"2023-08-31T02:00:03.162420+0000","last_fullsized":"2023-08-31T02:00:03.162420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:23:18.368239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163287+0000","last_change":"2023-08-31T01:59:59.143663+0000","last_active":"2023-08-31T02:00:03.163287+0000","last_peered":"2023-08-31T02:00:03.163287+0000","last_clean":"2023-08-31T02:00:03.163287+0000","last_became_active":"2023-08-31T01:59:59.143284+0000","last_became_peered":"2023-08-31T01:59:59.143284+0000","last_unstale":"2023-08-31T02:00:03.163287+0000","last_undegraded":"2023-08-31T02:00:03.163287+0000","last_fullsized":"2023-08-31T02:00:03.163287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:57:18.747036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.173127+0000","last_change":"2023-08-31T01:59:59.149136+0000","last_active":"2023-08-31T02:00:03.173127+0000","last_peered":"2023-08-31T02:00:03.173127+0000","last_clean":"2023-08-31T02:00:03.173127+0000","last_became_active":"2023-08-31T01:59:59.148859+0000","last_became_peered":"2023-08-31T01:59:59.148859+0000","last_unstale":"2023-08-31T02:00:03.173127+0000","last_undegraded":"2023-08-31T02:00:03.173127+0000","last_fullsized":"2023-08-31T02:00:03.173127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:15.781174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180955+0000","last_change":"2023-08-31T01:59:59.140287+0000","last_active":"2023-08-31T02:00:03.180955+0000","last_peered":"2023-08-31T02:00:03.180955+0000","last_clean":"2023-08-31T02:00:03.180955+0000","last_became_active":"2023-08-31T01:59:59.140016+0000","last_became_peered":"2023-08-31T01:59:59.140016+0000","last_unstale":"2023-08-31T02:00:03.180955+0000","last_undegraded":"2023-08-31T02:00:03.180955+0000","last_fullsized":"2023-08-31T02:00:03.180955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:42:39.396804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163349+0000","last_change":"2023-08-31T02:00:03.192225+0000","last_active":"2023-08-31T02:00:04.163349+0000","last_peered":"2023-08-31T02:00:04.163349+0000","last_clean":"2023-08-31T02:00:04.163349+0000","last_became_active":"2023-08-31T02:00:03.191659+0000","last_became_peered":"2023-08-31T02:00:03.191659+0000","last_unstale":"2023-08-31T02:00:04.163349+0000","last_undegraded":"2023-08-31T02:00:04.163349+0000","last_fullsized":"2023-08-31T02:00:04.163349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:07.950758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169428+0000","last_change":"2023-08-31T01:59:58.142347+0000","last_active":"2023-08-31T02:00:03.169428+0000","last_peered":"2023-08-31T02:00:03.169428+0000","last_clean":"2023-08-31T02:00:03.169428+0000","last_became_active":"2023-08-31T01:59:58.142075+0000","last_became_peered":"2023-08-31T01:59:58.142075+0000","last_unstale":"2023-08-31T02:00:03.169428+0000","last_undegraded":"2023-08-31T02:00:03.169428+0000","last_fullsized":"2023-08-31T02:00:03.169428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164531+0000","last_change":"2023-08-31T01:59:59.154639+0000","last_active":"2023-08-31T02:00:03.164531+0000","last_peered":"2023-08-31T02:00:03.164531+0000","last_clean":"2023-08-31T02:00:03.164531+0000","last_became_active":"2023-08-31T01:59:59.154308+0000","last_became_peered":"2023-08-31T01:59:59.154308+0000","last_unstale":"2023-08-31T02:00:03.164531+0000","last_undegraded":"2023-08-31T02:00:03.164531+0000","last_fullsized":"2023-08-31T02:00:03.164531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:23:18.368239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163776+0000","last_change":"2023-08-31T02:00:03.188074+0000","last_active":"2023-08-31T02:00:04.163776+0000","last_peered":"2023-08-31T02:00:04.163776+0000","last_clean":"2023-08-31T02:00:04.163776+0000","last_became_active":"2023-08-31T02:00:03.187698+0000","last_became_peered":"2023-08-31T02:00:03.187698+0000","last_unstale":"2023-08-31T02:00:04.163776+0000","last_undegraded":"2023-08-31T02:00:04.163776+0000","last_fullsized":"2023-08-31T02:00:04.163776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:55:06.805698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164700+0000","last_change":"2023-08-31T01:59:58.132279+0000","last_active":"2023-08-31T02:00:03.164700+0000","last_peered":"2023-08-31T02:00:03.164700+0000","last_clean":"2023-08-31T02:00:03.164700+0000","last_became_active":"2023-08-31T01:59:58.132009+0000","last_became_peered":"2023-08-31T01:59:58.132009+0000","last_unstale":"2023-08-31T02:00:03.164700+0000","last_undegraded":"2023-08-31T02:00:03.164700+0000","last_fullsized":"2023-08-31T02:00:03.164700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:02:21.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169076+0000","last_change":"2023-08-31T01:59:59.135972+0000","last_active":"2023-08-31T02:00:03.169076+0000","last_peered":"2023-08-31T02:00:03.169076+0000","last_clean":"2023-08-31T02:00:03.169076+0000","last_became_active":"2023-08-31T01:59:59.135691+0000","last_became_peered":"2023-08-31T01:59:59.135691+0000","last_unstale":"2023-08-31T02:00:03.169076+0000","last_undegraded":"2023-08-31T02:00:03.169076+0000","last_fullsized":"2023-08-31T02:00:03.169076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:03.652877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164169+0000","last_change":"2023-08-31T02:00:03.192204+0000","last_active":"2023-08-31T02:00:04.164169+0000","last_peered":"2023-08-31T02:00:04.164169+0000","last_clean":"2023-08-31T02:00:04.164169+0000","last_became_active":"2023-08-31T02:00:03.191633+0000","last_became_peered":"2023-08-31T02:00:03.191633+0000","last_unstale":"2023-08-31T02:00:04.164169+0000","last_undegraded":"2023-08-31T02:00:04.164169+0000","last_fullsized":"2023-08-31T02:00:04.164169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180816+0000","last_change":"2023-08-31T01:59:58.143879+0000","last_active":"2023-08-31T02:00:03.180816+0000","last_peered":"2023-08-31T02:00:03.180816+0000","last_clean":"2023-08-31T02:00:03.180816+0000","last_became_active":"2023-08-31T01:59:58.143588+0000","last_became_peered":"2023-08-31T01:59:58.143588+0000","last_unstale":"2023-08-31T02:00:03.180816+0000","last_undegraded":"2023-08-31T02:00:03.180816+0000","last_fullsized":"2023-08-31T02:00:03.180816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:46.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162551+0000","last_change":"2023-08-31T01:59:59.136923+0000","last_active":"2023-08-31T02:00:03.162551+0000","last_peered":"2023-08-31T02:00:03.162551+0000","last_clean":"2023-08-31T02:00:03.162551+0000","last_became_active":"2023-08-31T01:59:59.136667+0000","last_became_peered":"2023-08-31T01:59:59.136667+0000","last_unstale":"2023-08-31T02:00:03.162551+0000","last_undegraded":"2023-08-31T02:00:03.162551+0000","last_fullsized":"2023-08-31T02:00:03.162551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:56:30.420963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163855+0000","last_change":"2023-08-31T02:00:03.174239+0000","last_active":"2023-08-31T02:00:04.163855+0000","last_peered":"2023-08-31T02:00:04.163855+0000","last_clean":"2023-08-31T02:00:04.163855+0000","last_became_active":"2023-08-31T02:00:03.173806+0000","last_became_peered":"2023-08-31T02:00:03.173806+0000","last_unstale":"2023-08-31T02:00:04.163855+0000","last_undegraded":"2023-08-31T02:00:04.163855+0000","last_fullsized":"2023-08-31T02:00:04.163855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:07.292454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180701+0000","last_change":"2023-08-31T01:59:58.142035+0000","last_active":"2023-08-31T02:00:03.180701+0000","last_peered":"2023-08-31T02:00:03.180701+0000","last_clean":"2023-08-31T02:00:03.180701+0000","last_became_active":"2023-08-31T01:59:58.141223+0000","last_became_peered":"2023-08-31T01:59:58.141223+0000","last_unstale":"2023-08-31T02:00:03.180701+0000","last_undegraded":"2023-08-31T02:00:03.180701+0000","last_fullsized":"2023-08-31T02:00:03.180701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:54:24.757437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163587+0000","last_change":"2023-08-31T01:59:59.135949+0000","last_active":"2023-08-31T02:00:03.163587+0000","last_peered":"2023-08-31T02:00:03.163587+0000","last_clean":"2023-08-31T02:00:03.163587+0000","last_became_active":"2023-08-31T01:59:59.135657+0000","last_became_peered":"2023-08-31T01:59:59.135657+0000","last_unstale":"2023-08-31T02:00:03.163587+0000","last_undegraded":"2023-08-31T02:00:03.163587+0000","last_fullsized":"2023-08-31T02:00:03.163587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:05:14.371221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163462+0000","last_change":"2023-08-31T02:00:03.197344+0000","last_active":"2023-08-31T02:00:04.163462+0000","last_peered":"2023-08-31T02:00:04.163462+0000","last_clean":"2023-08-31T02:00:04.163462+0000","last_became_active":"2023-08-31T02:00:03.196881+0000","last_became_peered":"2023-08-31T02:00:03.196881+0000","last_unstale":"2023-08-31T02:00:04.163462+0000","last_undegraded":"2023-08-31T02:00:04.163462+0000","last_fullsized":"2023-08-31T02:00:04.163462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:06:25.721250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162344+0000","last_change":"2023-08-31T01:59:58.141370+0000","last_active":"2023-08-31T02:00:03.162344+0000","last_peered":"2023-08-31T02:00:03.162344+0000","last_clean":"2023-08-31T02:00:03.162344+0000","last_became_active":"2023-08-31T01:59:58.141142+0000","last_became_peered":"2023-08-31T01:59:58.141142+0000","last_unstale":"2023-08-31T02:00:03.162344+0000","last_undegraded":"2023-08-31T02:00:03.162344+0000","last_fullsized":"2023-08-31T02:00:03.162344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:59:13.304994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167343+0000","last_change":"2023-08-31T01:59:59.142375+0000","last_active":"2023-08-31T02:00:03.167343+0000","last_peered":"2023-08-31T02:00:03.167343+0000","last_clean":"2023-08-31T02:00:03.167343+0000","last_became_active":"2023-08-31T01:59:59.142081+0000","last_became_peered":"2023-08-31T01:59:59.142081+0000","last_unstale":"2023-08-31T02:00:03.167343+0000","last_undegraded":"2023-08-31T02:00:03.167343+0000","last_fullsized":"2023-08-31T02:00:03.167343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:11.399572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.243672+0000","last_change":"2023-08-31T02:00:03.187642+0000","last_active":"2023-08-31T02:00:04.243672+0000","last_peered":"2023-08-31T02:00:04.243672+0000","last_clean":"2023-08-31T02:00:04.243672+0000","last_became_active":"2023-08-31T02:00:03.187241+0000","last_became_peered":"2023-08-31T02:00:03.187241+0000","last_unstale":"2023-08-31T02:00:04.243672+0000","last_undegraded":"2023-08-31T02:00:04.243672+0000","last_fullsized":"2023-08-31T02:00:04.243672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:02:06.236563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170304+0000","last_change":"2023-08-31T01:59:58.135240+0000","last_active":"2023-08-31T02:00:03.170304+0000","last_peered":"2023-08-31T02:00:03.170304+0000","last_clean":"2023-08-31T02:00:03.170304+0000","last_became_active":"2023-08-31T01:59:58.134970+0000","last_became_peered":"2023-08-31T01:59:58.134970+0000","last_unstale":"2023-08-31T02:00:03.170304+0000","last_undegraded":"2023-08-31T02:00:03.170304+0000","last_fullsized":"2023-08-31T02:00:03.170304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:27.460329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.168630+0000","last_change":"2023-08-31T01:59:59.136910+0000","last_active":"2023-08-31T02:00:03.168630+0000","last_peered":"2023-08-31T02:00:03.168630+0000","last_clean":"2023-08-31T02:00:03.168630+0000","last_became_active":"2023-08-31T01:59:59.136639+0000","last_became_peered":"2023-08-31T01:59:59.136639+0000","last_unstale":"2023-08-31T02:00:03.168630+0000","last_undegraded":"2023-08-31T02:00:03.168630+0000","last_fullsized":"2023-08-31T02:00:03.168630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242167+0000","last_change":"2023-08-31T02:00:03.191155+0000","last_active":"2023-08-31T02:00:04.242167+0000","last_peered":"2023-08-31T02:00:04.242167+0000","last_clean":"2023-08-31T02:00:04.242167+0000","last_became_active":"2023-08-31T02:00:03.190781+0000","last_became_peered":"2023-08-31T02:00:03.190781+0000","last_unstale":"2023-08-31T02:00:04.242167+0000","last_undegraded":"2023-08-31T02:00:04.242167+0000","last_fullsized":"2023-08-31T02:00:04.242167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161935+0000","last_change":"2023-08-31T01:59:58.136133+0000","last_active":"2023-08-31T02:00:03.161935+0000","last_peered":"2023-08-31T02:00:03.161935+0000","last_clean":"2023-08-31T02:00:03.161935+0000","last_became_active":"2023-08-31T01:59:58.135866+0000","last_became_peered":"2023-08-31T01:59:58.135866+0000","last_unstale":"2023-08-31T02:00:03.161935+0000","last_undegraded":"2023-08-31T02:00:03.161935+0000","last_fullsized":"2023-08-31T02:00:03.161935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:07:34.297167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161781+0000","last_change":"2023-08-31T01:59:59.137046+0000","last_active":"2023-08-31T02:00:03.161781+0000","last_peered":"2023-08-31T02:00:03.161781+0000","last_clean":"2023-08-31T02:00:03.161781+0000","last_became_active":"2023-08-31T01:59:59.136766+0000","last_became_peered":"2023-08-31T01:59:59.136766+0000","last_unstale":"2023-08-31T02:00:03.161781+0000","last_undegraded":"2023-08-31T02:00:03.161781+0000","last_fullsized":"2023-08-31T02:00:03.161781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:36.061031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242413+0000","last_change":"2023-08-31T02:00:03.185467+0000","last_active":"2023-08-31T02:00:04.242413+0000","last_peered":"2023-08-31T02:00:04.242413+0000","last_clean":"2023-08-31T02:00:04.242413+0000","last_became_active":"2023-08-31T02:00:03.185055+0000","last_became_peered":"2023-08-31T02:00:03.185055+0000","last_unstale":"2023-08-31T02:00:04.242413+0000","last_undegraded":"2023-08-31T02:00:04.242413+0000","last_fullsized":"2023-08-31T02:00:04.242413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:12:08.637395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163543+0000","last_change":"2023-08-31T01:59:58.135749+0000","last_active":"2023-08-31T02:00:03.163543+0000","last_peered":"2023-08-31T02:00:03.163543+0000","last_clean":"2023-08-31T02:00:03.163543+0000","last_became_active":"2023-08-31T01:59:58.134641+0000","last_became_peered":"2023-08-31T01:59:58.134641+0000","last_unstale":"2023-08-31T02:00:03.163543+0000","last_undegraded":"2023-08-31T02:00:03.163543+0000","last_fullsized":"2023-08-31T02:00:03.163543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:14.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181824+0000","last_change":"2023-08-31T01:59:59.139726+0000","last_active":"2023-08-31T02:00:03.181824+0000","last_peered":"2023-08-31T02:00:03.181824+0000","last_clean":"2023-08-31T02:00:03.181824+0000","last_became_active":"2023-08-31T01:59:59.139453+0000","last_became_peered":"2023-08-31T01:59:59.139453+0000","last_unstale":"2023-08-31T02:00:03.181824+0000","last_undegraded":"2023-08-31T02:00:03.181824+0000","last_fullsized":"2023-08-31T02:00:03.181824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163132+0000","last_change":"2023-08-31T02:00:03.188588+0000","last_active":"2023-08-31T02:00:04.163132+0000","last_peered":"2023-08-31T02:00:04.163132+0000","last_clean":"2023-08-31T02:00:04.163132+0000","last_became_active":"2023-08-31T02:00:03.187651+0000","last_became_peered":"2023-08-31T02:00:03.187651+0000","last_unstale":"2023-08-31T02:00:04.163132+0000","last_undegraded":"2023-08-31T02:00:04.163132+0000","last_fullsized":"2023-08-31T02:00:04.163132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:58:48.531393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171794+0000","last_change":"2023-08-31T01:59:58.137377+0000","last_active":"2023-08-31T02:00:03.171794+0000","last_peered":"2023-08-31T02:00:03.171794+0000","last_clean":"2023-08-31T02:00:03.171794+0000","last_became_active":"2023-08-31T01:59:58.137080+0000","last_became_peered":"2023-08-31T01:59:58.137080+0000","last_unstale":"2023-08-31T02:00:03.171794+0000","last_undegraded":"2023-08-31T02:00:03.171794+0000","last_fullsized":"2023-08-31T02:00:03.171794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:10.392703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163096+0000","last_change":"2023-08-31T01:59:59.138414+0000","last_active":"2023-08-31T02:00:03.163096+0000","last_peered":"2023-08-31T02:00:03.163096+0000","last_clean":"2023-08-31T02:00:03.163096+0000","last_became_active":"2023-08-31T01:59:59.138115+0000","last_became_peered":"2023-08-31T01:59:59.138115+0000","last_unstale":"2023-08-31T02:00:03.163096+0000","last_undegraded":"2023-08-31T02:00:03.163096+0000","last_fullsized":"2023-08-31T02:00:03.163096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:56:15.505917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163393+0000","last_change":"2023-08-31T02:00:03.177589+0000","last_active":"2023-08-31T02:00:04.163393+0000","last_peered":"2023-08-31T02:00:04.163393+0000","last_clean":"2023-08-31T02:00:04.163393+0000","last_became_active":"2023-08-31T02:00:03.177081+0000","last_became_peered":"2023-08-31T02:00:03.177081+0000","last_unstale":"2023-08-31T02:00:04.163393+0000","last_undegraded":"2023-08-31T02:00:04.163393+0000","last_fullsized":"2023-08-31T02:00:04.163393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:45:19.479655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162995+0000","last_change":"2023-08-31T01:59:58.136589+0000","last_active":"2023-08-31T02:00:03.162995+0000","last_peered":"2023-08-31T02:00:03.162995+0000","last_clean":"2023-08-31T02:00:03.162995+0000","last_became_active":"2023-08-31T01:59:58.136034+0000","last_became_peered":"2023-08-31T01:59:58.136034+0000","last_unstale":"2023-08-31T02:00:03.162995+0000","last_undegraded":"2023-08-31T02:00:03.162995+0000","last_fullsized":"2023-08-31T02:00:03.162995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:19:36.193451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169329+0000","last_change":"2023-08-31T01:59:59.131747+0000","last_active":"2023-08-31T02:00:03.169329+0000","last_peered":"2023-08-31T02:00:03.169329+0000","last_clean":"2023-08-31T02:00:03.169329+0000","last_became_active":"2023-08-31T01:59:59.131269+0000","last_became_peered":"2023-08-31T01:59:59.131269+0000","last_unstale":"2023-08-31T02:00:03.169329+0000","last_undegraded":"2023-08-31T02:00:03.169329+0000","last_fullsized":"2023-08-31T02:00:03.169329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164576+0000","last_change":"2023-08-31T02:00:03.191728+0000","last_active":"2023-08-31T02:00:04.164576+0000","last_peered":"2023-08-31T02:00:04.164576+0000","last_clean":"2023-08-31T02:00:04.164576+0000","last_became_active":"2023-08-31T02:00:03.191327+0000","last_became_peered":"2023-08-31T02:00:03.191327+0000","last_unstale":"2023-08-31T02:00:04.164576+0000","last_undegraded":"2023-08-31T02:00:04.164576+0000","last_fullsized":"2023-08-31T02:00:04.164576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183416+0000","last_change":"2023-08-31T01:59:58.138090+0000","last_active":"2023-08-31T02:00:03.183416+0000","last_peered":"2023-08-31T02:00:03.183416+0000","last_clean":"2023-08-31T02:00:03.183416+0000","last_became_active":"2023-08-31T01:59:58.137733+0000","last_became_peered":"2023-08-31T01:59:58.137733+0000","last_unstale":"2023-08-31T02:00:03.183416+0000","last_undegraded":"2023-08-31T02:00:03.183416+0000","last_fullsized":"2023-08-31T02:00:03.183416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167635+0000","last_change":"2023-08-31T01:59:59.139493+0000","last_active":"2023-08-31T02:00:03.167635+0000","last_peered":"2023-08-31T02:00:03.167635+0000","last_clean":"2023-08-31T02:00:03.167635+0000","last_became_active":"2023-08-31T01:59:59.139019+0000","last_became_peered":"2023-08-31T01:59:59.139019+0000","last_unstale":"2023-08-31T02:00:03.167635+0000","last_undegraded":"2023-08-31T02:00:03.167635+0000","last_fullsized":"2023-08-31T02:00:03.167635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:50:02.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241935+0000","last_change":"2023-08-31T02:00:03.184119+0000","last_active":"2023-08-31T02:00:04.241935+0000","last_peered":"2023-08-31T02:00:04.241935+0000","last_clean":"2023-08-31T02:00:04.241935+0000","last_became_active":"2023-08-31T02:00:03.183557+0000","last_became_peered":"2023-08-31T02:00:03.183557+0000","last_unstale":"2023-08-31T02:00:04.241935+0000","last_undegraded":"2023-08-31T02:00:04.241935+0000","last_fullsized":"2023-08-31T02:00:04.241935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:08.828471+0000","last_change":"2023-08-31T01:59:58.138549+0000","last_active":"2023-08-31T02:00:08.828471+0000","last_peered":"2023-08-31T02:00:08.828471+0000","last_clean":"2023-08-31T02:00:08.828471+0000","last_became_active":"2023-08-31T01:59:58.138254+0000","last_became_peered":"2023-08-31T01:59:58.138254+0000","last_unstale":"2023-08-31T02:00:08.828471+0000","last_undegraded":"2023-08-31T02:00:08.828471+0000","last_fullsized":"2023-08-31T02:00:08.828471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180911+0000","last_change":"2023-08-31T01:59:59.147840+0000","last_active":"2023-08-31T02:00:03.180911+0000","last_peered":"2023-08-31T02:00:03.180911+0000","last_clean":"2023-08-31T02:00:03.180911+0000","last_became_active":"2023-08-31T01:59:59.144815+0000","last_became_peered":"2023-08-31T01:59:59.144815+0000","last_unstale":"2023-08-31T02:00:03.180911+0000","last_undegraded":"2023-08-31T02:00:03.180911+0000","last_fullsized":"2023-08-31T02:00:03.180911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:36:25.930421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.165604+0000","last_change":"2023-08-31T02:00:03.184326+0000","last_active":"2023-08-31T02:00:04.165604+0000","last_peered":"2023-08-31T02:00:04.165604+0000","last_clean":"2023-08-31T02:00:04.165604+0000","last_became_active":"2023-08-31T02:00:03.183699+0000","last_became_peered":"2023-08-31T02:00:03.183699+0000","last_unstale":"2023-08-31T02:00:04.165604+0000","last_undegraded":"2023-08-31T02:00:04.165604+0000","last_fullsized":"2023-08-31T02:00:04.165604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:06:25.721250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169606+0000","last_change":"2023-08-31T01:59:58.135348+0000","last_active":"2023-08-31T02:00:03.169606+0000","last_peered":"2023-08-31T02:00:03.169606+0000","last_clean":"2023-08-31T02:00:03.169606+0000","last_became_active":"2023-08-31T01:59:58.135066+0000","last_became_peered":"2023-08-31T01:59:58.135066+0000","last_unstale":"2023-08-31T02:00:03.169606+0000","last_undegraded":"2023-08-31T02:00:03.169606+0000","last_fullsized":"2023-08-31T02:00:03.169606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:32:56.077806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167015+0000","last_change":"2023-08-31T01:59:59.138162+0000","last_active":"2023-08-31T02:00:03.167015+0000","last_peered":"2023-08-31T02:00:03.167015+0000","last_clean":"2023-08-31T02:00:03.167015+0000","last_became_active":"2023-08-31T01:59:59.137839+0000","last_became_peered":"2023-08-31T01:59:59.137839+0000","last_unstale":"2023-08-31T02:00:03.167015+0000","last_undegraded":"2023-08-31T02:00:03.167015+0000","last_fullsized":"2023-08-31T02:00:03.167015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:47.845392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163987+0000","last_change":"2023-08-31T02:00:03.191406+0000","last_active":"2023-08-31T02:00:04.163987+0000","last_peered":"2023-08-31T02:00:04.163987+0000","last_clean":"2023-08-31T02:00:04.163987+0000","last_became_active":"2023-08-31T02:00:03.188162+0000","last_became_peered":"2023-08-31T02:00:03.188162+0000","last_unstale":"2023-08-31T02:00:04.163987+0000","last_undegraded":"2023-08-31T02:00:04.163987+0000","last_fullsized":"2023-08-31T02:00:04.163987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:47:44.042063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162984+0000","last_change":"2023-08-31T01:59:58.131639+0000","last_active":"2023-08-31T02:00:03.162984+0000","last_peered":"2023-08-31T02:00:03.162984+0000","last_clean":"2023-08-31T02:00:03.162984+0000","last_became_active":"2023-08-31T01:59:58.131381+0000","last_became_peered":"2023-08-31T01:59:58.131381+0000","last_unstale":"2023-08-31T02:00:03.162984+0000","last_undegraded":"2023-08-31T02:00:03.162984+0000","last_fullsized":"2023-08-31T02:00:03.162984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:35.054161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180639+0000","last_change":"2023-08-31T01:59:59.148855+0000","last_active":"2023-08-31T02:00:03.180639+0000","last_peered":"2023-08-31T02:00:03.180639+0000","last_clean":"2023-08-31T02:00:03.180639+0000","last_became_active":"2023-08-31T01:59:59.148596+0000","last_became_peered":"2023-08-31T01:59:59.148596+0000","last_unstale":"2023-08-31T02:00:03.180639+0000","last_undegraded":"2023-08-31T02:00:03.180639+0000","last_fullsized":"2023-08-31T02:00:03.180639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:09:06.788463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163483+0000","last_change":"2023-08-31T02:00:03.188719+0000","last_active":"2023-08-31T02:00:04.163483+0000","last_peered":"2023-08-31T02:00:04.163483+0000","last_clean":"2023-08-31T02:00:04.163483+0000","last_became_active":"2023-08-31T02:00:03.188370+0000","last_became_peered":"2023-08-31T02:00:03.188370+0000","last_unstale":"2023-08-31T02:00:04.163483+0000","last_undegraded":"2023-08-31T02:00:04.163483+0000","last_fullsized":"2023-08-31T02:00:04.163483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:47:24.148482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170323+0000","last_change":"2023-08-31T01:59:58.139072+0000","last_active":"2023-08-31T02:00:03.170323+0000","last_peered":"2023-08-31T02:00:03.170323+0000","last_clean":"2023-08-31T02:00:03.170323+0000","last_became_active":"2023-08-31T01:59:58.138813+0000","last_became_peered":"2023-08-31T01:59:58.138813+0000","last_unstale":"2023-08-31T02:00:03.170323+0000","last_undegraded":"2023-08-31T02:00:03.170323+0000","last_fullsized":"2023-08-31T02:00:03.170323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:54:24.757437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170141+0000","last_change":"2023-08-31T01:59:59.141198+0000","last_active":"2023-08-31T02:00:03.170141+0000","last_peered":"2023-08-31T02:00:03.170141+0000","last_clean":"2023-08-31T02:00:03.170141+0000","last_became_active":"2023-08-31T01:59:59.140699+0000","last_became_peered":"2023-08-31T01:59:59.140699+0000","last_unstale":"2023-08-31T02:00:03.170141+0000","last_undegraded":"2023-08-31T02:00:03.170141+0000","last_fullsized":"2023-08-31T02:00:03.170141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:20:43.299746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242253+0000","last_change":"2023-08-31T02:00:03.179770+0000","last_active":"2023-08-31T02:00:04.242253+0000","last_peered":"2023-08-31T02:00:04.242253+0000","last_clean":"2023-08-31T02:00:04.242253+0000","last_became_active":"2023-08-31T02:00:03.179411+0000","last_became_peered":"2023-08-31T02:00:03.179411+0000","last_unstale":"2023-08-31T02:00:04.242253+0000","last_undegraded":"2023-08-31T02:00:04.242253+0000","last_fullsized":"2023-08-31T02:00:04.242253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171952+0000","last_change":"2023-08-31T01:59:58.137410+0000","last_active":"2023-08-31T02:00:03.171952+0000","last_peered":"2023-08-31T02:00:03.171952+0000","last_clean":"2023-08-31T02:00:03.171952+0000","last_became_active":"2023-08-31T01:59:58.137142+0000","last_became_peered":"2023-08-31T01:59:58.137142+0000","last_unstale":"2023-08-31T02:00:03.171952+0000","last_undegraded":"2023-08-31T02:00:03.171952+0000","last_fullsized":"2023-08-31T02:00:03.171952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:08:55.972594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181767+0000","last_change":"2023-08-31T01:59:59.144857+0000","last_active":"2023-08-31T02:00:03.181767+0000","last_peered":"2023-08-31T02:00:03.181767+0000","last_clean":"2023-08-31T02:00:03.181767+0000","last_became_active":"2023-08-31T01:59:59.144565+0000","last_became_peered":"2023-08-31T01:59:59.144565+0000","last_unstale":"2023-08-31T02:00:03.181767+0000","last_undegraded":"2023-08-31T02:00:03.181767+0000","last_fullsized":"2023-08-31T02:00:03.181767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:20:43.299746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163679+0000","last_change":"2023-08-31T02:00:03.188428+0000","last_active":"2023-08-31T02:00:04.163679+0000","last_peered":"2023-08-31T02:00:04.163679+0000","last_clean":"2023-08-31T02:00:04.163679+0000","last_became_active":"2023-08-31T02:00:03.188066+0000","last_became_peered":"2023-08-31T02:00:03.188066+0000","last_unstale":"2023-08-31T02:00:04.163679+0000","last_undegraded":"2023-08-31T02:00:04.163679+0000","last_fullsized":"2023-08-31T02:00:04.163679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:09:10.825351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167768+0000","last_change":"2023-08-31T01:59:58.135253+0000","last_active":"2023-08-31T02:00:03.167768+0000","last_peered":"2023-08-31T02:00:03.167768+0000","last_clean":"2023-08-31T02:00:03.167768+0000","last_became_active":"2023-08-31T01:59:58.134921+0000","last_became_peered":"2023-08-31T01:59:58.134921+0000","last_unstale":"2023-08-31T02:00:03.167768+0000","last_undegraded":"2023-08-31T02:00:03.167768+0000","last_fullsized":"2023-08-31T02:00:03.167768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180877+0000","last_change":"2023-08-31T01:59:59.145059+0000","last_active":"2023-08-31T02:00:03.180877+0000","last_peered":"2023-08-31T02:00:03.180877+0000","last_clean":"2023-08-31T02:00:03.180877+0000","last_became_active":"2023-08-31T01:59:59.144515+0000","last_became_peered":"2023-08-31T01:59:59.144515+0000","last_unstale":"2023-08-31T02:00:03.180877+0000","last_undegraded":"2023-08-31T02:00:03.180877+0000","last_fullsized":"2023-08-31T02:00:03.180877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:44:59.715888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241799+0000","last_change":"2023-08-31T02:00:03.183733+0000","last_active":"2023-08-31T02:00:04.241799+0000","last_peered":"2023-08-31T02:00:04.241799+0000","last_clean":"2023-08-31T02:00:04.241799+0000","last_became_active":"2023-08-31T02:00:03.182189+0000","last_became_peered":"2023-08-31T02:00:03.182189+0000","last_unstale":"2023-08-31T02:00:04.241799+0000","last_undegraded":"2023-08-31T02:00:04.241799+0000","last_fullsized":"2023-08-31T02:00:04.241799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181991+0000","last_change":"2023-08-31T01:59:58.137521+0000","last_active":"2023-08-31T02:00:03.181991+0000","last_peered":"2023-08-31T02:00:03.181991+0000","last_clean":"2023-08-31T02:00:03.181991+0000","last_became_active":"2023-08-31T01:59:58.137005+0000","last_became_peered":"2023-08-31T01:59:58.137005+0000","last_unstale":"2023-08-31T02:00:03.181991+0000","last_undegraded":"2023-08-31T02:00:03.181991+0000","last_fullsized":"2023-08-31T02:00:03.181991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:46.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163694+0000","last_change":"2023-08-31T01:59:59.146679+0000","last_active":"2023-08-31T02:00:03.163694+0000","last_peered":"2023-08-31T02:00:03.163694+0000","last_clean":"2023-08-31T02:00:03.163694+0000","last_became_active":"2023-08-31T01:59:59.146349+0000","last_became_peered":"2023-08-31T01:59:59.146349+0000","last_unstale":"2023-08-31T02:00:03.163694+0000","last_undegraded":"2023-08-31T02:00:03.163694+0000","last_fullsized":"2023-08-31T02:00:03.163694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:16:30.278083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241357+0000","last_change":"2023-08-31T02:00:03.187301+0000","last_active":"2023-08-31T02:00:04.241357+0000","last_peered":"2023-08-31T02:00:04.241357+0000","last_clean":"2023-08-31T02:00:04.241357+0000","last_became_active":"2023-08-31T02:00:03.186919+0000","last_became_peered":"2023-08-31T02:00:03.186919+0000","last_unstale":"2023-08-31T02:00:04.241357+0000","last_undegraded":"2023-08-31T02:00:04.241357+0000","last_fullsized":"2023-08-31T02:00:04.241357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162774+0000","last_change":"2023-08-31T01:59:58.137889+0000","last_active":"2023-08-31T02:00:03.162774+0000","last_peered":"2023-08-31T02:00:03.162774+0000","last_clean":"2023-08-31T02:00:03.162774+0000","last_became_active":"2023-08-31T01:59:58.137474+0000","last_became_peered":"2023-08-31T01:59:58.137474+0000","last_unstale":"2023-08-31T02:00:03.162774+0000","last_undegraded":"2023-08-31T02:00:03.162774+0000","last_fullsized":"2023-08-31T02:00:03.162774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:58:27.973576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167300+0000","last_change":"2023-08-31T01:59:59.135054+0000","last_active":"2023-08-31T02:00:03.167300+0000","last_peered":"2023-08-31T02:00:03.167300+0000","last_clean":"2023-08-31T02:00:03.167300+0000","last_became_active":"2023-08-31T01:59:59.134692+0000","last_became_peered":"2023-08-31T01:59:59.134692+0000","last_unstale":"2023-08-31T02:00:03.167300+0000","last_undegraded":"2023-08-31T02:00:03.167300+0000","last_fullsized":"2023-08-31T02:00:03.167300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:11.423606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241980+0000","last_change":"2023-08-31T02:00:03.183047+0000","last_active":"2023-08-31T02:00:04.241980+0000","last_peered":"2023-08-31T02:00:04.241980+0000","last_clean":"2023-08-31T02:00:04.241980+0000","last_became_active":"2023-08-31T02:00:03.182647+0000","last_became_peered":"2023-08-31T02:00:03.182647+0000","last_unstale":"2023-08-31T02:00:04.241980+0000","last_undegraded":"2023-08-31T02:00:04.241980+0000","last_fullsized":"2023-08-31T02:00:04.241980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:12:08.637395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182207+0000","last_change":"2023-08-31T01:59:59.127102+0000","last_active":"2023-08-31T02:00:03.182207+0000","last_peered":"2023-08-31T02:00:03.182207+0000","last_clean":"2023-08-31T02:00:03.182207+0000","last_became_active":"2023-08-31T01:59:59.126795+0000","last_became_peered":"2023-08-31T01:59:59.126795+0000","last_unstale":"2023-08-31T02:00:03.182207+0000","last_undegraded":"2023-08-31T02:00:03.182207+0000","last_fullsized":"2023-08-31T02:00:03.182207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:03.652877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.172443+0000","last_change":"2023-08-31T01:59:58.128837+0000","last_active":"2023-08-31T02:00:03.172443+0000","last_peered":"2023-08-31T02:00:03.172443+0000","last_clean":"2023-08-31T02:00:03.172443+0000","last_became_active":"2023-08-31T01:59:58.128553+0000","last_became_peered":"2023-08-31T01:59:58.128553+0000","last_unstale":"2023-08-31T02:00:03.172443+0000","last_undegraded":"2023-08-31T02:00:03.172443+0000","last_fullsized":"2023-08-31T02:00:03.172443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:40:45.576262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242548+0000","last_change":"2023-08-31T02:00:03.183013+0000","last_active":"2023-08-31T02:00:04.242548+0000","last_peered":"2023-08-31T02:00:04.242548+0000","last_clean":"2023-08-31T02:00:04.242548+0000","last_became_active":"2023-08-31T02:00:03.182620+0000","last_became_peered":"2023-08-31T02:00:03.182620+0000","last_unstale":"2023-08-31T02:00:04.242548+0000","last_undegraded":"2023-08-31T02:00:04.242548+0000","last_fullsized":"2023-08-31T02:00:04.242548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162206+0000","last_change":"2023-08-31T01:59:59.135012+0000","last_active":"2023-08-31T02:00:03.162206+0000","last_peered":"2023-08-31T02:00:03.162206+0000","last_clean":"2023-08-31T02:00:03.162206+0000","last_became_active":"2023-08-31T01:59:59.134742+0000","last_became_peered":"2023-08-31T01:59:59.134742+0000","last_unstale":"2023-08-31T02:00:03.162206+0000","last_undegraded":"2023-08-31T02:00:03.162206+0000","last_fullsized":"2023-08-31T02:00:03.162206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:09:03.292169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163085+0000","last_change":"2023-08-31T01:59:58.133974+0000","last_active":"2023-08-31T02:00:03.163085+0000","last_peered":"2023-08-31T02:00:03.163085+0000","last_clean":"2023-08-31T02:00:03.163085+0000","last_became_active":"2023-08-31T01:59:58.133700+0000","last_became_peered":"2023-08-31T01:59:58.133700+0000","last_unstale":"2023-08-31T02:00:03.163085+0000","last_undegraded":"2023-08-31T02:00:03.163085+0000","last_fullsized":"2023-08-31T02:00:03.163085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:28:01.725513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180556+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:00:03.180556+0000","last_peered":"2023-08-31T02:00:03.180556+0000","last_clean":"2023-08-31T02:00:03.180556+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:00:03.180556+0000","last_undegraded":"2023-08-31T02:00:03.180556+0000","last_fullsized":"2023-08-31T02:00:03.180556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242374+0000","last_change":"2023-08-31T02:00:03.185255+0000","last_active":"2023-08-31T02:00:04.242374+0000","last_peered":"2023-08-31T02:00:04.242374+0000","last_clean":"2023-08-31T02:00:04.242374+0000","last_became_active":"2023-08-31T02:00:03.184861+0000","last_became_peered":"2023-08-31T02:00:03.184861+0000","last_unstale":"2023-08-31T02:00:04.242374+0000","last_undegraded":"2023-08-31T02:00:04.242374+0000","last_fullsized":"2023-08-31T02:00:04.242374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167610+0000","last_change":"2023-08-31T01:59:59.135368+0000","last_active":"2023-08-31T02:00:03.167610+0000","last_peered":"2023-08-31T02:00:03.167610+0000","last_clean":"2023-08-31T02:00:03.167610+0000","last_became_active":"2023-08-31T01:59:59.135074+0000","last_became_peered":"2023-08-31T01:59:59.135074+0000","last_unstale":"2023-08-31T02:00:03.167610+0000","last_undegraded":"2023-08-31T02:00:03.167610+0000","last_fullsized":"2023-08-31T02:00:03.167610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:41.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180603+0000","last_change":"2023-08-31T01:59:58.141143+0000","last_active":"2023-08-31T02:00:03.180603+0000","last_peered":"2023-08-31T02:00:03.180603+0000","last_clean":"2023-08-31T02:00:03.180603+0000","last_became_active":"2023-08-31T01:59:58.140680+0000","last_became_peered":"2023-08-31T01:59:58.140680+0000","last_unstale":"2023-08-31T02:00:03.180603+0000","last_undegraded":"2023-08-31T02:00:03.180603+0000","last_fullsized":"2023-08-31T02:00:03.180603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241818+0000","last_change":"2023-08-31T02:00:03.187482+0000","last_active":"2023-08-31T02:00:04.241818+0000","last_peered":"2023-08-31T02:00:04.241818+0000","last_clean":"2023-08-31T02:00:04.241818+0000","last_became_active":"2023-08-31T02:00:03.186856+0000","last_became_peered":"2023-08-31T02:00:03.186856+0000","last_unstale":"2023-08-31T02:00:04.241818+0000","last_undegraded":"2023-08-31T02:00:04.241818+0000","last_fullsized":"2023-08-31T02:00:04.241818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180775+0000","last_change":"2023-08-31T01:59:58.143295+0000","last_active":"2023-08-31T02:00:03.180775+0000","last_peered":"2023-08-31T02:00:03.180775+0000","last_clean":"2023-08-31T02:00:03.180775+0000","last_became_active":"2023-08-31T01:59:58.142985+0000","last_became_peered":"2023-08-31T01:59:58.142985+0000","last_unstale":"2023-08-31T02:00:03.180775+0000","last_undegraded":"2023-08-31T02:00:03.180775+0000","last_fullsized":"2023-08-31T02:00:03.180775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182106+0000","last_change":"2023-08-31T01:59:59.127832+0000","last_active":"2023-08-31T02:00:03.182106+0000","last_peered":"2023-08-31T02:00:03.182106+0000","last_clean":"2023-08-31T02:00:03.182106+0000","last_became_active":"2023-08-31T01:59:59.127564+0000","last_became_peered":"2023-08-31T01:59:59.127564+0000","last_unstale":"2023-08-31T02:00:03.182106+0000","last_undegraded":"2023-08-31T02:00:03.182106+0000","last_fullsized":"2023-08-31T02:00:03.182106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.162998+0000","last_change":"2023-08-31T02:00:03.191988+0000","last_active":"2023-08-31T02:00:04.162998+0000","last_peered":"2023-08-31T02:00:04.162998+0000","last_clean":"2023-08-31T02:00:04.162998+0000","last_became_active":"2023-08-31T02:00:03.191349+0000","last_became_peered":"2023-08-31T02:00:03.191349+0000","last_unstale":"2023-08-31T02:00:04.162998+0000","last_undegraded":"2023-08-31T02:00:04.162998+0000","last_fullsized":"2023-08-31T02:00:04.162998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:00:23.252798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183026+0000","last_change":"2023-08-31T01:59:58.138706+0000","last_active":"2023-08-31T02:00:03.183026+0000","last_peered":"2023-08-31T02:00:03.183026+0000","last_clean":"2023-08-31T02:00:03.183026+0000","last_became_active":"2023-08-31T01:59:58.138320+0000","last_became_peered":"2023-08-31T01:59:58.138320+0000","last_unstale":"2023-08-31T02:00:03.183026+0000","last_undegraded":"2023-08-31T02:00:03.183026+0000","last_fullsized":"2023-08-31T02:00:03.183026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:10.392703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164651+0000","last_change":"2023-08-31T01:59:59.144937+0000","last_active":"2023-08-31T02:00:03.164651+0000","last_peered":"2023-08-31T02:00:03.164651+0000","last_clean":"2023-08-31T02:00:03.164651+0000","last_became_active":"2023-08-31T01:59:59.144653+0000","last_became_peered":"2023-08-31T01:59:59.144653+0000","last_unstale":"2023-08-31T02:00:03.164651+0000","last_undegraded":"2023-08-31T02:00:03.164651+0000","last_fullsized":"2023-08-31T02:00:03.164651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:43:55.591253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163711+0000","last_change":"2023-08-31T02:00:03.185348+0000","last_active":"2023-08-31T02:00:04.163711+0000","last_peered":"2023-08-31T02:00:04.163711+0000","last_clean":"2023-08-31T02:00:04.163711+0000","last_became_active":"2023-08-31T02:00:03.184977+0000","last_became_peered":"2023-08-31T02:00:03.184977+0000","last_unstale":"2023-08-31T02:00:04.163711+0000","last_undegraded":"2023-08-31T02:00:04.163711+0000","last_fullsized":"2023-08-31T02:00:04.163711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:36:29.967309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171706+0000","last_change":"2023-08-31T01:59:58.142445+0000","last_active":"2023-08-31T02:00:03.171706+0000","last_peered":"2023-08-31T02:00:03.171706+0000","last_clean":"2023-08-31T02:00:03.171706+0000","last_became_active":"2023-08-31T01:59:58.142166+0000","last_became_peered":"2023-08-31T01:59:58.142166+0000","last_unstale":"2023-08-31T02:00:03.171706+0000","last_undegraded":"2023-08-31T02:00:03.171706+0000","last_fullsized":"2023-08-31T02:00:03.171706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170228+0000","last_change":"2023-08-31T01:59:59.139657+0000","last_active":"2023-08-31T02:00:03.170228+0000","last_peered":"2023-08-31T02:00:03.170228+0000","last_clean":"2023-08-31T02:00:03.170228+0000","last_became_active":"2023-08-31T01:59:59.139380+0000","last_became_peered":"2023-08-31T01:59:59.139380+0000","last_unstale":"2023-08-31T02:00:03.170228+0000","last_undegraded":"2023-08-31T02:00:03.170228+0000","last_fullsized":"2023-08-31T02:00:03.170228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164032+0000","last_change":"2023-08-31T02:00:03.187756+0000","last_active":"2023-08-31T02:00:04.164032+0000","last_peered":"2023-08-31T02:00:04.164032+0000","last_clean":"2023-08-31T02:00:04.164032+0000","last_became_active":"2023-08-31T02:00:03.187322+0000","last_became_peered":"2023-08-31T02:00:03.187322+0000","last_unstale":"2023-08-31T02:00:04.164032+0000","last_undegraded":"2023-08-31T02:00:04.164032+0000","last_fullsized":"2023-08-31T02:00:04.164032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:37:30.912467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180456+0000","last_change":"2023-08-31T01:59:58.143349+0000","last_active":"2023-08-31T02:00:03.180456+0000","last_peered":"2023-08-31T02:00:03.180456+0000","last_clean":"2023-08-31T02:00:03.180456+0000","last_became_active":"2023-08-31T01:59:58.143019+0000","last_became_peered":"2023-08-31T01:59:58.143019+0000","last_unstale":"2023-08-31T02:00:03.180456+0000","last_undegraded":"2023-08-31T02:00:03.180456+0000","last_fullsized":"2023-08-31T02:00:03.180456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:58:23.430586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167307+0000","last_change":"2023-08-31T01:59:59.137822+0000","last_active":"2023-08-31T02:00:03.167307+0000","last_peered":"2023-08-31T02:00:03.167307+0000","last_clean":"2023-08-31T02:00:03.167307+0000","last_became_active":"2023-08-31T01:59:59.137558+0000","last_became_peered":"2023-08-31T01:59:59.137558+0000","last_unstale":"2023-08-31T02:00:03.167307+0000","last_undegraded":"2023-08-31T02:00:03.167307+0000","last_fullsized":"2023-08-31T02:00:03.167307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:32:57.084676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242210+0000","last_change":"2023-08-31T02:00:03.182827+0000","last_active":"2023-08-31T02:00:04.242210+0000","last_peered":"2023-08-31T02:00:04.242210+0000","last_clean":"2023-08-31T02:00:04.242210+0000","last_became_active":"2023-08-31T02:00:03.182438+0000","last_became_peered":"2023-08-31T02:00:03.182438+0000","last_unstale":"2023-08-31T02:00:04.242210+0000","last_undegraded":"2023-08-31T02:00:04.242210+0000","last_fullsized":"2023-08-31T02:00:04.242210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:22:47.889737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182678+0000","last_change":"2023-08-31T01:59:58.142002+0000","last_active":"2023-08-31T02:00:03.182678+0000","last_peered":"2023-08-31T02:00:03.182678+0000","last_clean":"2023-08-31T02:00:03.182678+0000","last_became_active":"2023-08-31T01:59:58.141736+0000","last_became_peered":"2023-08-31T01:59:58.141736+0000","last_unstale":"2023-08-31T02:00:03.182678+0000","last_undegraded":"2023-08-31T02:00:03.182678+0000","last_fullsized":"2023-08-31T02:00:03.182678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:52.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161862+0000","last_change":"2023-08-31T01:59:59.141837+0000","last_active":"2023-08-31T02:00:03.161862+0000","last_peered":"2023-08-31T02:00:03.161862+0000","last_clean":"2023-08-31T02:00:03.161862+0000","last_became_active":"2023-08-31T01:59:59.141556+0000","last_became_peered":"2023-08-31T01:59:59.141556+0000","last_unstale":"2023-08-31T02:00:03.161862+0000","last_undegraded":"2023-08-31T02:00:03.161862+0000","last_fullsized":"2023-08-31T02:00:03.161862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:49:59.637746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164152+0000","last_change":"2023-08-31T02:00:03.189684+0000","last_active":"2023-08-31T02:00:04.164152+0000","last_peered":"2023-08-31T02:00:04.164152+0000","last_clean":"2023-08-31T02:00:04.164152+0000","last_became_active":"2023-08-31T02:00:03.187373+0000","last_became_peered":"2023-08-31T02:00:03.187373+0000","last_unstale":"2023-08-31T02:00:04.164152+0000","last_undegraded":"2023-08-31T02:00:04.164152+0000","last_fullsized":"2023-08-31T02:00:04.164152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:21.879013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182660+0000","last_change":"2023-08-31T01:59:58.136945+0000","last_active":"2023-08-31T02:00:03.182660+0000","last_peered":"2023-08-31T02:00:03.182660+0000","last_clean":"2023-08-31T02:00:03.182660+0000","last_became_active":"2023-08-31T01:59:58.136593+0000","last_became_peered":"2023-08-31T01:59:58.136593+0000","last_unstale":"2023-08-31T02:00:03.182660+0000","last_undegraded":"2023-08-31T02:00:03.182660+0000","last_fullsized":"2023-08-31T02:00:03.182660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:59:35.632366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162451+0000","last_change":"2023-08-31T01:59:59.137446+0000","last_active":"2023-08-31T02:00:03.162451+0000","last_peered":"2023-08-31T02:00:03.162451+0000","last_clean":"2023-08-31T02:00:03.162451+0000","last_became_active":"2023-08-31T01:59:59.137156+0000","last_became_peered":"2023-08-31T01:59:59.137156+0000","last_unstale":"2023-08-31T02:00:03.162451+0000","last_undegraded":"2023-08-31T02:00:03.162451+0000","last_fullsized":"2023-08-31T02:00:03.162451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:58:28.980446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164210+0000","last_change":"2023-08-31T02:00:03.186822+0000","last_active":"2023-08-31T02:00:04.164210+0000","last_peered":"2023-08-31T02:00:04.164210+0000","last_clean":"2023-08-31T02:00:04.164210+0000","last_became_active":"2023-08-31T02:00:03.186360+0000","last_became_peered":"2023-08-31T02:00:03.186360+0000","last_unstale":"2023-08-31T02:00:04.164210+0000","last_undegraded":"2023-08-31T02:00:04.164210+0000","last_fullsized":"2023-08-31T02:00:04.164210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180642+0000","last_change":"2023-08-31T01:59:58.144977+0000","last_active":"2023-08-31T02:00:03.180642+0000","last_peered":"2023-08-31T02:00:03.180642+0000","last_clean":"2023-08-31T02:00:03.180642+0000","last_became_active":"2023-08-31T01:59:58.144682+0000","last_became_peered":"2023-08-31T01:59:58.144682+0000","last_unstale":"2023-08-31T02:00:03.180642+0000","last_undegraded":"2023-08-31T02:00:03.180642+0000","last_fullsized":"2023-08-31T02:00:03.180642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:54:31.237887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170405+0000","last_change":"2023-08-31T01:59:59.145992+0000","last_active":"2023-08-31T02:00:03.170405+0000","last_peered":"2023-08-31T02:00:03.170405+0000","last_clean":"2023-08-31T02:00:03.170405+0000","last_became_active":"2023-08-31T01:59:59.142856+0000","last_became_peered":"2023-08-31T01:59:59.142856+0000","last_unstale":"2023-08-31T02:00:03.170405+0000","last_undegraded":"2023-08-31T02:00:03.170405+0000","last_fullsized":"2023-08-31T02:00:03.170405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241755+0000","last_change":"2023-08-31T02:00:03.189530+0000","last_active":"2023-08-31T02:00:04.241755+0000","last_peered":"2023-08-31T02:00:04.241755+0000","last_clean":"2023-08-31T02:00:04.241755+0000","last_became_active":"2023-08-31T02:00:03.189045+0000","last_became_peered":"2023-08-31T02:00:03.189045+0000","last_unstale":"2023-08-31T02:00:04.241755+0000","last_undegraded":"2023-08-31T02:00:04.241755+0000","last_fullsized":"2023-08-31T02:00:04.241755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.173234+0000","last_change":"2023-08-31T01:59:58.133537+0000","last_active":"2023-08-31T02:00:03.173234+0000","last_peered":"2023-08-31T02:00:03.173234+0000","last_clean":"2023-08-31T02:00:03.173234+0000","last_became_active":"2023-08-31T01:59:58.133222+0000","last_became_peered":"2023-08-31T01:59:58.133222+0000","last_unstale":"2023-08-31T02:00:03.173234+0000","last_undegraded":"2023-08-31T02:00:03.173234+0000","last_fullsized":"2023-08-31T02:00:03.173234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:17.281385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180864+0000","last_change":"2023-08-31T01:59:59.149486+0000","last_active":"2023-08-31T02:00:03.180864+0000","last_peered":"2023-08-31T02:00:03.180864+0000","last_clean":"2023-08-31T02:00:03.180864+0000","last_became_active":"2023-08-31T01:59:59.149195+0000","last_became_peered":"2023-08-31T01:59:59.149195+0000","last_unstale":"2023-08-31T02:00:03.180864+0000","last_undegraded":"2023-08-31T02:00:03.180864+0000","last_fullsized":"2023-08-31T02:00:03.180864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:55:02.768810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241656+0000","last_change":"2023-08-31T02:00:03.194590+0000","last_active":"2023-08-31T02:00:04.241656+0000","last_peered":"2023-08-31T02:00:04.241656+0000","last_clean":"2023-08-31T02:00:04.241656+0000","last_became_active":"2023-08-31T02:00:03.194028+0000","last_became_peered":"2023-08-31T02:00:03.194028+0000","last_unstale":"2023-08-31T02:00:04.241656+0000","last_undegraded":"2023-08-31T02:00:04.241656+0000","last_fullsized":"2023-08-31T02:00:04.241656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:21.879013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183319+0000","last_change":"2023-08-31T01:59:58.140223+0000","last_active":"2023-08-31T02:00:03.183319+0000","last_peered":"2023-08-31T02:00:03.183319+0000","last_clean":"2023-08-31T02:00:03.183319+0000","last_became_active":"2023-08-31T01:59:58.139966+0000","last_became_peered":"2023-08-31T01:59:58.139966+0000","last_unstale":"2023-08-31T02:00:03.183319+0000","last_undegraded":"2023-08-31T02:00:03.183319+0000","last_fullsized":"2023-08-31T02:00:03.183319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162651+0000","last_change":"2023-08-31T01:59:59.139152+0000","last_active":"2023-08-31T02:00:03.162651+0000","last_peered":"2023-08-31T02:00:03.162651+0000","last_clean":"2023-08-31T02:00:03.162651+0000","last_became_active":"2023-08-31T01:59:59.138887+0000","last_became_peered":"2023-08-31T01:59:59.138887+0000","last_unstale":"2023-08-31T02:00:03.162651+0000","last_undegraded":"2023-08-31T02:00:03.162651+0000","last_fullsized":"2023-08-31T02:00:03.162651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:35:52.979172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164612+0000","last_change":"2023-08-31T02:00:03.182923+0000","last_active":"2023-08-31T02:00:04.164612+0000","last_peered":"2023-08-31T02:00:04.164612+0000","last_clean":"2023-08-31T02:00:04.164612+0000","last_became_active":"2023-08-31T02:00:03.182486+0000","last_became_peered":"2023-08-31T02:00:03.182486+0000","last_unstale":"2023-08-31T02:00:04.164612+0000","last_undegraded":"2023-08-31T02:00:04.164612+0000","last_fullsized":"2023-08-31T02:00:04.164612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:45:19.479655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.176209+0000","last_change":"2023-08-31T01:59:58.130739+0000","last_active":"2023-08-31T02:00:03.176209+0000","last_peered":"2023-08-31T02:00:03.176209+0000","last_clean":"2023-08-31T02:00:03.176209+0000","last_became_active":"2023-08-31T01:59:58.130559+0000","last_became_peered":"2023-08-31T01:59:58.130559+0000","last_unstale":"2023-08-31T02:00:03.176209+0000","last_undegraded":"2023-08-31T02:00:03.176209+0000","last_fullsized":"2023-08-31T02:00:03.176209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:52:30.384278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181104+0000","last_change":"2023-08-31T01:59:59.149408+0000","last_active":"2023-08-31T02:00:03.181104+0000","last_peered":"2023-08-31T02:00:03.181104+0000","last_clean":"2023-08-31T02:00:03.181104+0000","last_became_active":"2023-08-31T01:59:59.149129+0000","last_became_peered":"2023-08-31T01:59:59.149129+0000","last_unstale":"2023-08-31T02:00:03.181104+0000","last_undegraded":"2023-08-31T02:00:03.181104+0000","last_fullsized":"2023-08-31T02:00:03.181104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:03.255566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171183+0000","last_change":"2023-08-31T01:59:59.141296+0000","last_active":"2023-08-31T02:00:03.171183+0000","last_peered":"2023-08-31T02:00:03.171183+0000","last_clean":"2023-08-31T02:00:03.171183+0000","last_became_active":"2023-08-31T01:59:59.141010+0000","last_became_peered":"2023-08-31T01:59:59.141010+0000","last_unstale":"2023-08-31T02:00:03.171183+0000","last_undegraded":"2023-08-31T02:00:03.171183+0000","last_fullsized":"2023-08-31T02:00:03.171183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.172411+0000","last_change":"2023-08-31T01:59:59.129754+0000","last_active":"2023-08-31T02:00:03.172411+0000","last_peered":"2023-08-31T02:00:03.172411+0000","last_clean":"2023-08-31T02:00:03.172411+0000","last_became_active":"2023-08-31T01:59:59.127954+0000","last_became_peered":"2023-08-31T01:59:59.127954+0000","last_unstale":"2023-08-31T02:00:03.172411+0000","last_undegraded":"2023-08-31T02:00:03.172411+0000","last_fullsized":"2023-08-31T02:00:03.172411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:19.243425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162957+0000","last_change":"2023-08-31T01:59:59.139684+0000","last_active":"2023-08-31T02:00:03.162957+0000","last_peered":"2023-08-31T02:00:03.162957+0000","last_clean":"2023-08-31T02:00:03.162957+0000","last_became_active":"2023-08-31T01:59:59.139233+0000","last_became_peered":"2023-08-31T01:59:59.139233+0000","last_unstale":"2023-08-31T02:00:03.162957+0000","last_undegraded":"2023-08-31T02:00:03.162957+0000","last_fullsized":"2023-08-31T02:00:03.162957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:50:06.678223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169434+0000","last_change":"2023-08-31T01:59:59.139203+0000","last_active":"2023-08-31T02:00:03.169434+0000","last_peered":"2023-08-31T02:00:03.169434+0000","last_clean":"2023-08-31T02:00:03.169434+0000","last_became_active":"2023-08-31T01:59:59.138931+0000","last_became_peered":"2023-08-31T01:59:59.138931+0000","last_unstale":"2023-08-31T02:00:03.169434+0000","last_undegraded":"2023-08-31T02:00:03.169434+0000","last_fullsized":"2023-08-31T02:00:03.169434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162361+0000","last_change":"2023-08-31T01:59:59.147334+0000","last_active":"2023-08-31T02:00:03.162361+0000","last_peered":"2023-08-31T02:00:03.162361+0000","last_clean":"2023-08-31T02:00:03.162361+0000","last_became_active":"2023-08-31T01:59:59.146910+0000","last_became_peered":"2023-08-31T01:59:59.146910+0000","last_unstale":"2023-08-31T02:00:03.162361+0000","last_undegraded":"2023-08-31T02:00:03.162361+0000","last_fullsized":"2023-08-31T02:00:03.162361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:56:16.408773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183223+0000","last_change":"2023-08-31T01:59:59.139784+0000","last_active":"2023-08-31T02:00:03.183223+0000","last_peered":"2023-08-31T02:00:03.183223+0000","last_clean":"2023-08-31T02:00:03.183223+0000","last_became_active":"2023-08-31T01:59:59.139504+0000","last_became_peered":"2023-08-31T01:59:59.139504+0000","last_unstale":"2023-08-31T02:00:03.183223+0000","last_undegraded":"2023-08-31T02:00:03.183223+0000","last_fullsized":"2023-08-31T02:00:03.183223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:24:58.176806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171308+0000","last_change":"2023-08-31T01:59:59.146628+0000","last_active":"2023-08-31T02:00:03.171308+0000","last_peered":"2023-08-31T02:00:03.171308+0000","last_clean":"2023-08-31T02:00:03.171308+0000","last_became_active":"2023-08-31T01:59:59.146283+0000","last_became_peered":"2023-08-31T01:59:59.146283+0000","last_unstale":"2023-08-31T02:00:03.171308+0000","last_undegraded":"2023-08-31T02:00:03.171308+0000","last_fullsized":"2023-08-31T02:00:03.171308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164760+0000","last_change":"2023-08-31T01:59:59.142109+0000","last_active":"2023-08-31T02:00:03.164760+0000","last_peered":"2023-08-31T02:00:03.164760+0000","last_clean":"2023-08-31T02:00:03.164760+0000","last_became_active":"2023-08-31T01:59:59.141757+0000","last_became_peered":"2023-08-31T01:59:59.141757+0000","last_unstale":"2023-08-31T02:00:03.164760+0000","last_undegraded":"2023-08-31T02:00:03.164760+0000","last_fullsized":"2023-08-31T02:00:03.164760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:13:24.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163648+0000","last_change":"2023-08-31T01:59:59.142887+0000","last_active":"2023-08-31T02:00:03.163648+0000","last_peered":"2023-08-31T02:00:03.163648+0000","last_clean":"2023-08-31T02:00:03.163648+0000","last_became_active":"2023-08-31T01:59:59.142576+0000","last_became_peered":"2023-08-31T01:59:59.142576+0000","last_unstale":"2023-08-31T02:00:03.163648+0000","last_undegraded":"2023-08-31T02:00:03.163648+0000","last_fullsized":"2023-08-31T02:00:03.163648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:13:24.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162037+0000","last_change":"2023-08-31T01:59:59.144355+0000","last_active":"2023-08-31T02:00:03.162037+0000","last_peered":"2023-08-31T02:00:03.162037+0000","last_clean":"2023-08-31T02:00:03.162037+0000","last_became_active":"2023-08-31T01:59:59.144045+0000","last_became_peered":"2023-08-31T01:59:59.144045+0000","last_unstale":"2023-08-31T02:00:03.162037+0000","last_undegraded":"2023-08-31T02:00:03.162037+0000","last_fullsized":"2023-08-31T02:00:03.162037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:36:58.237436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163460+0000","last_change":"2023-08-31T01:59:59.139501+0000","last_active":"2023-08-31T02:00:03.163460+0000","last_peered":"2023-08-31T02:00:03.163460+0000","last_clean":"2023-08-31T02:00:03.163460+0000","last_became_active":"2023-08-31T01:59:59.138918+0000","last_became_peered":"2023-08-31T01:59:59.138918+0000","last_unstale":"2023-08-31T02:00:03.163460+0000","last_undegraded":"2023-08-31T02:00:03.163460+0000","last_fullsized":"2023-08-31T02:00:03.163460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:43:55.591253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169517+0000","last_change":"2023-08-31T01:59:59.143302+0000","last_active":"2023-08-31T02:00:03.169517+0000","last_peered":"2023-08-31T02:00:03.169517+0000","last_clean":"2023-08-31T02:00:03.169517+0000","last_became_active":"2023-08-31T01:59:59.142853+0000","last_became_peered":"2023-08-31T01:59:59.142853+0000","last_unstale":"2023-08-31T02:00:03.169517+0000","last_undegraded":"2023-08-31T02:00:03.169517+0000","last_fullsized":"2023-08-31T02:00:03.169517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:54:32.244757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170712+0000","last_change":"2023-08-31T01:59:59.144185+0000","last_active":"2023-08-31T02:00:03.170712+0000","last_peered":"2023-08-31T02:00:03.170712+0000","last_clean":"2023-08-31T02:00:03.170712+0000","last_became_active":"2023-08-31T01:59:59.143219+0000","last_became_peered":"2023-08-31T01:59:59.143219+0000","last_unstale":"2023-08-31T02:00:03.170712+0000","last_undegraded":"2023-08-31T02:00:03.170712+0000","last_fullsized":"2023-08-31T02:00:03.170712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":107610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":698400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":698456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":107576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:00:17.667 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T02:00:17.668 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-08-31T02:00:17.668 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-31T02:00:17.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.829+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3540211069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00acaf0 msgr2=0x7fa2c00b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.829+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3540211069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00acaf0 0x7fa2c00b1470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00b07a0 tx=0x7fa2b0009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:17.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.829+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3540211069 shutdown_connections 2023-08-31T02:00:17.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.829+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3540211069 >> v2:172.21.15.170:3300/0 conn(0x7fa2c00cb510 0x7fa2c00cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.829+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3540211069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00acaf0 0x7fa2c00b1470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.829+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3540211069 >> 172.21.15.84:0/3540211069 conn(0x7fa2c00ca090 msgr2=0x7fa2c00ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:17.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.829+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3540211069 shutdown_connections 2023-08-31T02:00:17.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.829+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3540211069 wait complete. 2023-08-31T02:00:17.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.830+0000 7fa2c5fb5700 1 Processor -- start 2023-08-31T02:00:17.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2c5fb5700 1 -- start start 2023-08-31T02:00:17.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2c5fb5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2c00acaf0 0x7fa2c00afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2c5fb5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00cb510 0x7fa2c0147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2c5fb5700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2c015b720 0x7fa2c0159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2c5fb5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00b00e0 con 0x7fa2c00cb510 2023-08-31T02:00:17.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2c5fb5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c0148020 con 0x7fa2c00acaf0 2023-08-31T02:00:17.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2c5fb5700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c015a2c0 con 0x7fa2c015b720 2023-08-31T02:00:17.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2beffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00cb510 0x7fa2c0147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2beffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00cb510 0x7fa2c0147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51350/0 (socket says 172.21.15.84:51350) 2023-08-31T02:00:17.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.831+0000 7fa2beffd700 1 -- 172.21.15.84:0/3356166031 learned_addr learned my addr 172.21.15.84:0/3356166031 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:17.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2bffff700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2c015b720 0x7fa2c0159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2bf7fe700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2c00acaf0 0x7fa2c00afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2beffd700 1 -- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2c015b720 msgr2=0x7fa2c0159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2beffd700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2c015b720 0x7fa2c0159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2beffd700 1 -- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2c00acaf0 msgr2=0x7fa2c00afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:17.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2beffd700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2c00acaf0 0x7fa2c00afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:17.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2beffd700 1 -- 172.21.15.84:0/3356166031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00095f0 con 0x7fa2c00cb510 2023-08-31T02:00:17.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2bf7fe700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2c00acaf0 0x7fa2c00afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:17.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2beffd700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00cb510 0x7fa2c0147ae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00098e0 tx=0x7fa2b000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:17.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2b7fff700 1 -- 172.21.15.84:0/3356166031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b001d070 con 0x7fa2c00cb510 2023-08-31T02:00:17.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2b7fff700 1 -- 172.21.15.84:0/3356166031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa2b0003890 con 0x7fa2c00cb510 2023-08-31T02:00:17.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c00ad2a0 con 0x7fa2c00cb510 2023-08-31T02:00:17.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2b7fff700 1 -- 172.21.15.84:0/3356166031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0003c80 con 0x7fa2c00cb510 2023-08-31T02:00:17.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.832+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c015a7b0 con 0x7fa2c00cb510 2023-08-31T02:00:17.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.833+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c004e7c0 con 0x7fa2c00cb510 2023-08-31T02:00:17.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.833+0000 7fa2b7fff700 1 -- 172.21.15.84:0/3356166031 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa2b000f460 con 0x7fa2c00cb510 2023-08-31T02:00:17.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.834+0000 7fa2b7fff700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:17.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.834+0000 7fa2b7fff700 1 -- 172.21.15.84:0/3356166031 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2b0089f30 con 0x7fa2c00cb510 2023-08-31T02:00:17.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.834+0000 7fa2bf7fe700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.834+0000 7fa2bf7fe700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8000fb0 tx=0x7fa2a8009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:17.838+0000 7fa2b7fff700 1 -- 172.21.15.84:0/3356166031 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa2b00555d0 con 0x7fa2c00cb510 2023-08-31T02:00:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.027+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7fa2c00c8320 con 0x7fa2c00cb510 2023-08-31T02:00:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.028+0000 7fa2b7fff700 1 -- 172.21.15.84:0/3356166031 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v30) v1 ==== 86+0+160 (secure 0 0 0) 0x7fa2b0027070 con 0x7fa2c00cb510 2023-08-31T02:00:18.020 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa2a006a0e0 msgr2=0x7fa2a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8000fb0 tx=0x7fa2a8009040 comp rx=0 tx=0).stop 2023-08-31T02:00:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00cb510 msgr2=0x7fa2c0147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00cb510 0x7fa2c0147ae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00098e0 tx=0x7fa2b000beb0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 shutdown_connections 2023-08-31T02:00:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa2a006a0e0 0x7fa2a006c5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2c015b720 0x7fa2c0159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2c00acaf0 0x7fa2c00afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 --2- 172.21.15.84:0/3356166031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2c00cb510 0x7fa2c0147ae0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 >> 172.21.15.84:0/3356166031 conn(0x7fa2c00ca090 msgr2=0x7fa2c00c0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 shutdown_connections 2023-08-31T02:00:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.030+0000 7fa2c5fb5700 1 -- 172.21.15.84:0/3356166031 wait complete. 2023-08-31T02:00:18.035 INFO:teuthology.orchestra.run.smithi084.stdout:[{"version":30,"timestamp":"2023-08-31T01:59:43.495855+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"5010.418957"}]}] 2023-08-31T02:00:18.035 INFO:tasks.ceph_manager:config epoch is 30 2023-08-31T02:00:18.036 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-31T02:00:18.036 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-31T02:00:18.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-31T02:00:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.167+0000 7fd095cdf700 1 -- 172.21.15.84:0/790742869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd090158220 msgr2=0x7fd0900cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.167+0000 7fd095cdf700 1 --2- 172.21.15.84:0/790742869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd090158220 0x7fd0900cc920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd080005fd0 tx=0x7fd080009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.167+0000 7fd095cdf700 1 -- 172.21.15.84:0/790742869 shutdown_connections 2023-08-31T02:00:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.167+0000 7fd095cdf700 1 --2- 172.21.15.84:0/790742869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd090158220 0x7fd0900cc920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.167+0000 7fd095cdf700 1 --2- 172.21.15.84:0/790742869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0900b0df0 0x7fd0900c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.167+0000 7fd095cdf700 1 -- 172.21.15.84:0/790742869 >> 172.21.15.84:0/790742869 conn(0x7fd0900caa20 msgr2=0x7fd0900cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.167+0000 7fd095cdf700 1 -- 172.21.15.84:0/790742869 shutdown_connections 2023-08-31T02:00:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.167+0000 7fd095cdf700 1 -- 172.21.15.84:0/790742869 wait complete. 2023-08-31T02:00:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.168+0000 7fd095cdf700 1 Processor -- start 2023-08-31T02:00:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.168+0000 7fd095cdf700 1 -- start start 2023-08-31T02:00:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd095cdf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900707c0 0x7fd090152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd095cdf700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0900b0df0 0x7fd09014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd095cdf700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd090158220 0x7fd0900c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd095cdf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090153f90 con 0x7fd0900707c0 2023-08-31T02:00:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd095cdf700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09014eb10 con 0x7fd0900b0df0 2023-08-31T02:00:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd095cdf700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900c2cf0 con 0x7fd090158220 2023-08-31T02:00:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900707c0 0x7fd090152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900707c0 0x7fd090152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51360/0 (socket says 172.21.15.84:51360) 2023-08-31T02:00:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 -- 172.21.15.84:0/1702867146 learned_addr learned my addr 172.21.15.84:0/1702867146 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:18.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08ffff700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd090158220 0x7fd0900c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08effd700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0900b0df0 0x7fd09014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 -- 172.21.15.84:0/1702867146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd090158220 msgr2=0x7fd0900c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd090158220 0x7fd0900c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 -- 172.21.15.84:0/1702867146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0900b0df0 msgr2=0x7fd09014e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0900b0df0 0x7fd09014e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 -- 172.21.15.84:0/1702867146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800095f0 con 0x7fd0900707c0 2023-08-31T02:00:18.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd08f7fe700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900707c0 0x7fd090152a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0800098e0 tx=0x7fd080003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:18.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd077fff700 1 -- 172.21.15.84:0/1702867146 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08001c070 con 0x7fd0900707c0 2023-08-31T02:00:18.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.169+0000 7fd077fff700 1 -- 172.21.15.84:0/1702867146 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd08000b820 con 0x7fd0900707c0 2023-08-31T02:00:18.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.170+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0901536f0 con 0x7fd0900707c0 2023-08-31T02:00:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.170+0000 7fd077fff700 1 -- 172.21.15.84:0/1702867146 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000bbf0 con 0x7fd0900707c0 2023-08-31T02:00:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.170+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd090153cb0 con 0x7fd0900707c0 2023-08-31T02:00:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.170+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09004e7c0 con 0x7fd0900707c0 2023-08-31T02:00:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.171+0000 7fd077fff700 1 -- 172.21.15.84:0/1702867146 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd08000bd50 con 0x7fd0900707c0 2023-08-31T02:00:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.171+0000 7fd077fff700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd07c06a0e0 0x7fd07c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.171+0000 7fd077fff700 1 -- 172.21.15.84:0/1702867146 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd080089dd0 con 0x7fd0900707c0 2023-08-31T02:00:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.171+0000 7fd08effd700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd07c06a0e0 0x7fd07c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.172+0000 7fd08effd700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd07c06a0e0 0x7fd07c06c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd09015a5b0 tx=0x7fd084009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:18.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.176+0000 7fd077fff700 1 -- 172.21.15.84:0/1702867146 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd0800553f0 con 0x7fd0900707c0 2023-08-31T02:00:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.421+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd09006bb50 con 0x7fd0900707c0 2023-08-31T02:00:18.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.423+0000 7fd077fff700 1 -- 172.21.15.84:0/1702867146 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169492 (secure 0 0 0) 0x7fd08008b020 con 0x7fd0900707c0 2023-08-31T02:00:18.417 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd07c06a0e0 msgr2=0x7fd07c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd07c06a0e0 0x7fd07c06c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd09015a5b0 tx=0x7fd084009260 comp rx=0 tx=0).stop 2023-08-31T02:00:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900707c0 msgr2=0x7fd090152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900707c0 0x7fd090152a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0800098e0 tx=0x7fd080003d50 comp rx=0 tx=0).stop 2023-08-31T02:00:18.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 shutdown_connections 2023-08-31T02:00:18.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd07c06a0e0 0x7fd07c06c5a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd090158220 0x7fd0900c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900707c0 0x7fd090152a10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 --2- 172.21.15.84:0/1702867146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0900b0df0 0x7fd09014e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 >> 172.21.15.84:0/1702867146 conn(0x7fd0900caa20 msgr2=0x7fd0900b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:18.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 shutdown_connections 2023-08-31T02:00:18.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.426+0000 7fd095cdf700 1 -- 172.21.15.84:0/1702867146 wait complete. 2023-08-31T02:00:18.430 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"active_gid":4194,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3916096091},{"type":"v1","addr":"172.21.15.84:6833","nonce":3916096091}]},"active_addr":"172.21.15.84:6833/3916096091","active_change":"2023-08-31T01:59:39.040999+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4178,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1517110838}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2167351003}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":4150385388}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2620118518}]}]} 2023-08-31T02:00:18.434 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-31T02:00:18.434 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-31T02:00:18.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:18.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.566+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/1731908211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac004850 msgr2=0x7fd7ac004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.566+0000 7fd7ca9f2700 1 --2- 172.21.15.84:0/1731908211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac004850 0x7fd7ac004cd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c310 tx=0x7fd7ac005880 comp rx=0 tx=0).stop 2023-08-31T02:00:18.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.566+0000 7fd7c8f8f700 1 -- 172.21.15.84:0/1731908211 reap_dead start 2023-08-31T02:00:18.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.566+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/1731908211 shutdown_connections 2023-08-31T02:00:18.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.566+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/1731908211 >> 172.21.15.84:0/1731908211 conn(0x7fd7c40caa20 msgr2=0x7fd7c40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:18.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.566+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/1731908211 shutdown_connections 2023-08-31T02:00:18.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.566+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/1731908211 wait complete. 2023-08-31T02:00:18.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.567+0000 7fd7ca9f2700 1 Processor -- start 2023-08-31T02:00:18.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.567+0000 7fd7ca9f2700 1 -- start start 2023-08-31T02:00:18.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7ca9f2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ac004850 0x7fd7c40c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7ca9f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7c41e1930 0x7fd7c41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7ca9f2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7c4143bb0 0x7fd7c40c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7ca9f2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40c42d0 con 0x7fd7c41e1930 2023-08-31T02:00:18.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7ca9f2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41e1ea0 con 0x7fd7ac004850 2023-08-31T02:00:18.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7ca9f2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41e2180 con 0x7fd7c4143bb0 2023-08-31T02:00:18.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7c41e1930 0x7fd7c41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7c41e1930 0x7fd7c41545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51382/0 (socket says 172.21.15.84:51382) 2023-08-31T02:00:18.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 -- 172.21.15.84:0/2210347517 learned_addr learned my addr 172.21.15.84:0/2210347517 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:18.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c8f8f700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7c4143bb0 0x7fd7c40c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c3fff700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ac004850 0x7fd7c40c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 -- 172.21.15.84:0/2210347517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7c4143bb0 msgr2=0x7fd7c40c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7c4143bb0 0x7fd7c40c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 -- 172.21.15.84:0/2210347517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ac004850 msgr2=0x7fd7c40c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ac004850 0x7fd7c40c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 -- 172.21.15.84:0/2210347517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c41e2460 con 0x7fd7c41e1930 2023-08-31T02:00:18.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c37fe700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7c41e1930 0x7fd7c41545a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4006040 tx=0x7fd7b40018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c0ff9700 1 -- 172.21.15.84:0/2210347517 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4001630 con 0x7fd7c41e1930 2023-08-31T02:00:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c0ff9700 1 -- 172.21.15.84:0/2210347517 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd7b400cec0 con 0x7fd7c41e1930 2023-08-31T02:00:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c41e2740 con 0x7fd7c41e1930 2023-08-31T02:00:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7c0ff9700 1 -- 172.21.15.84:0/2210347517 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40038c0 con 0x7fd7c41e1930 2023-08-31T02:00:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.568+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c4154ae0 con 0x7fd7c41e1930 2023-08-31T02:00:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.569+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c41e2d90 con 0x7fd7c41e1930 2023-08-31T02:00:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.570+0000 7fd7c0ff9700 1 -- 172.21.15.84:0/2210347517 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7b4022070 con 0x7fd7c41e1930 2023-08-31T02:00:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.570+0000 7fd7c0ff9700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7b006a0e0 0x7fd7b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.570+0000 7fd7c0ff9700 1 -- 172.21.15.84:0/2210347517 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7b408a5f0 con 0x7fd7c41e1930 2023-08-31T02:00:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.570+0000 7fd7c3fff700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7b006a0e0 0x7fd7b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.571+0000 7fd7c3fff700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7b006a0e0 0x7fd7b006c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8006fd0 tx=0x7fd7b8006bc0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.575+0000 7fd7c0ff9700 1 -- 172.21.15.84:0/2210347517 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd7b4055b70 con 0x7fd7c41e1930 2023-08-31T02:00:18.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.761+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c41586b0 con 0x7fd7c41e1930 2023-08-31T02:00:18.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.763+0000 7fd7c0ff9700 1 -- 172.21.15.84:0/2210347517 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fd7b402de80 con 0x7fd7c41e1930 2023-08-31T02:00:18.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:18.755 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:18.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7b006a0e0 msgr2=0x7fd7b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7b006a0e0 0x7fd7b006c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8006fd0 tx=0x7fd7b8006bc0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7c41e1930 msgr2=0x7fd7c41545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7c41e1930 0x7fd7c41545a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4006040 tx=0x7fd7b40018d0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 shutdown_connections 2023-08-31T02:00:18.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7b006a0e0 0x7fd7b006c5a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7c4143bb0 0x7fd7c40c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ac004850 0x7fd7c40c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 --2- 172.21.15.84:0/2210347517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7c41e1930 0x7fd7c41545a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 >> 172.21.15.84:0/2210347517 conn(0x7fd7c40caa20 msgr2=0x7fd7c4151360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 shutdown_connections 2023-08-31T02:00:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.765+0000 7fd7ca9f2700 1 -- 172.21.15.84:0/2210347517 wait complete. 2023-08-31T02:00:18.769 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-31T02:00:18.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.900+0000 7f526f1d6700 1 -- 172.21.15.84:0/3752189434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5258004850 msgr2=0x7f5258004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.900+0000 7f526f1d6700 1 --2- 172.21.15.84:0/3752189434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5258004850 0x7f5258004cd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f525400c310 tx=0x7f5258005880 comp rx=0 tx=0).stop 2023-08-31T02:00:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.900+0000 7f526f1d6700 1 -- 172.21.15.84:0/3752189434 shutdown_connections 2023-08-31T02:00:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.900+0000 7f526f1d6700 1 --2- 172.21.15.84:0/3752189434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5258004850 0x7f5258004cd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.900+0000 7f526f1d6700 1 -- 172.21.15.84:0/3752189434 >> 172.21.15.84:0/3752189434 conn(0x7f52680caa20 msgr2=0x7f52680cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:18.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.900+0000 7f526f1d6700 1 -- 172.21.15.84:0/3752189434 shutdown_connections 2023-08-31T02:00:18.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.900+0000 7f526f1d6700 1 -- 172.21.15.84:0/3752189434 wait complete. 2023-08-31T02:00:18.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.901+0000 7f526f1d6700 1 Processor -- start 2023-08-31T02:00:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.901+0000 7f526f1d6700 1 -- start start 2023-08-31T02:00:18.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526f1d6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5258004850 0x7f52680c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526f1d6700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52680c8db0 0x7f52680c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526f1d6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52680c4070 0x7f52680ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526f1d6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c3710 con 0x7f52680c4070 2023-08-31T02:00:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526f1d6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c4520 con 0x7f5258004850 2023-08-31T02:00:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526f1d6700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c2b20 con 0x7f52680c8db0 2023-08-31T02:00:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52680c4070 0x7f52680ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52680c4070 0x7f52680ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51404/0 (socket says 172.21.15.84:51404) 2023-08-31T02:00:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 -- 172.21.15.84:0/2559689004 learned_addr learned my addr 172.21.15.84:0/2559689004 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f5267fff700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52680c8db0 0x7f52680c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526cf72700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5258004850 0x7f52680c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 -- 172.21.15.84:0/2559689004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52680c8db0 msgr2=0x7f52680c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52680c8db0 0x7f52680c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 -- 172.21.15.84:0/2559689004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5258004850 msgr2=0x7f52680c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:18.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5258004850 0x7f52680c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 -- 172.21.15.84:0/2559689004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680c2d70 con 0x7f52680c4070 2023-08-31T02:00:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f526d773700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52680c4070 0x7f52680ab2e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5268071c10 tx=0x7f52600018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.902+0000 7f52657fa700 1 -- 172.21.15.84:0/2559689004 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260006950 con 0x7f52680c4070 2023-08-31T02:00:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.903+0000 7f52657fa700 1 -- 172.21.15.84:0/2559689004 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5260011750 con 0x7f52680c4070 2023-08-31T02:00:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.903+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52680c3050 con 0x7f52680c4070 2023-08-31T02:00:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.903+0000 7f52657fa700 1 -- 172.21.15.84:0/2559689004 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260011b60 con 0x7f52680c4070 2023-08-31T02:00:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.903+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5268157e40 con 0x7f52680c4070 2023-08-31T02:00:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.904+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5268157fd0 con 0x7f52680c4070 2023-08-31T02:00:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.904+0000 7f52657fa700 1 -- 172.21.15.84:0/2559689004 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5260011cc0 con 0x7f52680c4070 2023-08-31T02:00:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.904+0000 7f52657fa700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f524c06a0e0 0x7f524c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.904+0000 7f52657fa700 1 -- 172.21.15.84:0/2559689004 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5260089030 con 0x7f52680c4070 2023-08-31T02:00:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.904+0000 7f526cf72700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f524c06a0e0 0x7f524c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.905+0000 7f526cf72700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f524c06a0e0 0x7f524c06c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5268063960 tx=0x7f525c009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:18.909+0000 7f52657fa700 1 -- 172.21.15.84:0/2559689004 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f52600545b0 con 0x7f52680c4070 2023-08-31T02:00:19.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.101+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f526804e7c0 con 0x7f52680c4070 2023-08-31T02:00:19.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.102+0000 7f52657fa700 1 -- 172.21.15.84:0/2559689004 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f5260015020 con 0x7f52680c4070 2023-08-31T02:00:19.097 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:19.097 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:19.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.104+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f524c06a0e0 msgr2=0x7f524c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.104+0000 7f526f1d6700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f524c06a0e0 0x7f524c06c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5268063960 tx=0x7f525c009260 comp rx=0 tx=0).stop 2023-08-31T02:00:19.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.104+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52680c4070 msgr2=0x7f52680ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.104+0000 7f526f1d6700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52680c4070 0x7f52680ab2e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5268071c10 tx=0x7f52600018c0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.105+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 shutdown_connections 2023-08-31T02:00:19.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.105+0000 7f526f1d6700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f524c06a0e0 0x7f524c06c5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.105+0000 7f526f1d6700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52680c4070 0x7f52680ab2e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.105+0000 7f526f1d6700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5258004850 0x7f52680c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.105+0000 7f526f1d6700 1 --2- 172.21.15.84:0/2559689004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52680c8db0 0x7f52680c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.105+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 >> 172.21.15.84:0/2559689004 conn(0x7f52680caa20 msgr2=0x7f52680cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.105+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 shutdown_connections 2023-08-31T02:00:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.105+0000 7f526f1d6700 1 -- 172.21.15.84:0/2559689004 wait complete. 2023-08-31T02:00:19.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-31T02:00:19.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-31T02:00:19.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-31T02:00:19.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-31T02:00:19.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-31T02:00:19.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-31T02:00:19.113 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-31T02:00:19.113 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-31T02:00:19.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.341+0000 7f9efc6ad700 1 -- 172.21.15.84:0/2213372758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ef406d920 msgr2=0x7f9ef413d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.341+0000 7f9efc6ad700 1 --2- 172.21.15.84:0/2213372758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ef406d920 0x7f9ef413d970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005fd0 tx=0x7f9ef0009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.341+0000 7f9efc6ad700 1 -- 172.21.15.84:0/2213372758 shutdown_connections 2023-08-31T02:00:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.341+0000 7f9efc6ad700 1 --2- 172.21.15.84:0/2213372758 >> v2:172.21.15.170:3300/0 conn(0x7f9ef40c7a80 0x7f9ef4162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.341+0000 7f9efc6ad700 1 --2- 172.21.15.84:0/2213372758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ef406d920 0x7f9ef413d970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.341+0000 7f9efc6ad700 1 -- 172.21.15.84:0/2213372758 >> 172.21.15.84:0/2213372758 conn(0x7f9ef40699a0 msgr2=0x7f9ef4069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7fd36d89c700 1 -- 172.21.15.84:0/2219066336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3680b3000 msgr2=0x7fd3680c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7fd36d89c700 1 --2- 172.21.15.84:0/2219066336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3680b3000 0x7fd3680c97a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd358005fd0 tx=0x7fd358009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7fd36d89c700 1 -- 172.21.15.84:0/2219066336 shutdown_connections 2023-08-31T02:00:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7fd36d89c700 1 --2- 172.21.15.84:0/2219066336 >> v2:172.21.15.84:3300/0 conn(0x7fd3680b2c20 0x7fd36815f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7fd36d89c700 1 --2- 172.21.15.84:0/2219066336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3680b3000 0x7fd3680c97a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7fd36d89c700 1 -- 172.21.15.84:0/2219066336 >> 172.21.15.84:0/2219066336 conn(0x7fd3680ca090 msgr2=0x7fd3680ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7fd36d89c700 1 -- 172.21.15.84:0/2219066336 shutdown_connections 2023-08-31T02:00:19.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7f9efc6ad700 1 -- 172.21.15.84:0/2213372758 shutdown_connections 2023-08-31T02:00:19.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7f9efc6ad700 1 -- 172.21.15.84:0/2213372758 wait complete. 2023-08-31T02:00:19.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7efbf6430700 1 -- 172.21.15.84:0/2075772545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbf00b0ea0 msgr2=0x7efbf00af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7efbf6430700 1 --2- 172.21.15.84:0/2075772545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbf00b0ea0 0x7efbf00af760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efbe00098b0 tx=0x7efbe0009bc0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7efbf6430700 1 -- 172.21.15.84:0/2075772545 shutdown_connections 2023-08-31T02:00:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7efbf6430700 1 --2- 172.21.15.84:0/2075772545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbf00b0ea0 0x7efbf00af760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.342+0000 7efbf6430700 1 -- 172.21.15.84:0/2075772545 >> 172.21.15.84:0/2075772545 conn(0x7efbf0069b80 msgr2=0x7efbf0069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.343+0000 7efbf6430700 1 -- 172.21.15.84:0/2075772545 shutdown_connections 2023-08-31T02:00:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.343+0000 7efbf6430700 1 -- 172.21.15.84:0/2075772545 wait complete. 2023-08-31T02:00:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.343+0000 7f6305d7e700 1 -- 172.21.15.84:0/448804630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62e8004850 msgr2=0x7f62e8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.343+0000 7f6305d7e700 1 --2- 172.21.15.84:0/448804630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62e8004850 0x7f62e8004cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f62f4001830 tx=0x7f62e8005880 comp rx=0 tx=0).stop 2023-08-31T02:00:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.343+0000 7f62fffff700 1 -- 172.21.15.84:0/448804630 reap_dead start 2023-08-31T02:00:19.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.343+0000 7fd36d89c700 1 -- 172.21.15.84:0/2219066336 wait complete. 2023-08-31T02:00:19.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.344+0000 7efbf6430700 1 Processor -- start 2023-08-31T02:00:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.344+0000 7f9efc6ad700 1 Processor -- start 2023-08-31T02:00:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.345+0000 7f9efc6ad700 1 -- start start 2023-08-31T02:00:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.345+0000 7fd36d89c700 1 Processor -- start 2023-08-31T02:00:19.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.345+0000 7fd36d89c700 1 -- start start 2023-08-31T02:00:19.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9efc6ad700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ef406d920 0x7f9ef4159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9efc6ad700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ef40c7a80 0x7f9ef41376a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9efc6ad700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ef40cb810 0x7f9ef4158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9efc6ad700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40afa90 con 0x7f9ef40c7a80 2023-08-31T02:00:19.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9efc6ad700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40afd70 con 0x7f9ef406d920 2023-08-31T02:00:19.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9efc6ad700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40b0050 con 0x7f9ef40cb810 2023-08-31T02:00:19.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9ef9c48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ef40c7a80 0x7f9ef41376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9ef9c48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ef40c7a80 0x7f9ef41376a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51452/0 (socket says 172.21.15.84:51452) 2023-08-31T02:00:19.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9ef9c48700 1 -- 172.21.15.84:0/1240127359 learned_addr learned my addr 172.21.15.84:0/1240127359 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.345+0000 7efbf6430700 1 -- start start 2023-08-31T02:00:19.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbf6430700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf00b00c0 0x7efbf00c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbf6430700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf00b0ea0 0x7efbf00c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbf6430700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbf01591f0 0x7efbf00c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbf6430700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00c50f0 con 0x7efbf01591f0 2023-08-31T02:00:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbf6430700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00c40c0 con 0x7efbf00b0ea0 2023-08-31T02:00:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbf6430700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00c43a0 con 0x7efbf00b00c0 2023-08-31T02:00:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbeffff700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf00b00c0 0x7efbf00c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbeffff700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf00b00c0 0x7efbf00c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:45674/0 (socket says 172.21.15.84:45674) 2023-08-31T02:00:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbeffff700 1 -- 172.21.15.84:0/3363618798 learned_addr learned my addr 172.21.15.84:0/3363618798 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7efbef7fe700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf00b0ea0 0x7efbf00c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7f9efa449700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ef406d920 0x7f9ef4159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7fd36d89c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3680b1e10 0x7fd36806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7fd36d89c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3680b2c20 0x7fd3681414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7fd36d89c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3680b3000 0x7fd368157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7fd36d89c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd368141dc0 con 0x7fd3680b1e10 2023-08-31T02:00:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7fd36d89c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3681420a0 con 0x7fd3680b3000 2023-08-31T02:00:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.346+0000 7fd36d89c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd368142380 con 0x7fd3680b2c20 2023-08-31T02:00:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f6305d7e700 1 -- 172.21.15.84:0/448804630 shutdown_connections 2023-08-31T02:00:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f6305d7e700 1 -- 172.21.15.84:0/448804630 >> 172.21.15.84:0/448804630 conn(0x7f63000aea80 msgr2=0x7f63000aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3677fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3680b3000 0x7fd368157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3677fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3680b3000 0x7fd368157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55112/0 (socket says 172.21.15.84:55112) 2023-08-31T02:00:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3677fe700 1 -- 172.21.15.84:0/2688219888 learned_addr learned my addr 172.21.15.84:0/2688219888 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9efac4a700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ef40cb810 0x7f9ef4158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9efa449700 1 -- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ef40cb810 msgr2=0x7f9ef4158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9efa449700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ef40cb810 0x7f9ef4158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9efa449700 1 -- 172.21.15.84:0/1240127359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ef40c7a80 msgr2=0x7f9ef41376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9efa449700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ef40c7a80 0x7f9ef41376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9efa449700 1 -- 172.21.15.84:0/1240127359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00095f0 con 0x7f9ef406d920 2023-08-31T02:00:19.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7efbeffff700 1 -- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf00b0ea0 msgr2=0x7efbf00c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7efbeffff700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf00b0ea0 0x7efbf00c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7efbeffff700 1 -- 172.21.15.84:0/3363618798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbf01591f0 msgr2=0x7efbf00c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7efbeffff700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbf01591f0 0x7efbf00c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7efbeffff700 1 -- 172.21.15.84:0/3363618798 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe0009510 con 0x7efbf00b00c0 2023-08-31T02:00:19.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd366ffd700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3680b1e10 0x7fd36806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3667fc700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3680b2c20 0x7fd3681414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f6305d7e700 1 -- 172.21.15.84:0/448804630 shutdown_connections 2023-08-31T02:00:19.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7efbeffff700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf00b00c0 0x7efbf00c21f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efbe400c4d0 tx=0x7efbe400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9efa449700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ef406d920 0x7f9ef4159350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0015000 tx=0x7f9ef0005020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3677fe700 1 -- 172.21.15.84:0/2688219888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3680b2c20 msgr2=0x7fd3681414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3677fe700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3680b2c20 0x7fd3681414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3677fe700 1 -- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3680b1e10 msgr2=0x7fd36806d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3677fe700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3680b1e10 0x7fd36806d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3677fe700 1 -- 172.21.15.84:0/2688219888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580095f0 con 0x7fd3680b3000 2023-08-31T02:00:19.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef001d070 con 0x7f9ef406d920 2023-08-31T02:00:19.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7fd3667fc700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3680b2c20 0x7fd3681414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:19.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ef0004260 con 0x7f9ef406d920 2023-08-31T02:00:19.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0003680 con 0x7f9ef406d920 2023-08-31T02:00:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.348+0000 7fd3677fe700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3680b3000 0x7fd368157b40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c780 tx=0x7fd36000ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.348+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360003e10 con 0x7fd3680b3000 2023-08-31T02:00:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.348+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd3600051e0 con 0x7fd3680b3000 2023-08-31T02:00:19.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.348+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3600055f0 con 0x7fd3680b3000 2023-08-31T02:00:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.348+0000 7f5b22446700 1 -- 172.21.15.84:0/990920083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b1c0b3000 msgr2=0x7f5b1c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.348+0000 7f5b22446700 1 --2- 172.21.15.84:0/990920083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b1c0b3000 0x7f5b1c15f060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5b100098c0 tx=0x7f5b10009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.348+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef40b0330 con 0x7f9ef406d920 2023-08-31T02:00:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef40b1af0 con 0x7f9ef406d920 2023-08-31T02:00:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f5b22446700 1 -- 172.21.15.84:0/990920083 shutdown_connections 2023-08-31T02:00:19.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f5b22446700 1 --2- 172.21.15.84:0/990920083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b1c0b3000 0x7f5b1c15f060 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f5b22446700 1 -- 172.21.15.84:0/990920083 >> 172.21.15.84:0/990920083 conn(0x7f5b1c06b510 msgr2=0x7f5b1c0cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f5b22446700 1 -- 172.21.15.84:0/990920083 shutdown_connections 2023-08-31T02:00:19.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f5b22446700 1 -- 172.21.15.84:0/990920083 wait complete. 2023-08-31T02:00:19.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.347+0000 7f6305d7e700 1 -- 172.21.15.84:0/448804630 wait complete. 2023-08-31T02:00:19.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f6305d7e700 1 Processor -- start 2023-08-31T02:00:19.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f6305d7e700 1 -- start start 2023-08-31T02:00:19.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.349+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ef40cbc90 con 0x7f9ef406d920 2023-08-31T02:00:19.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.350+0000 7f6305d7e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62e8004850 0x7f63000afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.350+0000 7f6305d7e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6300201e30 0x7f63001ff900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.350+0000 7f6305d7e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63001ffe40 0x7f6300159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.350+0000 7f6305d7e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000b0520 con 0x7f63001ffe40 2023-08-31T02:00:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.350+0000 7f6305d7e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000b0800 con 0x7f62e8004850 2023-08-31T02:00:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.350+0000 7f6305d7e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63000b0ae0 con 0x7f6300201e30 2023-08-31T02:00:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62e8004850 0x7f63000afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62fffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63001ffe40 0x7f6300159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62e8004850 0x7f63000afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55114/0 (socket says 172.21.15.84:55114) 2023-08-31T02:00:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62fffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63001ffe40 0x7f6300159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51468/0 (socket says 172.21.15.84:51468) 2023-08-31T02:00:19.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 -- 172.21.15.84:0/1116993741 learned_addr learned my addr 172.21.15.84:0/1116993741 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd368142660 con 0x7fd3680b3000 2023-08-31T02:00:19.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36806d560 con 0x7fd3680b3000 2023-08-31T02:00:19.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f5b22446700 1 Processor -- start 2023-08-31T02:00:19.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 -- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6300201e30 msgr2=0x7f63001ff900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:19.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6300201e30 0x7f63001ff900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 -- 172.21.15.84:0/1116993741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63001ffe40 msgr2=0x7f6300159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63001ffe40 0x7f6300159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 -- 172.21.15.84:0/1116993741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000b0dc0 con 0x7f62e8004850 2023-08-31T02:00:19.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62ff7fe700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62e8004850 0x7f63000afeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f62f00016d0 tx=0x7f62f0003960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00119c0 con 0x7f62e8004850 2023-08-31T02:00:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f62f0011b20 con 0x7f62e8004850 2023-08-31T02:00:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63000b10a0 con 0x7f62e8004850 2023-08-31T02:00:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63002029d0 con 0x7f62e8004850 2023-08-31T02:00:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.352+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3681593a0 con 0x7fd3680b3000 2023-08-31T02:00:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.352+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00103c0 con 0x7f62e8004850 2023-08-31T02:00:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.351+0000 7f5b22446700 1 -- start start 2023-08-31T02:00:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.352+0000 7f5b22446700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b1c0b3000 0x7f5b1c0b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.352+0000 7f5b22446700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c0b33e0 0x7f5b1c14d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.352+0000 7f5b22446700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b1c0cbc00 0x7f5b1c1f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.352+0000 7f5b22446700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0b66c0 con 0x7f5b1c0b33e0 2023-08-31T02:00:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.352+0000 7f5b22446700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c14fb60 con 0x7f5b1c0cbc00 2023-08-31T02:00:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.352+0000 7f5b22446700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c150680 con 0x7f5b1c0b3000 2023-08-31T02:00:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7fc2516b6700 1 -- 172.21.15.84:0/1718881629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc24c0c9030 msgr2=0x7fc24c0cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7fc2516b6700 1 --2- 172.21.15.84:0/1718881629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc24c0c9030 0x7fc24c0cb200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0098c0 tx=0x7fc23c009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7f5b1bfff700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b1c0b3000 0x7f5b1c0b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7f5b1bfff700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b1c0b3000 0x7f5b1c0b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:45692/0 (socket says 172.21.15.84:45692) 2023-08-31T02:00:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7f5b1bfff700 1 -- 172.21.15.84:0/538297358 learned_addr learned my addr 172.21.15.84:0/538297358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7f5b209e3700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b1c0cbc00 0x7f5b1c1f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe4005230 con 0x7efbf00b00c0 2023-08-31T02:00:19.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efbe4005480 con 0x7efbf00b00c0 2023-08-31T02:00:19.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe4004990 con 0x7efbf00b00c0 2023-08-31T02:00:19.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7fc2516b6700 1 -- 172.21.15.84:0/1718881629 shutdown_connections 2023-08-31T02:00:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7fc2516b6700 1 --2- 172.21.15.84:0/1718881629 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc24c0c9740 0x7fc24c15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7fc2516b6700 1 --2- 172.21.15.84:0/1718881629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc24c0c9030 0x7fc24c0cb200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7fc2516b6700 1 -- 172.21.15.84:0/1718881629 >> 172.21.15.84:0/1718881629 conn(0x7fc24c0cd630 msgr2=0x7fc24c0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7fc2516b6700 1 -- 172.21.15.84:0/1718881629 shutdown_connections 2023-08-31T02:00:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7fc2516b6700 1 -- 172.21.15.84:0/1718881629 wait complete. 2023-08-31T02:00:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f5b1bfff700 1 -- 172.21.15.84:0/538297358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b1c0cbc00 msgr2=0x7f5b1c1f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f5b1bfff700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b1c0cbc00 0x7f5b1c1f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f5b1bfff700 1 -- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c0b33e0 msgr2=0x7f5b1c14d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f5b1bfff700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c0b33e0 0x7f5b1c14d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f5b1bfff700 1 -- 172.21.15.84:0/538297358 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10009520 con 0x7f5b1c0b3000 2023-08-31T02:00:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf00c6ac0 con 0x7efbf00b00c0 2023-08-31T02:00:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.353+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f62f0010520 con 0x7f62e8004850 2023-08-31T02:00:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f62e7fff700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f62ec06a0e0 0x7f62ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62f0089630 con 0x7f62e8004850 2023-08-31T02:00:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62e0000fc0 con 0x7f62e8004850 2023-08-31T02:00:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf00c6770 con 0x7efbf00b00c0 2023-08-31T02:00:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f62e7fff700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f62ec073620 0x7f62ec075a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 --> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62ec076130 con 0x7f62ec073620 2023-08-31T02:00:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62f0054bb0 con 0x7f62e8004850 2023-08-31T02:00:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd360005750 con 0x7fd3680b3000 2023-08-31T02:00:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f5b1bfff700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b1c0b3000 0x7f5b1c0b5d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0b3bb0 tx=0x7f5b10003da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f62fffff700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f62ec073620 0x7f62ec075a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ef00419e0 con 0x7f9ef406d920 2023-08-31T02:00:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.354+0000 7f9eeaffd700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ed806a180 0x7f9ed806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ef0089ce0 con 0x7f9ef406d920 2023-08-31T02:00:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f9eeaffd700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7f9ed80737c0 0x7f9ed8075c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 --> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ed80762d0 con 0x7f9ed80737c0 2023-08-31T02:00:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ef008a090 con 0x7f9ef406d920 2023-08-31T02:00:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1001c070 con 0x7f5b1c0b3000 2023-08-31T02:00:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b1000f670 con 0x7f5b1c0b3000 2023-08-31T02:00:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c150b10 con 0x7f5b1c0b3000 2023-08-31T02:00:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c150030 con 0x7f5b1c0b3000 2023-08-31T02:00:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7fd34ffff700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd35406a0e0 0x7fd35406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd360087bc0 con 0x7fd3680b3000 2023-08-31T02:00:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7fd34ffff700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7fd3540736a0 0x7fd354075ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 --> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3540761b0 con 0x7fd3540736a0 2023-08-31T02:00:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7fd3667fc700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7fd3540736a0 0x7fd354075ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000fa80 con 0x7f5b1c0b3000 2023-08-31T02:00:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.355+0000 7f62feffd700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f62ec06a0e0 0x7f62ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7f62fffff700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f62ec073620 0x7f62ec075a60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7f9efac4a700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7f9ed80737c0 0x7f9ed8075c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efbf004e7c0 con 0x7efbf00b00c0 2023-08-31T02:00:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7fc2516b6700 1 Processor -- start 2023-08-31T02:00:19.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5afc000fc0 con 0x7f5b1c0b3000 2023-08-31T02:00:19.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7fd366ffd700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd35406a0e0 0x7fd35406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7f62feffd700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f62ec06a0e0 0x7f62ec06c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f630006cec0 tx=0x7f62f40012a0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7f9efac4a700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7f9ed80737c0 0x7f9ed8075c00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fd3667fc700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7fd3540736a0 0x7fd354075ae0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fd366ffd700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd35406a0e0 0x7fd35406c5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009a10 tx=0x7fd35c009190 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.356+0000 7fc2516b6700 1 -- start start 2023-08-31T02:00:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc2516b6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc24c0c9030 0x7fc24c0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc2516b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc24c0c9740 0x7fc24c158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc2516b6700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc24c0cb740 0x7fc24c0abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc2516b6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0c4a70 con 0x7fc24c0c9740 2023-08-31T02:00:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc2516b6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0c4d50 con 0x7fc24c0c9030 2023-08-31T02:00:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc2516b6700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0ab470 con 0x7fc24c0cb740 2023-08-31T02:00:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc24b7fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc24c0cb740 0x7fc24c0abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc24b7fe700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc24c0cb740 0x7fc24c0abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:45710/0 (socket says 172.21.15.84:45710) 2023-08-31T02:00:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7fc24b7fe700 1 -- 172.21.15.84:0/633981565 learned_addr learned my addr 172.21.15.84:0/633981565 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3600530a0 con 0x7fd3680b3000 2023-08-31T02:00:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b1000fbe0 con 0x7f5b1c0b3000 2023-08-31T02:00:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7f5b18ff9700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b0806a160 0x7f5b0806c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b1008a570 con 0x7f5b1c0b3000 2023-08-31T02:00:19.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7f5b18ff9700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f5b080737a0 0x7f5b08075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7f5b1b7fe700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b0806a160 0x7f5b0806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 --> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b080762b0 con 0x7f5b080737a0 2023-08-31T02:00:19.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b1008aa10 con 0x7f5b1c0b3000 2023-08-31T02:00:19.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 <== osd.4 v2:172.21.15.170:6808/1776632925 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f62ec076130 con 0x7f62ec073620 2023-08-31T02:00:19.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efbe4004af0 con 0x7efbf00b00c0 2023-08-31T02:00:19.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7efbecff9700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efbdc06a1b0 0x7efbdc06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efbe4087cd0 con 0x7efbf00b00c0 2023-08-31T02:00:19.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7efbecff9700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7efbdc073770 0x7efbdc075bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.357+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 --> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbdc076280 con 0x7efbdc073770 2023-08-31T02:00:19.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7efbef7fe700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efbdc06a1b0 0x7efbdc06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7efbf49cd700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7efbdc073770 0x7efbdc075bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7fc24b7fe700 1 -- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc24c0c9030 msgr2=0x7fc24c0afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7fc24b7fe700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc24c0c9030 0x7fc24c0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7fc24b7fe700 1 -- 172.21.15.84:0/633981565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc24c0c9740 msgr2=0x7fc24c158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7fc24b7fe700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc24c0c9740 0x7fc24c158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7fc24b7fe700 1 -- 172.21.15.84:0/633981565 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c009520 con 0x7fc24c0cb740 2023-08-31T02:00:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbe4053230 con 0x7efbf00b00c0 2023-08-31T02:00:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 <== osd.0 v2:172.21.15.84:6813/856635215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd3540761b0 con 0x7fd3540736a0 2023-08-31T02:00:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.358+0000 7efbef7fe700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efbdc06a1b0 0x7efbdc06c670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efbf01f8c80 tx=0x7efbe8009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7f5b1b7fe700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b0806a160 0x7f5b0806c620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c156fc0 tx=0x7f5b0c001160 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7fc24b7fe700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc24c0cb740 0x7fc24c0abc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc24400cbc0 tx=0x7fc24400cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 <== osd.5 v2:172.21.15.170:6800/4177484541 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9ed80762d0 con 0x7f9ed80737c0 2023-08-31T02:00:19.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7f5b209e3700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f5b080737a0 0x7f5b08075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7f9ef9c48700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ed806a180 0x7f9ed806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7efbf49cd700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7efbdc073770 0x7efbdc075bb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244003c00 con 0x7fc24c0cb740 2023-08-31T02:00:19.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc244003e70 con 0x7fc24c0cb740 2023-08-31T02:00:19.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24400ab30 con 0x7fc24c0cb740 2023-08-31T02:00:19.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c0ab750 con 0x7fc24c0cb740 2023-08-31T02:00:19.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c159cd0 con 0x7fc24c0cb740 2023-08-31T02:00:19.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.360+0000 7f9ef9c48700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ed806a180 0x7f9ed806c640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4159070 tx=0x7f9eec00b040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.360+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 <== osd.6 v2:172.21.15.170:6824/1742000930 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efbdc076280 con 0x7efbdc073770 2023-08-31T02:00:19.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.359+0000 7f5b209e3700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f5b080737a0 0x7f5b08075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.360+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc24c0c4f70 con 0x7fc24c0cb740 2023-08-31T02:00:19.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.361+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc24400ac90 con 0x7fc24c0cb740 2023-08-31T02:00:19.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.362+0000 7fc2337fe700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc23806a0e0 0x7fc23806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.362+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc244088ff0 con 0x7fc24c0cb740 2023-08-31T02:00:19.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.362+0000 7fc24affd700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc23806a0e0 0x7fc23806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.362+0000 7fc2337fe700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc2380736a0 0x7fc238075ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.362+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 --> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2380761b0 con 0x7fc2380736a0 2023-08-31T02:00:19.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.362+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc24408b6b0 con 0x7fc24c0cb740 2023-08-31T02:00:19.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.362+0000 7fc24affd700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc23806a0e0 0x7fc23806c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc240005950 tx=0x7fc2400058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.363+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 <== osd.2 v2:172.21.15.84:6800/1213248925 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5b080762b0 con 0x7f5b080737a0 2023-08-31T02:00:19.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.366+0000 7fc24a7fc700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc2380736a0 0x7fc238075ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.366+0000 7fc24a7fc700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc2380736a0 0x7fc238075ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.367+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 <== osd.7 v2:172.21.15.170:6816/2208670688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc2380761b0 con 0x7fc2380736a0 2023-08-31T02:00:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.369+0000 7f1bb83de700 1 -- 172.21.15.84:0/1681880038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb00c7370 msgr2=0x7f1bb00c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.369+0000 7f1bb83de700 1 --2- 172.21.15.84:0/1681880038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb00c7370 0x7f1bb00c7820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00098c0 tx=0x7f1ba0009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.374+0000 7f1bb83de700 1 -- 172.21.15.84:0/1681880038 shutdown_connections 2023-08-31T02:00:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.374+0000 7f1bb83de700 1 --2- 172.21.15.84:0/1681880038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bb006c430 0x7f1bb006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.374+0000 7f1bb83de700 1 --2- 172.21.15.84:0/1681880038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb00c7370 0x7f1bb00c7820 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.374+0000 7f1bb83de700 1 -- 172.21.15.84:0/1681880038 >> 172.21.15.84:0/1681880038 conn(0x7f1bb00699a0 msgr2=0x7f1bb0069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.375+0000 7f1bb83de700 1 -- 172.21.15.84:0/1681880038 shutdown_connections 2023-08-31T02:00:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.375+0000 7f1bb83de700 1 -- 172.21.15.84:0/1681880038 wait complete. 2023-08-31T02:00:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.377+0000 7f1bb83de700 1 Processor -- start 2023-08-31T02:00:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.377+0000 7f1bb83de700 1 -- start start 2023-08-31T02:00:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.378+0000 7f1bb83de700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bb006c430 0x7f1bb01f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.378+0000 7f1bb83de700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bb00c7370 0x7f1bb00c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.378+0000 7f1bb83de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb013d970 0x7f1bb00b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.378+0000 7f1bb83de700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00b0840 con 0x7f1bb013d970 2023-08-31T02:00:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.378+0000 7f1bb83de700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb01f68b0 con 0x7f1bb00c7370 2023-08-31T02:00:19.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.378+0000 7f1bb83de700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00afc30 con 0x7f1bb006c430 2023-08-31T02:00:19.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb013d970 0x7f1bb00b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb013d970 0x7f1bb00b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51524/0 (socket says 172.21.15.84:51524) 2023-08-31T02:00:19.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 -- 172.21.15.84:0/1015228909 learned_addr learned my addr 172.21.15.84:0/1015228909 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 -- 172.21.15.84:0/1015228909 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bb006c430 msgr2=0x7f1bb01f6370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:19.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bb006c430 0x7f1bb01f6370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 -- 172.21.15.84:0/1015228909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bb00c7370 msgr2=0x7f1bb00c60f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:19.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bb00c7370 0x7f1bb00c60f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 -- 172.21.15.84:0/1015228909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0009520 con 0x7f1bb013d970 2023-08-31T02:00:19.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.379+0000 7f1bb697b700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb013d970 0x7f1bb00b0cd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800ad20 tx=0x7f1ba800d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.381+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 --> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd368142b80 con 0x7fd3540736a0 2023-08-31T02:00:19.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.381+0000 7fd34ffff700 1 -- 172.21.15.84:0/2688219888 <== osd.0 v2:172.21.15.84:6813/856635215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd368142b80 con 0x7fd3540736a0 2023-08-31T02:00:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.381+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7fd3540736a0 msgr2=0x7fd354075ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.381+0000 7fd36d89c700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7fd3540736a0 0x7fd354075ae0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.382+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd35406a0e0 msgr2=0x7fd35406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.382+0000 7fd36d89c700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd35406a0e0 0x7fd35406c5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009a10 tx=0x7fd35c009190 comp rx=0 tx=0).stop 2023-08-31T02:00:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.382+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3680b3000 msgr2=0x7fd368157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.382+0000 7fd36d89c700 1 --2- 172.21.15.84:0/2688219888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3680b3000 0x7fd368157b40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c780 tx=0x7fd36000ca90 comp rx=0 tx=0).stop 2023-08-31T02:00:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.383+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 --> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efbf00c2730 con 0x7efbdc073770 2023-08-31T02:00:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.383+0000 7f1ba6ffd700 1 -- 172.21.15.84:0/1015228909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba800f040 con 0x7f1bb013d970 2023-08-31T02:00:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.383+0000 7f1ba6ffd700 1 -- 172.21.15.84:0/1015228909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1ba800dc80 con 0x7f1bb013d970 2023-08-31T02:00:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.383+0000 7f1ba6ffd700 1 -- 172.21.15.84:0/1015228909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba800aea0 con 0x7f1bb013d970 2023-08-31T02:00:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.383+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb00aff10 con 0x7f1bb013d970 2023-08-31T02:00:19.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.383+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb00b04d0 con 0x7f1bb013d970 2023-08-31T02:00:19.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.384+0000 7f991ea99700 1 -- 172.21.15.84:0/2781729281 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9918144ae0 msgr2=0x7f991806a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.384+0000 7f991ea99700 1 --2- 172.21.15.84:0/2781729281 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9918144ae0 0x7f991806a9b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f990c0098c0 tx=0x7f990c009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.384+0000 7f991ea99700 1 -- 172.21.15.84:0/2781729281 shutdown_connections 2023-08-31T02:00:19.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.384+0000 7f991ea99700 1 --2- 172.21.15.84:0/2781729281 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9918144ae0 0x7f991806a9b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.384+0000 7f991ea99700 1 --2- 172.21.15.84:0/2781729281 >> v2:172.21.15.170:3300/0 conn(0x7f991815fb00 0x7f991806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.384+0000 7f991ea99700 1 -- 172.21.15.84:0/2781729281 >> 172.21.15.84:0/2781729281 conn(0x7f99180aea80 msgr2=0x7f99180aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.385+0000 7f991ea99700 1 -- 172.21.15.84:0/2781729281 shutdown_connections 2023-08-31T02:00:19.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.385+0000 7f991ea99700 1 -- 172.21.15.84:0/2781729281 wait complete. 2023-08-31T02:00:19.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.385+0000 7f1ba6ffd700 1 -- 172.21.15.84:0/1015228909 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ba801c410 con 0x7f1bb013d970 2023-08-31T02:00:19.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.385+0000 7f1ba6ffd700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1b9406a130 0x7f1b9406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.385+0000 7f1ba6ffd700 1 -- 172.21.15.84:0/1015228909 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ba8088850 con 0x7f1bb013d970 2023-08-31T02:00:19.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.386+0000 7f1bb617a700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1b9406a130 0x7f1b9406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.386+0000 7f991ea99700 1 Processor -- start 2023-08-31T02:00:19.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.386+0000 7f991ea99700 1 -- start start 2023-08-31T02:00:19.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.386+0000 7f1bb617a700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1b9406a130 0x7f1b9406c5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0014e0 tx=0x7f1bac007a60 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 --> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62e0002d40 con 0x7f62ec073620 2023-08-31T02:00:19.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f1bb83de700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7f1b980015e0 0x7f1b98003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 --> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b98006bd0 con 0x7f1b980015e0 2023-08-31T02:00:19.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7efbecff9700 1 -- 172.21.15.84:0/3363618798 <== osd.6 v2:172.21.15.170:6824/1742000930 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efbf00c2730 con 0x7efbdc073770 2023-08-31T02:00:19.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f1bb5979700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7f1b980015e0 0x7f1b98003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f991ea99700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9918144ae0 0x7f991813bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f991ea99700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991815b7f0 0x7f991813ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f991ea99700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f991815fb00 0x7f991813a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f62e7fff700 1 -- 172.21.15.84:0/1116993741 <== osd.4 v2:172.21.15.170:6808/1776632925 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f62e0002d40 con 0x7f62ec073620 2023-08-31T02:00:19.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f991ea99700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991813c170 con 0x7f991815b7f0 2023-08-31T02:00:19.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f991ea99700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99181397c0 con 0x7f991815fb00 2023-08-31T02:00:19.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f991ea99700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991814e990 con 0x7f9918144ae0 2023-08-31T02:00:19.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7fd3677fe700 1 -- 172.21.15.84:0/2688219888 reap_dead start 2023-08-31T02:00:19.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 shutdown_connections 2023-08-31T02:00:19.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 >> 172.21.15.84:0/2688219888 conn(0x7fd3680ca090 msgr2=0x7fd36815e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.387+0000 7f1bb5979700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7f1b980015e0 0x7f1b98003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991815b7f0 0x7f991813ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991815b7f0 0x7f991813ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51530/0 (socket says 172.21.15.84:51530) 2023-08-31T02:00:19.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 -- 172.21.15.84:0/778564087 learned_addr learned my addr 172.21.15.84:0/778564087 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f991c835700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9918144ae0 0x7f991813bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f991d036700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f991815fb00 0x7f991813a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 shutdown_connections 2023-08-31T02:00:19.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7fd36d89c700 1 -- 172.21.15.84:0/2688219888 wait complete. 2023-08-31T02:00:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 -- 172.21.15.84:0/778564087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9918144ae0 msgr2=0x7f991813bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9918144ae0 0x7f991813bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 -- 172.21.15.84:0/778564087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f991815fb00 msgr2=0x7f991813a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f991815fb00 0x7f991813a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 -- 172.21.15.84:0/778564087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c009520 con 0x7f991815b7f0 2023-08-31T02:00:19.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f991d036700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f991815fb00 0x7f991813a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T02:00:19.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f9917fff700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991815b7f0 0x7f991813ca00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f990400e9f0 tx=0x7f990400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f99157fa700 1 -- 172.21.15.84:0/778564087 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990400c9c0 con 0x7f991815b7f0 2023-08-31T02:00:19.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.390+0000 7f1ba6ffd700 1 -- 172.21.15.84:0/1015228909 <== osd.1 v2:172.21.15.84:6808/257300748 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1b98006bd0 con 0x7f1b980015e0 2023-08-31T02:00:19.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f99157fa700 1 -- 172.21.15.84:0/778564087 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f990400cc10 con 0x7f991815b7f0 2023-08-31T02:00:19.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.388+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991814ec70 con 0x7f991815b7f0 2023-08-31T02:00:19.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.389+0000 7f99157fa700 1 -- 172.21.15.84:0/778564087 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904010430 con 0x7f991815b7f0 2023-08-31T02:00:19.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.389+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991814f230 con 0x7f991815b7f0 2023-08-31T02:00:19.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.390+0000 7f99157fa700 1 -- 172.21.15.84:0/778564087 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9904010590 con 0x7f991815b7f0 2023-08-31T02:00:19.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.390+0000 7f99157fa700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f98fc06a0e0 0x7f98fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.391+0000 7f99157fa700 1 -- 172.21.15.84:0/778564087 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9904014070 con 0x7f991815b7f0 2023-08-31T02:00:19.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.391+0000 7f991c835700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f98fc06a0e0 0x7f98fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.391+0000 7f991c835700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f98fc06a0e0 0x7f98fc06c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f990c009810 tx=0x7f990c019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 --> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ef404e7c0 con 0x7f9ed80737c0 2023-08-31T02:00:19.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f62ec073620 msgr2=0x7f62ec075a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f62ec073620 0x7f62ec075a60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f62ec06a0e0 msgr2=0x7f62ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f62ec06a0e0 0x7f62ec06c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f630006cec0 tx=0x7f62f40012a0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62e8004850 msgr2=0x7f63000afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 --2- 172.21.15.84:0/1116993741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62e8004850 0x7f63000afeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f62f00016d0 tx=0x7f62f0003960 comp rx=0 tx=0).stop 2023-08-31T02:00:19.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f62fffff700 1 -- 172.21.15.84:0/1116993741 reap_dead start 2023-08-31T02:00:19.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 shutdown_connections 2023-08-31T02:00:19.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 >> 172.21.15.84:0/1116993741 conn(0x7f63000aea80 msgr2=0x7f630015ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7efbdc073770 msgr2=0x7efbdc075bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf6430700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7efbdc073770 0x7efbdc075bb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 shutdown_connections 2023-08-31T02:00:19.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efbdc06a1b0 msgr2=0x7efbdc06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf6430700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efbdc06a1b0 0x7efbdc06c670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efbf01f8c80 tx=0x7efbe8009040 comp rx=0 tx=0).stop 2023-08-31T02:00:19.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf00b00c0 msgr2=0x7efbf00c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf6430700 1 --2- 172.21.15.84:0/3363618798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf00b00c0 0x7efbf00c21f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efbe400c4d0 tx=0x7efbe400c7e0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf49cd700 1 -- 172.21.15.84:0/3363618798 reap_dead start 2023-08-31T02:00:19.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7f6305d7e700 1 -- 172.21.15.84:0/1116993741 wait complete. 2023-08-31T02:00:19.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 shutdown_connections 2023-08-31T02:00:19.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.392+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 >> 172.21.15.84:0/3363618798 conn(0x7efbf0069b80 msgr2=0x7efbf0159810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.393+0000 7f9eeaffd700 1 -- 172.21.15.84:0/1240127359 <== osd.5 v2:172.21.15.170:6800/4177484541 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9ef404e7c0 con 0x7f9ed80737c0 2023-08-31T02:00:19.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.393+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 shutdown_connections 2023-08-31T02:00:19.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.393+0000 7efbf6430700 1 -- 172.21.15.84:0/3363618798 wait complete. 2023-08-31T02:00:19.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.393+0000 7f991ea99700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f99180c8bd0 0x7f99181f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.393+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 --> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f991806c2d0 con 0x7f99180c8bd0 2023-08-31T02:00:19.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f991d036700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f99180c8bd0 0x7f99181f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7f9ed80737c0 msgr2=0x7f9ed8075c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efc6ad700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7f9ed80737c0 0x7f9ed8075c00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f991d036700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f99180c8bd0 0x7f99181f91d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ed806a180 msgr2=0x7f9ed806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efc6ad700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ed806a180 0x7f9ed806c640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4159070 tx=0x7f9eec00b040 comp rx=0 tx=0).stop 2023-08-31T02:00:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ef406d920 msgr2=0x7f9ef4159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efc6ad700 1 --2- 172.21.15.84:0/1240127359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ef406d920 0x7f9ef4159350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0015000 tx=0x7f9ef0005020 comp rx=0 tx=0).stop 2023-08-31T02:00:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efac4a700 1 -- 172.21.15.84:0/1240127359 reap_dead start 2023-08-31T02:00:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 shutdown_connections 2023-08-31T02:00:19.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.394+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 >> 172.21.15.84:0/1240127359 conn(0x7f9ef40699a0 msgr2=0x7f9ef406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.395+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 shutdown_connections 2023-08-31T02:00:19.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.395+0000 7f9efc6ad700 1 -- 172.21.15.84:0/1240127359 wait complete. 2023-08-31T02:00:19.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.395+0000 7f99157fa700 1 -- 172.21.15.84:0/778564087 <== osd.3 v2:172.21.15.84:6824/266140406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f991806c2d0 con 0x7f99180c8bd0 2023-08-31T02:00:19.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.396+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 --> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5afc002d40 con 0x7f5b080737a0 2023-08-31T02:00:19.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.399+0000 7f5b18ff9700 1 -- 172.21.15.84:0/538297358 <== osd.2 v2:172.21.15.84:6800/1213248925 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5afc002d40 con 0x7f5b080737a0 2023-08-31T02:00:19.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.400+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f5b080737a0 msgr2=0x7f5b08075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.400+0000 7f5b22446700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f5b080737a0 0x7f5b08075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.401+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b0806a160 msgr2=0x7f5b0806c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.401+0000 7f5b22446700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b0806a160 0x7f5b0806c620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c156fc0 tx=0x7f5b0c001160 comp rx=0 tx=0).stop 2023-08-31T02:00:19.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.401+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b1c0b3000 msgr2=0x7f5b1c0b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.401+0000 7f5b22446700 1 --2- 172.21.15.84:0/538297358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b1c0b3000 0x7f5b1c0b5d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0b3bb0 tx=0x7f5b10003da0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.401+0000 7f5b209e3700 1 -- 172.21.15.84:0/538297358 reap_dead start 2023-08-31T02:00:19.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.401+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 --> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc24c0c79f0 con 0x7fc2380736a0 2023-08-31T02:00:19.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.403+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 shutdown_connections 2023-08-31T02:00:19.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.403+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 >> 172.21.15.84:0/538297358 conn(0x7f5b1c06b510 msgr2=0x7f5b1c151e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.405+0000 7fc2337fe700 1 -- 172.21.15.84:0/633981565 <== osd.7 v2:172.21.15.170:6816/2208670688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc24c0c79f0 con 0x7fc2380736a0 2023-08-31T02:00:19.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.407+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 shutdown_connections 2023-08-31T02:00:19.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.407+0000 7f5b22446700 1 -- 172.21.15.84:0/538297358 wait complete. 2023-08-31T02:00:19.459 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-08-31T02:00:19.459 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-08-31T02:00:19.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-31T02:00:19.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-31T02:00:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.413+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc2380736a0 msgr2=0x7fc238075ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.413+0000 7fc2516b6700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc2380736a0 0x7fc238075ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.414+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 --> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9918066270 con 0x7f99180c8bd0 2023-08-31T02:00:19.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.415+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc23806a0e0 msgr2=0x7fc23806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.415+0000 7fc2516b6700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc23806a0e0 0x7fc23806c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc240005950 tx=0x7fc2400058e0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.415+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc24c0cb740 msgr2=0x7fc24c0abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.415+0000 7fc2516b6700 1 --2- 172.21.15.84:0/633981565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc24c0cb740 0x7fc24c0abc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc24400cbc0 tx=0x7fc24400cf80 comp rx=0 tx=0).stop 2023-08-31T02:00:19.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.415+0000 7f99157fa700 1 -- 172.21.15.84:0/778564087 <== osd.3 v2:172.21.15.84:6824/266140406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9918066270 con 0x7f99180c8bd0 2023-08-31T02:00:19.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.416+0000 7fc24b7fe700 1 -- 172.21.15.84:0/633981565 reap_dead start 2023-08-31T02:00:19.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.416+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 shutdown_connections 2023-08-31T02:00:19.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.416+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 >> 172.21.15.84:0/633981565 conn(0x7fc24c0cd630 msgr2=0x7fc24c0c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.416+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 shutdown_connections 2023-08-31T02:00:19.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.416+0000 7fc2516b6700 1 -- 172.21.15.84:0/633981565 wait complete. 2023-08-31T02:00:19.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f99180c8bd0 msgr2=0x7f99181f91d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f99180c8bd0 0x7f99181f91d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f98fc06a0e0 msgr2=0x7f98fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f98fc06a0e0 0x7f98fc06c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f990c009810 tx=0x7f990c019040 comp rx=0 tx=0).stop 2023-08-31T02:00:19.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991815b7f0 msgr2=0x7f991813ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 --2- 172.21.15.84:0/778564087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f991815b7f0 0x7f991813ca00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f990400e9f0 tx=0x7f990400ed00 comp rx=0 tx=0).stop 2023-08-31T02:00:19.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991d036700 1 -- 172.21.15.84:0/778564087 reap_dead start 2023-08-31T02:00:19.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 shutdown_connections 2023-08-31T02:00:19.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 >> 172.21.15.84:0/778564087 conn(0x7f99180aea80 msgr2=0x7f991815bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.468 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-08-31T02:00:19.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-31T02:00:19.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 shutdown_connections 2023-08-31T02:00:19.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.417+0000 7f991ea99700 1 -- 172.21.15.84:0/778564087 wait complete. 2023-08-31T02:00:19.471 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-08-31T02:00:19.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-31T02:00:19.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.419+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 --> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b98005c50 con 0x7f1b980015e0 2023-08-31T02:00:19.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.419+0000 7f1ba6ffd700 1 -- 172.21.15.84:0/1015228909 <== osd.1 v2:172.21.15.84:6808/257300748 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b98005c50 con 0x7f1b980015e0 2023-08-31T02:00:19.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7f1b980015e0 msgr2=0x7f1b98003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7f1b980015e0 0x7f1b98003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1b9406a130 msgr2=0x7f1b9406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1b9406a130 0x7f1b9406c5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0014e0 tx=0x7f1bac007a60 comp rx=0 tx=0).stop 2023-08-31T02:00:19.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb013d970 msgr2=0x7f1bb00b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 --2- 172.21.15.84:0/1015228909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bb013d970 0x7f1bb00b0cd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800ad20 tx=0x7f1ba800d3a0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb697b700 1 -- 172.21.15.84:0/1015228909 reap_dead start 2023-08-31T02:00:19.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 shutdown_connections 2023-08-31T02:00:19.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 >> 172.21.15.84:0/1015228909 conn(0x7f1bb00699a0 msgr2=0x7f1bb006adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 shutdown_connections 2023-08-31T02:00:19.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.420+0000 7f1bb83de700 1 -- 172.21.15.84:0/1015228909 wait complete. 2023-08-31T02:00:19.476 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-08-31T02:00:19.476 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-31T02:00:19.477 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-08-31T02:00:19.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-31T02:00:19.478 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-08-31T02:00:19.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-31T02:00:19.480 INFO:teuthology.orchestra.run.smithi084.stdout:64424509449 2023-08-31T02:00:19.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-31T02:00:19.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.722+0000 7fb69ffbb700 1 -- 172.21.15.84:0/121577607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 msgr2=0x7fb6980c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.722+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/121577607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 0x7fb6980c7ef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb694009970 tx=0x7fb694009c80 comp rx=0 tx=0).stop 2023-08-31T02:00:19.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.723+0000 7fb69ffbb700 1 -- 172.21.15.84:0/121577607 shutdown_connections 2023-08-31T02:00:19.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.723+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/121577607 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6980c8430 0x7fb69815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.723+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/121577607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 0x7fb6980c7ef0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.723+0000 7fb69ffbb700 1 -- 172.21.15.84:0/121577607 >> 172.21.15.84:0/121577607 conn(0x7fb6980aea80 msgr2=0x7fb6980aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.723+0000 7fb69ffbb700 1 -- 172.21.15.84:0/121577607 shutdown_connections 2023-08-31T02:00:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.723+0000 7fb69ffbb700 1 -- 172.21.15.84:0/121577607 wait complete. 2023-08-31T02:00:19.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.724+0000 7fb69ffbb700 1 Processor -- start 2023-08-31T02:00:19.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.725+0000 7fb69ffbb700 1 -- start start 2023-08-31T02:00:19.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69ffbb700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69806ac20 0x7fb69813fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69ffbb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 0x7fb6981ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fed385d8700 1 -- 172.21.15.84:0/1095571369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed300c9030 msgr2=0x7fed3015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fed385d8700 1 --2- 172.21.15.84:0/1095571369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed300c9030 0x7fed3015b4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009990 tx=0x7fed2c009ca0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fed385d8700 1 -- 172.21.15.84:0/1095571369 shutdown_connections 2023-08-31T02:00:19.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fed385d8700 1 --2- 172.21.15.84:0/1095571369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed300c9030 0x7fed3015b4b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fed385d8700 1 -- 172.21.15.84:0/1095571369 >> 172.21.15.84:0/1095571369 conn(0x7fed300cd630 msgr2=0x7fed300cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fed385d8700 1 -- 172.21.15.84:0/1095571369 shutdown_connections 2023-08-31T02:00:19.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fed385d8700 1 -- 172.21.15.84:0/1095571369 wait complete. 2023-08-31T02:00:19.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69ffbb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6980c8430 0x7fb6981595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69ffbb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980b1c90 con 0x7fb69806b000 2023-08-31T02:00:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69ffbb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980b1f70 con 0x7fb6980c8430 2023-08-31T02:00:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69ffbb700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980aee60 con 0x7fb69806ac20 2023-08-31T02:00:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 0x7fb6981ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69dd57700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69806ac20 0x7fb69813fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 0x7fb6981ee5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51564/0 (socket says 172.21.15.84:51564) 2023-08-31T02:00:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69dd57700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69806ac20 0x7fb69813fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:45782/0 (socket says 172.21.15.84:45782) 2023-08-31T02:00:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 -- 172.21.15.84:0/2684377360 learned_addr learned my addr 172.21.15.84:0/2684377360 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69e558700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6980c8430 0x7fb6981595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 -- 172.21.15.84:0/2684377360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69806ac20 msgr2=0x7fb69813fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69806ac20 0x7fb69813fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 -- 172.21.15.84:0/2684377360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6980c8430 msgr2=0x7fb6981595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6980c8430 0x7fb6981595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 -- 172.21.15.84:0/2684377360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb694009580 con 0x7fb69806b000 2023-08-31T02:00:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.726+0000 7fb69d556700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 0x7fb6981ee5c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb6980c71b0 tx=0x7fb69401ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7f9bf0870700 1 -- 172.21.15.84:0/3197100516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bec06b080 msgr2=0x7f9bec157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7f9bf0870700 1 --2- 172.21.15.84:0/3197100516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bec06b080 0x7f9bec157290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9be00098c0 tx=0x7f9be0009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7f9bf0870700 1 -- 172.21.15.84:0/3197100516 shutdown_connections 2023-08-31T02:00:19.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7f9bf0870700 1 --2- 172.21.15.84:0/3197100516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bec06b080 0x7f9bec157290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7f9bf0870700 1 --2- 172.21.15.84:0/3197100516 >> v2:172.21.15.84:3300/0 conn(0x7f9bec067af0 0x7f9bec06df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7f9bf0870700 1 -- 172.21.15.84:0/3197100516 >> 172.21.15.84:0/3197100516 conn(0x7f9bec0cd1c0 msgr2=0x7f9bec0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7f4f3ecab700 1 -- 172.21.15.84:0/2697332690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f380c7370 msgr2=0x7f4f380c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/2697332690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f380c7370 0x7f4f380c7820 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4f380723c0 tx=0x7f4f2c009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.727+0000 7fb68e7fc700 1 -- 172.21.15.84:0/2684377360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694030070 con 0x7fb69806b000 2023-08-31T02:00:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7fb68e7fc700 1 -- 172.21.15.84:0/2684377360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb694005020 con 0x7fb69806b000 2023-08-31T02:00:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7fb68e7fc700 1 -- 172.21.15.84:0/2684377360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694005410 con 0x7fb69806b000 2023-08-31T02:00:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6980af140 con 0x7fb69806b000 2023-08-31T02:00:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6981eeb00 con 0x7fb69806b000 2023-08-31T02:00:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7f4f3ecab700 1 -- 172.21.15.84:0/2697332690 shutdown_connections 2023-08-31T02:00:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/2697332690 >> v2:172.21.15.84:3300/0 conn(0x7f4f3806d920 0x7f4f3806ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/2697332690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f380c7370 0x7f4f380c7820 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7f4f3ecab700 1 -- 172.21.15.84:0/2697332690 >> 172.21.15.84:0/2697332690 conn(0x7f4f380699a0 msgr2=0x7f4f38069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7fed385d8700 1 Processor -- start 2023-08-31T02:00:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7f9bf0870700 1 -- 172.21.15.84:0/3197100516 shutdown_connections 2023-08-31T02:00:19.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7fed385d8700 1 -- start start 2023-08-31T02:00:19.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.729+0000 7fed385d8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed300c9030 0x7fed30154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.729+0000 7fed385d8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed300c9a40 0x7fed3015d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.729+0000 7fed385d8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed3015b9f0 0x7fed3015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.729+0000 7fed385d8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3014c320 con 0x7fed300c9030 2023-08-31T02:00:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.729+0000 7fed385d8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300c3400 con 0x7fed300c9a40 2023-08-31T02:00:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.729+0000 7fed385d8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed300c36e0 con 0x7fed3015b9f0 2023-08-31T02:00:19.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.729+0000 7fed36b75700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed3015b9f0 0x7fed3015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fed36b75700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed3015b9f0 0x7fed3015db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:45792/0 (socket says 172.21.15.84:45792) 2023-08-31T02:00:19.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fed36b75700 1 -- 172.21.15.84:0/3661127662 learned_addr learned my addr 172.21.15.84:0/3661127662 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.728+0000 7f9bf0870700 1 -- 172.21.15.84:0/3197100516 wait complete. 2023-08-31T02:00:19.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7f4f3ecab700 1 -- 172.21.15.84:0/2697332690 shutdown_connections 2023-08-31T02:00:19.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c005320 con 0x7fb69806b000 2023-08-31T02:00:19.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7f9bf0870700 1 Processor -- start 2023-08-31T02:00:19.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7f9bf0870700 1 -- start start 2023-08-31T02:00:19.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fed36b75700 1 -- 172.21.15.84:0/3661127662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed300c9a40 msgr2=0x7fed3015d630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T02:00:19.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fed36b75700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed300c9a40 0x7fed3015d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fed36b75700 1 -- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed300c9030 msgr2=0x7fed30154990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T02:00:19.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fed36b75700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed300c9030 0x7fed30154990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fed36b75700 1 -- 172.21.15.84:0/3661127662 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c0095f0 con 0x7fed3015b9f0 2023-08-31T02:00:19.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.730+0000 7fed36b75700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed3015b9f0 0x7fed3015db70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed2800b990 tx=0x7fed2800bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f4f3ecab700 1 -- 172.21.15.84:0/2697332690 wait complete. 2023-08-31T02:00:19.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7fed26ffd700 1 -- 172.21.15.84:0/3661127662 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800c9d0 con 0x7fed3015b9f0 2023-08-31T02:00:19.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7fed26ffd700 1 -- 172.21.15.84:0/3661127662 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fed2800cc20 con 0x7fed3015b9f0 2023-08-31T02:00:19.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed300c39c0 con 0x7fed3015b9f0 2023-08-31T02:00:19.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed30154ed0 con 0x7fed3015b9f0 2023-08-31T02:00:19.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f8020f77700 1 -- 172.21.15.84:0/368143325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f801c0c7450 msgr2=0x7f801c06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f8020f77700 1 --2- 172.21.15.84:0/368143325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f801c0c7450 0x7f801c06ce40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8010005fd0 tx=0x7f8010009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:19.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f8020f77700 1 -- 172.21.15.84:0/368143325 shutdown_connections 2023-08-31T02:00:19.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f8020f77700 1 --2- 172.21.15.84:0/368143325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f801c0c7450 0x7f801c06ce40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f8020f77700 1 --2- 172.21.15.84:0/368143325 >> v2:172.21.15.170:3300/0 conn(0x7f801c1575a0 0x7f801c06a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f8020f77700 1 -- 172.21.15.84:0/368143325 >> 172.21.15.84:0/368143325 conn(0x7f801c0aea80 msgr2=0x7f801c0aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f8020f77700 1 -- 172.21.15.84:0/368143325 shutdown_connections 2023-08-31T02:00:19.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f8020f77700 1 -- 172.21.15.84:0/368143325 wait complete. 2023-08-31T02:00:19.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7fed26ffd700 1 -- 172.21.15.84:0/3661127662 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28014440 con 0x7fed3015b9f0 2023-08-31T02:00:19.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f9bf0870700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bec067af0 0x7f9bec1f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f9bf0870700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bec06b080 0x7f9bec151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f9bf0870700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bec15afa0 0x7f9bec06da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f9bf0870700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0c4290 con 0x7f9bec15afa0 2023-08-31T02:00:19.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f9bf0870700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec06df40 con 0x7f9bec06b080 2023-08-31T02:00:19.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7f9bf0870700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1ed6f0 con 0x7f9bec067af0 2023-08-31T02:00:19.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7fb68e7fc700 1 -- 172.21.15.84:0/2684377360 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb694005570 con 0x7fb69806b000 2023-08-31T02:00:19.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.731+0000 7fb68e7fc700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb68406a2c0 0x7fb68406c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.732+0000 7fb68e7fc700 1 -- 172.21.15.84:0/2684377360 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb69409a500 con 0x7fb69806b000 2023-08-31T02:00:19.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.732+0000 7fb69dd57700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb68406a2c0 0x7fb68406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f4f3ecab700 1 Processor -- start 2023-08-31T02:00:19.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7fb69dd57700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb68406a2c0 0x7fb68406c780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb698155d00 tx=0x7fb690009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f9be9d9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bec06b080 0x7f9bec151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f9be9d9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bec06b080 0x7f9bec151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55230/0 (socket says 172.21.15.84:55230) 2023-08-31T02:00:19.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f9be9d9b700 1 -- 172.21.15.84:0/4087976666 learned_addr learned my addr 172.21.15.84:0/4087976666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed180052f0 con 0x7fed3015b9f0 2023-08-31T02:00:19.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f9be9d9b700 1 -- 172.21.15.84:0/4087976666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bec067af0 msgr2=0x7f9bec1f1570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:19.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f9be9d9b700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bec067af0 0x7f9bec1f1570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f9be9d9b700 1 -- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bec15afa0 msgr2=0x7f9bec06da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f9be9d9b700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bec15afa0 0x7f9bec06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f9be9d9b700 1 -- 172.21.15.84:0/4087976666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0009520 con 0x7f9bec06b080 2023-08-31T02:00:19.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f8020f77700 1 Processor -- start 2023-08-31T02:00:19.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.733+0000 7f4f3ecab700 1 -- start start 2023-08-31T02:00:19.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3ecab700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3806d920 0x7f4f380afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3ecab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f380c7370 0x7f4f3813bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3ecab700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3813d970 0x7f4f3813c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3ecab700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38154380 con 0x7f4f380c7370 2023-08-31T02:00:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3ecab700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38158750 con 0x7f4f3813d970 2023-08-31T02:00:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3ecab700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38158a10 con 0x7f4f3806d920 2023-08-31T02:00:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3d248700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3813d970 0x7f4f3813c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3d248700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3813d970 0x7f4f3813c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55238/0 (socket says 172.21.15.84:55238) 2023-08-31T02:00:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3d248700 1 -- 172.21.15.84:0/1537965875 learned_addr learned my addr 172.21.15.84:0/1537965875 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f4f3ca47700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3806d920 0x7f4f380afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7fed26ffd700 1 -- 172.21.15.84:0/3661127662 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fed2801d3b0 con 0x7fed3015b9f0 2023-08-31T02:00:19.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7fed26ffd700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed1406a1b0 0x7fed1406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7fed26ffd700 1 -- 172.21.15.84:0/3661127662 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed28088870 con 0x7fed3015b9f0 2023-08-31T02:00:19.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f4f37fff700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f380c7370 0x7f4f3813bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7fed36374700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed1406a1b0 0x7fed1406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f4f3ca47700 1 -- 172.21.15.84:0/1537965875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3813d970 msgr2=0x7f4f3813c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f4f3ca47700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3813d970 0x7f4f3813c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f4f3ca47700 1 -- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f380c7370 msgr2=0x7f4f3813bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f4f3ca47700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f380c7370 0x7f4f3813bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f4f3ca47700 1 -- 172.21.15.84:0/1537965875 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f30009c40 con 0x7f4f3806d920 2023-08-31T02:00:19.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.734+0000 7f8020f77700 1 -- start start 2023-08-31T02:00:19.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8020f77700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f801c0c7450 0x7f801c14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8020f77700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0cae10 0x7f801c149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8020f77700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c1575a0 0x7f801c149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8020f77700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1fa060 con 0x7f801c0cae10 2023-08-31T02:00:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8020f77700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c14de90 con 0x7f801c1575a0 2023-08-31T02:00:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8020f77700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1f9450 con 0x7f801c0c7450 2023-08-31T02:00:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8019d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0cae10 0x7f801c149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8019d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0cae10 0x7f801c149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51600/0 (socket says 172.21.15.84:51600) 2023-08-31T02:00:19.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8019d9b700 1 -- 172.21.15.84:0/2029308719 learned_addr learned my addr 172.21.15.84:0/2029308719 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f801ad9d700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c1575a0 0x7f801c149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f801a59c700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f801c0c7450 0x7f801c14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8019d9b700 1 -- 172.21.15.84:0/2029308719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f801c0c7450 msgr2=0x7f801c14d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8019d9b700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f801c0c7450 0x7f801c14d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7fed36374700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed1406a1b0 0x7fed1406c670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed20009710 tx=0x7fed20006c60 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8019d9b700 1 -- 172.21.15.84:0/2029308719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c1575a0 msgr2=0x7f801c149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.735+0000 7f8019d9b700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c1575a0 0x7f801c149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f8019d9b700 1 -- 172.21.15.84:0/2029308719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100095f0 con 0x7f801c0cae10 2023-08-31T02:00:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f8019d9b700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0cae10 0x7f801c149530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f800c00b470 tx=0x7f800c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f9be9d9b700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bec06b080 0x7f9bec151830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00ea80 tx=0x7f9bdc00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f4f3ca47700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3806d920 0x7f4f380afa90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c3f0 tx=0x7f4f2400c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f9bdaffd700 1 -- 172.21.15.84:0/4087976666 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00cd90 con 0x7f9bec06b080 2023-08-31T02:00:19.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f9bdaffd700 1 -- 172.21.15.84:0/4087976666 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9bdc004830 con 0x7f9bec06b080 2023-08-31T02:00:19.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec1ed9d0 con 0x7f9bec06b080 2023-08-31T02:00:19.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f9bdaffd700 1 -- 172.21.15.84:0/4087976666 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc004c40 con 0x7f9bec06b080 2023-08-31T02:00:19.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.736+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec1edf90 con 0x7f9bec06b080 2023-08-31T02:00:19.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f925e086700 1 -- 172.21.15.84:0/2688548314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f925813d970 msgr2=0x7f92580cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f925e086700 1 --2- 172.21.15.84:0/2688548314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f925813d970 0x7f92580cb810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f925806e3e0 tx=0x7f9248009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f925e086700 1 -- 172.21.15.84:0/2688548314 shutdown_connections 2023-08-31T02:00:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f925e086700 1 --2- 172.21.15.84:0/2688548314 >> v2:172.21.15.84:3300/0 conn(0x7f92580c7a80 0x7f925806c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f925e086700 1 --2- 172.21.15.84:0/2688548314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f925813d970 0x7f92580cb810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f925e086700 1 -- 172.21.15.84:0/2688548314 >> 172.21.15.84:0/2688548314 conn(0x7f92580699a0 msgr2=0x7f9258069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f925e086700 1 -- 172.21.15.84:0/2688548314 shutdown_connections 2023-08-31T02:00:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f925e086700 1 -- 172.21.15.84:0/2688548314 wait complete. 2023-08-31T02:00:19.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.737+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec1ee1b0 con 0x7f9bec06b080 2023-08-31T02:00:19.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.738+0000 7f9bdaffd700 1 -- 172.21.15.84:0/4087976666 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9bdc005020 con 0x7f9bec06b080 2023-08-31T02:00:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.738+0000 7f9bdaffd700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9bcc06a0e0 0x7f9bcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.738+0000 7f9bdaffd700 1 -- 172.21.15.84:0/4087976666 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9bdc088dc0 con 0x7f9bec06b080 2023-08-31T02:00:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.738+0000 7f9bea59c700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9bcc06a0e0 0x7f9bcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.738+0000 7f800affd700 1 -- 172.21.15.84:0/2029308719 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c011830 con 0x7f801c0cae10 2023-08-31T02:00:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c1f9730 con 0x7f801c0cae10 2023-08-31T02:00:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c1f9cf0 con 0x7f801c0cae10 2023-08-31T02:00:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7f800affd700 1 -- 172.21.15.84:0/2029308719 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f800c011a80 con 0x7f801c0cae10 2023-08-31T02:00:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7f800affd700 1 -- 172.21.15.84:0/2029308719 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c011e90 con 0x7f801c0cae10 2023-08-31T02:00:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7fb68e7fc700 1 -- 172.21.15.84:0/2684377360 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb694065a60 con 0x7fb69806b000 2023-08-31T02:00:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7f925e086700 1 Processor -- start 2023-08-31T02:00:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3303297365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b40144ae0 msgr2=0x7f3b4006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3303297365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b40144ae0 0x7f3b4006a9b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c005fd0 tx=0x7f3b3c009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:19.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.739+0000 7f925e086700 1 -- start start 2023-08-31T02:00:19.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.740+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3303297365 shutdown_connections 2023-08-31T02:00:19.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.740+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3303297365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b4015bf00 0x7f3b4006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.740+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3303297365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b40144ae0 0x7f3b4006a9b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.740+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3303297365 >> 172.21.15.84:0/3303297365 conn(0x7f3b400aea80 msgr2=0x7f3b400aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.740+0000 7f9bea59c700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9bcc06a0e0 0x7f9bcc06c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0c9780 tx=0x7f9be00047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.740+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3303297365 shutdown_connections 2023-08-31T02:00:19.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.740+0000 7f925e086700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92580c7a80 0x7f92581543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f925e086700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92580cbd50 0x7f92581514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f925e086700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f925813d970 0x7f92581f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f925e086700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925814e7d0 con 0x7f92580c7a80 2023-08-31T02:00:19.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f925e086700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92581f5a60 con 0x7f92580cbd50 2023-08-31T02:00:19.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f925e086700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9258151f50 con 0x7f925813d970 2023-08-31T02:00:19.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f4f357fa700 1 -- 172.21.15.84:0/1537965875 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24011790 con 0x7f4f3806d920 2023-08-31T02:00:19.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f4f357fa700 1 -- 172.21.15.84:0/1537965875 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4f240119e0 con 0x7f4f3806d920 2023-08-31T02:00:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c009520 con 0x7f4f3806d920 2023-08-31T02:00:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f9257fff700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f925813d970 0x7f92581f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f924effd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92580cbd50 0x7f92581514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f9257fff700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f925813d970 0x7f92581f5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:45830/0 (socket says 172.21.15.84:45830) 2023-08-31T02:00:19.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f924effd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92580cbd50 0x7f92581514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55256/0 (socket says 172.21.15.84:55256) 2023-08-31T02:00:19.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f9257fff700 1 -- 172.21.15.84:0/3801190793 learned_addr learned my addr 172.21.15.84:0/3801190793 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f800affd700 1 -- 172.21.15.84:0/2029308719 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f800c01a410 con 0x7f801c0cae10 2023-08-31T02:00:19.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f92577fe700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92580c7a80 0x7f92581543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f800affd700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ffc06a0e0 0x7f7ffc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f9257fff700 1 -- 172.21.15.84:0/3801190793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92580cbd50 msgr2=0x7f92581514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f9257fff700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92580cbd50 0x7f92581514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f9257fff700 1 -- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92580c7a80 msgr2=0x7f92581543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f9257fff700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92580c7a80 0x7f92581543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f9257fff700 1 -- 172.21.15.84:0/3801190793 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248009520 con 0x7f925813d970 2023-08-31T02:00:19.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7f9257fff700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f925813d970 0x7f92581f5520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f925000e520 tx=0x7f925000e830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f800affd700 1 -- 172.21.15.84:0/2029308719 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f800c088720 con 0x7f801c0cae10 2023-08-31T02:00:19.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3303297365 wait complete. 2023-08-31T02:00:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7f9254ff9700 1 -- 172.21.15.84:0/3801190793 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925000aea0 con 0x7f925813d970 2023-08-31T02:00:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7f9254ff9700 1 -- 172.21.15.84:0/3801190793 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f92500048a0 con 0x7f925813d970 2023-08-31T02:00:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7f9254ff9700 1 -- 172.21.15.84:0/3801190793 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250003b10 con 0x7f925813d970 2023-08-31T02:00:19.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92581549a0 con 0x7f925813d970 2023-08-31T02:00:19.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925814ea40 con 0x7f925813d970 2023-08-31T02:00:19.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f380b0b10 con 0x7f4f3806d920 2023-08-31T02:00:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.741+0000 7f4f357fa700 1 -- 172.21.15.84:0/1537965875 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24011db0 con 0x7f4f3806d920 2023-08-31T02:00:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f180052f0 con 0x7f4f3806d920 2023-08-31T02:00:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.742+0000 7fed26ffd700 1 -- 172.21.15.84:0/3661127662 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fed28053cb0 con 0x7fed3015b9f0 2023-08-31T02:00:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.743+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925804e7c0 con 0x7f925813d970 2023-08-31T02:00:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.743+0000 7f3b47ca6700 1 Processor -- start 2023-08-31T02:00:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.744+0000 7f801a59c700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ffc06a0e0 0x7f7ffc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.744+0000 7f9254ff9700 1 -- 172.21.15.84:0/3801190793 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f92500118b0 con 0x7f925813d970 2023-08-31T02:00:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.744+0000 7f801a59c700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ffc06a0e0 0x7f7ffc06c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f80100098e0 tx=0x7f80100047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.744+0000 7f9254ff9700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f923806a0e0 0x7f923806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.744+0000 7f4f357fa700 1 -- 172.21.15.84:0/1537965875 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f240339e0 con 0x7f4f3806d920 2023-08-31T02:00:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.744+0000 7f4f357fa700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f1c06a1b0 0x7f4f1c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.744+0000 7f4f357fa700 1 -- 172.21.15.84:0/1537965875 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f24088290 con 0x7f4f3806d920 2023-08-31T02:00:19.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f4f37fff700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f1c06a1b0 0x7f4f1c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f9254ff9700 1 -- 172.21.15.84:0/3801190793 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9250089190 con 0x7f925813d970 2023-08-31T02:00:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.744+0000 7f3b47ca6700 1 -- start start 2023-08-31T02:00:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b47ca6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b40144ae0 0x7f3b40139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b47ca6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4015bf00 0x7f3b401e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b47ca6700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b4015fb00 0x7f3b401e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b47ca6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4006f730 con 0x7f3b4015bf00 2023-08-31T02:00:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b47ca6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4013fc30 con 0x7f3b40144ae0 2023-08-31T02:00:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b47ca6700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4013ff10 con 0x7f3b4015fb00 2023-08-31T02:00:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45241700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4015bf00 0x7f3b401e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45241700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4015bf00 0x7f3b401e6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51622/0 (socket says 172.21.15.84:51622) 2023-08-31T02:00:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45241700 1 -- 172.21.15.84:0/3084674577 learned_addr learned my addr 172.21.15.84:0/3084674577 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45a42700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b40144ae0 0x7f3b40139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f4f37fff700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f1c06a1b0 0x7f4f1c06c670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000c00 tx=0x7f4f2c0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45241700 1 -- 172.21.15.84:0/3084674577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b4015fb00 msgr2=0x7f3b401e6550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:19.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45241700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b4015fb00 0x7f3b401e6550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45241700 1 -- 172.21.15.84:0/3084674577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b40144ae0 msgr2=0x7f3b40139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45241700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b40144ae0 0x7f3b40139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45241700 1 -- 172.21.15.84:0/3084674577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0095f0 con 0x7f3b4015bf00 2023-08-31T02:00:19.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.745+0000 7f3b45a42700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b40144ae0 0x7f3b40139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:19.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.746+0000 7f3b45241700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4015bf00 0x7f3b401e6010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000c420 tx=0x7f3b3000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.746+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80000052f0 con 0x7f801c0cae10 2023-08-31T02:00:19.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.746+0000 7f3b367fc700 1 -- 172.21.15.84:0/3084674577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30011790 con 0x7f3b4015bf00 2023-08-31T02:00:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.746+0000 7f3b367fc700 1 -- 172.21.15.84:0/3084674577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3b300119e0 con 0x7f3b4015bf00 2023-08-31T02:00:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.746+0000 7f3b367fc700 1 -- 172.21.15.84:0/3084674577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30011df0 con 0x7f3b4015bf00 2023-08-31T02:00:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.746+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b401401f0 con 0x7f3b4015bf00 2023-08-31T02:00:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.746+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4013ee70 con 0x7f3b4015bf00 2023-08-31T02:00:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.747+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4004e7c0 con 0x7f3b4015bf00 2023-08-31T02:00:19.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.749+0000 7f4f357fa700 1 -- 172.21.15.84:0/1537965875 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4f24053760 con 0x7f4f3806d920 2023-08-31T02:00:19.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.750+0000 7f92577fe700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f923806a0e0 0x7f923806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.750+0000 7f92577fe700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f923806a0e0 0x7f923806c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9248000c00 tx=0x7f9248011040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.753+0000 7f9bdaffd700 1 -- 172.21.15.84:0/4087976666 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9bdc054390 con 0x7f9bec06b080 2023-08-31T02:00:19.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.754+0000 7f9254ff9700 1 -- 172.21.15.84:0/3801190793 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f92500546f0 con 0x7f925813d970 2023-08-31T02:00:19.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.756+0000 7f3b367fc700 1 -- 172.21.15.84:0/3084674577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b30026430 con 0x7f3b4015bf00 2023-08-31T02:00:19.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.756+0000 7f3b367fc700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3b2406a0e0 0x7f3b2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.756+0000 7f3b367fc700 1 -- 172.21.15.84:0/3084674577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b30089110 con 0x7f3b4015bf00 2023-08-31T02:00:19.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.757+0000 7f800affd700 1 -- 172.21.15.84:0/2029308719 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f800c053c00 con 0x7f801c0cae10 2023-08-31T02:00:19.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.762+0000 7f3b45a42700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3b2406a0e0 0x7f3b2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.762+0000 7f3b45a42700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3b2406a0e0 0x7f3b2406c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0098e0 tx=0x7f3b3c0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.764+0000 7f3b367fc700 1 -- 172.21.15.84:0/3084674577 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3b30054770 con 0x7f3b4015bf00 2023-08-31T02:00:19.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.791+0000 7fef905f8700 1 -- 172.21.15.84:0/3123190735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef8806aef0 msgr2=0x7fef8806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.791+0000 7fef905f8700 1 --2- 172.21.15.84:0/3123190735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef8806aef0 0x7fef8806b8b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef80009fd0 tx=0x7fef8000b380 comp rx=0 tx=0).stop 2023-08-31T02:00:19.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.792+0000 7fef905f8700 1 -- 172.21.15.84:0/3123190735 shutdown_connections 2023-08-31T02:00:19.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.792+0000 7fef905f8700 1 --2- 172.21.15.84:0/3123190735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef8806aef0 0x7fef8806b8b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.792+0000 7fef905f8700 1 --2- 172.21.15.84:0/3123190735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef880c9030 0x7fef8806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.792+0000 7fef905f8700 1 -- 172.21.15.84:0/3123190735 >> 172.21.15.84:0/3123190735 conn(0x7fef880aea80 msgr2=0x7fef880aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:19.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.792+0000 7fef905f8700 1 -- 172.21.15.84:0/3123190735 shutdown_connections 2023-08-31T02:00:19.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.792+0000 7fef905f8700 1 -- 172.21.15.84:0/3123190735 wait complete. 2023-08-31T02:00:19.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.794+0000 7fef905f8700 1 Processor -- start 2023-08-31T02:00:19.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.794+0000 7fef905f8700 1 -- start start 2023-08-31T02:00:19.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.795+0000 7fef905f8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef8806aef0 0x7fef88169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.795+0000 7fef905f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef880c9030 0x7fef880b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.795+0000 7fef905f8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef88167ec0 0x7fef880caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.795+0000 7fef905f8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef88086a70 con 0x7fef880c9030 2023-08-31T02:00:19.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.795+0000 7fef905f8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef880b0030 con 0x7fef8806aef0 2023-08-31T02:00:19.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.795+0000 7fef905f8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef880b0310 con 0x7fef88167ec0 2023-08-31T02:00:19.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.796+0000 7fef8db93700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef880c9030 0x7fef880b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.796+0000 7fef8db93700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef880c9030 0x7fef880b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51636/0 (socket says 172.21.15.84:51636) 2023-08-31T02:00:19.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.796+0000 7fef8db93700 1 -- 172.21.15.84:0/1087770230 learned_addr learned my addr 172.21.15.84:0/1087770230 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:19.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.796+0000 7fef8db93700 1 -- 172.21.15.84:0/1087770230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef88167ec0 msgr2=0x7fef880caad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:19.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.796+0000 7fef8db93700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef88167ec0 0x7fef880caad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.796+0000 7fef8db93700 1 -- 172.21.15.84:0/1087770230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef8806aef0 msgr2=0x7fef88169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:19.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.796+0000 7fef8db93700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef8806aef0 0x7fef88169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:19.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.796+0000 7fef8db93700 1 -- 172.21.15.84:0/1087770230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef80009d00 con 0x7fef880c9030 2023-08-31T02:00:19.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.797+0000 7fef8db93700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef880c9030 0x7fef880b2700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef7800b520 tx=0x7fef7800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.798+0000 7fef7effd700 1 -- 172.21.15.84:0/1087770230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78005aa0 con 0x7fef880c9030 2023-08-31T02:00:19.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.798+0000 7fef7effd700 1 -- 172.21.15.84:0/1087770230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef78005cf0 con 0x7fef880c9030 2023-08-31T02:00:19.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.798+0000 7fef7effd700 1 -- 172.21.15.84:0/1087770230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78055640 con 0x7fef880c9030 2023-08-31T02:00:19.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.798+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef880b05f0 con 0x7fef880c9030 2023-08-31T02:00:19.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.798+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8816a4b0 con 0x7fef880c9030 2023-08-31T02:00:19.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.803+0000 7fef7effd700 1 -- 172.21.15.84:0/1087770230 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef780557a0 con 0x7fef880c9030 2023-08-31T02:00:19.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.804+0000 7fef7effd700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef6c06a180 0x7fef6c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:19.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.804+0000 7fef7effd700 1 -- 172.21.15.84:0/1087770230 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef780cc450 con 0x7fef880c9030 2023-08-31T02:00:19.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.804+0000 7fef8e394700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef6c06a180 0x7fef6c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:19.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.805+0000 7fef8e394700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef6c06a180 0x7fef6c06c640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef840096d0 tx=0x7fef84006c30 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:19.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.806+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef700052f0 con 0x7fef880c9030 2023-08-31T02:00:19.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:19.815+0000 7fef7effd700 1 -- 172.21.15.84:0/1087770230 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fef78097920 con 0x7fef880c9030 2023-08-31T02:00:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.146+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8000005160 con 0x7f801c0cae10 2023-08-31T02:00:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.146+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed18005160 con 0x7fed3015b9f0 2023-08-31T02:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.146+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb67c005190 con 0x7fb69806b000 2023-08-31T02:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.147+0000 7f800affd700 1 -- 172.21.15.84:0/2029308719 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f800c014170 con 0x7f801c0cae10 2023-08-31T02:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.146+0000 7fed26ffd700 1 -- 172.21.15.84:0/3661127662 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed28019020 con 0x7fed3015b9f0 2023-08-31T02:00:20.140 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2023-08-31T02:00:20.141 INFO:teuthology.orchestra.run.smithi084.stdout:55834574858 2023-08-31T02:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.147+0000 7fb68e7fc700 1 -- 172.21.15.84:0/2684377360 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb694024030 con 0x7fb69806b000 2023-08-31T02:00:20.142 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-08-31T02:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed1406a1b0 msgr2=0x7fed1406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed1406a1b0 0x7fed1406c670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed20009710 tx=0x7fed20006c60 comp rx=0 tx=0).stop 2023-08-31T02:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed3015b9f0 msgr2=0x7fed3015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed3015b9f0 0x7fed3015db70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed2800b990 tx=0x7fed2800bd50 comp rx=0 tx=0).stop 2023-08-31T02:00:20.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb68406a2c0 msgr2=0x7fb68406c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb68406a2c0 0x7fb68406c780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb698155d00 tx=0x7fb690009040 comp rx=0 tx=0).stop 2023-08-31T02:00:20.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 msgr2=0x7fb6981ee5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 0x7fb6981ee5c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb6980c71b0 tx=0x7fb69401ced0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ffc06a0e0 msgr2=0x7f7ffc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ffc06a0e0 0x7f7ffc06c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f80100098e0 tx=0x7f80100047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0cae10 msgr2=0x7f801c149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0cae10 0x7f801c149530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f800c00b470 tx=0x7f800c00b780 comp rx=0 tx=0).stop 2023-08-31T02:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 shutdown_connections 2023-08-31T02:00:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7ffc06a0e0 0x7f7ffc06c5a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c1575a0 0x7f801c149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f801c0c7450 0x7f801c14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 --2- 172.21.15.84:0/2029308719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f801c0cae10 0x7f801c149530 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 >> 172.21.15.84:0/2029308719 conn(0x7f801c0aea80 msgr2=0x7f801c0ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:20.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 shutdown_connections 2023-08-31T02:00:20.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed1406a1b0 0x7fed1406c670 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed3015b9f0 0x7fed3015db70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed300c9030 0x7fed30154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 --2- 172.21.15.84:0/3661127662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed300c9a40 0x7fed3015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.151+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 >> 172.21.15.84:0/3661127662 conn(0x7fed300cd630 msgr2=0x7fed300c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.152+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 shutdown_connections 2023-08-31T02:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.152+0000 7f8020f77700 1 -- 172.21.15.84:0/2029308719 wait complete. 2023-08-31T02:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.152+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 shutdown_connections 2023-08-31T02:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.152+0000 7fed385d8700 1 -- 172.21.15.84:0/3661127662 wait complete. 2023-08-31T02:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.153+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bec06e550 con 0x7f9bec06b080 2023-08-31T02:00:20.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 shutdown_connections 2023-08-31T02:00:20.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb68406a2c0 0x7fb68406c780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6980c8430 0x7fb6981595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69806ac20 0x7fb69813fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7fb69ffbb700 1 --2- 172.21.15.84:0/2684377360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb69806b000 0x7fb6981ee5c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 >> 172.21.15.84:0/2684377360 conn(0x7fb6980aea80 msgr2=0x7fb698140490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7f9bdaffd700 1 -- 172.21.15.84:0/4087976666 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9bdc0579b0 con 0x7f9bec06b080 2023-08-31T02:00:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 shutdown_connections 2023-08-31T02:00:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.154+0000 7fb69ffbb700 1 -- 172.21.15.84:0/2684377360 wait complete. 2023-08-31T02:00:20.153 INFO:teuthology.orchestra.run.smithi084.stdout:64424509448 2023-08-31T02:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.163+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f925806f7b0 con 0x7f925813d970 2023-08-31T02:00:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.163+0000 7f9254ff9700 1 -- 172.21.15.84:0/3801190793 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9250057d10 con 0x7f925813d970 2023-08-31T02:00:20.155 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2023-08-31T02:00:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.165+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9bcc06a0e0 msgr2=0x7f9bcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.165+0000 7f9bf0870700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9bcc06a0e0 0x7f9bcc06c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0c9780 tx=0x7f9be00047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.165+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bec06b080 msgr2=0x7f9bec151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.165+0000 7f9bf0870700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bec06b080 0x7f9bec151830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00ea80 tx=0x7f9bdc00ee40 comp rx=0 tx=0).stop 2023-08-31T02:00:20.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f923806a0e0 msgr2=0x7f923806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f923806a0e0 0x7f923806c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9248000c00 tx=0x7f9248011040 comp rx=0 tx=0).stop 2023-08-31T02:00:20.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f925813d970 msgr2=0x7f92581f5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f925813d970 0x7f92581f5520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f925000e520 tx=0x7f925000e830 comp rx=0 tx=0).stop 2023-08-31T02:00:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 shutdown_connections 2023-08-31T02:00:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f923806a0e0 0x7f923806c5a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f925813d970 0x7f92581f5520 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92580c7a80 0x7f92581543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 --2- 172.21.15.84:0/3801190793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92580cbd50 0x7f92581514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 >> 172.21.15.84:0/3801190793 conn(0x7f92580699a0 msgr2=0x7f9258156ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.167+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3b4006f870 con 0x7f3b4015bf00 2023-08-31T02:00:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.168+0000 7f3b367fc700 1 -- 172.21.15.84:0/3084674577 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b30057d90 con 0x7f3b4015bf00 2023-08-31T02:00:20.162 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2023-08-31T02:00:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.169+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 shutdown_connections 2023-08-31T02:00:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.169+0000 7f9bf0870700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9bcc06a0e0 0x7f9bcc06c5a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.169+0000 7f9bf0870700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bec15afa0 0x7f9bec06da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.169+0000 7f9bf0870700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bec067af0 0x7f9bec1f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.169+0000 7f9bf0870700 1 --2- 172.21.15.84:0/4087976666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bec06b080 0x7f9bec151830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.169+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 >> 172.21.15.84:0/4087976666 conn(0x7f9bec0cd1c0 msgr2=0x7f9bec0aaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.169+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 shutdown_connections 2023-08-31T02:00:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.169+0000 7f9bf0870700 1 -- 172.21.15.84:0/4087976666 wait complete. 2023-08-31T02:00:20.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.170+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3b2406a0e0 msgr2=0x7f3b2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.170+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3b2406a0e0 0x7f3b2406c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0098e0 tx=0x7f3b3c0047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.170+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4015bf00 msgr2=0x7f3b401e6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.170+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4015bf00 0x7f3b401e6010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000c420 tx=0x7f3b3000c7e0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.172+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 shutdown_connections 2023-08-31T02:00:20.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.172+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f18005870 con 0x7f4f3806d920 2023-08-31T02:00:20.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.172+0000 7f925e086700 1 -- 172.21.15.84:0/3801190793 wait complete. 2023-08-31T02:00:20.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.2 2023-08-31T02:00:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.174+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 shutdown_connections 2023-08-31T02:00:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.174+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3b2406a0e0 0x7f3b2406c5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.174+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b4015fb00 0x7f3b401e6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.174+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b40144ae0 0x7f3b40139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.174+0000 7f3b47ca6700 1 --2- 172.21.15.84:0/3084674577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4015bf00 0x7f3b401e6010 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.174+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 >> 172.21.15.84:0/3084674577 conn(0x7f3b400aea80 msgr2=0x7f3b400c8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.174+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 shutdown_connections 2023-08-31T02:00:20.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.174+0000 7f3b47ca6700 1 -- 172.21.15.84:0/3084674577 wait complete. 2023-08-31T02:00:20.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.6 2023-08-31T02:00:20.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.175+0000 7f4f357fa700 1 -- 172.21.15.84:0/1537965875 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f24056d80 con 0x7f4f3806d920 2023-08-31T02:00:20.172 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-08-31T02:00:20.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-08-31T02:00:20.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.179+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f1c06a1b0 msgr2=0x7f4f1c06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.179+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f1c06a1b0 0x7f4f1c06c670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000c00 tx=0x7f4f2c0047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.179+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3806d920 msgr2=0x7f4f380afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.179+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3806d920 0x7f4f380afa90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c3f0 tx=0x7f4f2400c700 comp rx=0 tx=0).stop 2023-08-31T02:00:20.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.180+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 shutdown_connections 2023-08-31T02:00:20.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.180+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f1c06a1b0 0x7f4f1c06c670 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.180+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3813d970 0x7f4f3813c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.180+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3806d920 0x7f4f380afa90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.180+0000 7f4f3ecab700 1 --2- 172.21.15.84:0/1537965875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f380c7370 0x7f4f3813bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.180+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 >> 172.21.15.84:0/1537965875 conn(0x7f4f380699a0 msgr2=0x7f4f3813b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.180+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 shutdown_connections 2023-08-31T02:00:20.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.180+0000 7f4f3ecab700 1 -- 172.21.15.84:0/1537965875 wait complete. 2023-08-31T02:00:20.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.1 2023-08-31T02:00:20.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.4 2023-08-31T02:00:20.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.7 2023-08-31T02:00:20.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.198+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef70005160 con 0x7fef880c9030 2023-08-31T02:00:20.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.198+0000 7fef7effd700 1 -- 172.21.15.84:0/1087770230 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef78059020 con 0x7fef880c9030 2023-08-31T02:00:20.190 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-08-31T02:00:20.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.0 2023-08-31T02:00:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.200+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef6c06a180 msgr2=0x7fef6c06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.200+0000 7fef905f8700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef6c06a180 0x7fef6c06c640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef840096d0 tx=0x7fef84006c30 comp rx=0 tx=0).stop 2023-08-31T02:00:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.200+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef880c9030 msgr2=0x7fef880b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.200+0000 7fef905f8700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef880c9030 0x7fef880b2700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef7800b520 tx=0x7fef7800b8e0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.201+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 shutdown_connections 2023-08-31T02:00:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.201+0000 7fef905f8700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef6c06a180 0x7fef6c06c640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.201+0000 7fef905f8700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef88167ec0 0x7fef880caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.201+0000 7fef905f8700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef8806aef0 0x7fef88169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.201+0000 7fef905f8700 1 --2- 172.21.15.84:0/1087770230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef880c9030 0x7fef880b2700 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.201+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 >> 172.21.15.84:0/1087770230 conn(0x7fef880aea80 msgr2=0x7fef8806f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.201+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 shutdown_connections 2023-08-31T02:00:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:20.201+0000 7fef905f8700 1 -- 172.21.15.84:0/1087770230 wait complete. 2023-08-31T02:00:20.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.3 2023-08-31T02:00:21.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-31T02:00:21.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-31T02:00:21.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-31T02:00:21.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-31T02:00:21.186 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-31T02:00:21.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-31T02:00:21.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-31T02:00:21.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-31T02:00:21.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.378+0000 7fa4ae96a700 1 -- 172.21.15.84:0/788369020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a80c8600 msgr2=0x7fa4a815edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.378+0000 7fa4ae96a700 1 --2- 172.21.15.84:0/788369020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a80c8600 0x7fa4a815edf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa4a001c0e0 tx=0x7fa4a001c3f0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.378+0000 7f1eb83e7700 1 -- 172.21.15.84:0/322240404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00b0d90 msgr2=0x7f1eb00b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.378+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/322240404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00b0d90 0x7f1eb00b38a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00cca50 tx=0x7f1eac009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.379+0000 7f1eb83e7700 1 -- 172.21.15.84:0/322240404 shutdown_connections 2023-08-31T02:00:21.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.379+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/322240404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00b0d90 0x7f1eb00b38a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.379+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/322240404 >> v2:172.21.15.84:3300/0 conn(0x7f1eb00ceb50 0x7f1eb00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.379+0000 7f1eb83e7700 1 -- 172.21.15.84:0/322240404 >> 172.21.15.84:0/322240404 conn(0x7f1eb0069fd0 msgr2=0x7f1eb00cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.379+0000 7fa4ae96a700 1 -- 172.21.15.84:0/788369020 shutdown_connections 2023-08-31T02:00:21.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.379+0000 7fa4ae96a700 1 --2- 172.21.15.84:0/788369020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a80c8600 0x7fa4a815edf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.379+0000 7fa4ae96a700 1 -- 172.21.15.84:0/788369020 >> 172.21.15.84:0/788369020 conn(0x7fa4a80aea80 msgr2=0x7fa4a80aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.380+0000 7fa4ae96a700 1 -- 172.21.15.84:0/788369020 shutdown_connections 2023-08-31T02:00:21.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.380+0000 7fa4ae96a700 1 -- 172.21.15.84:0/788369020 wait complete. 2023-08-31T02:00:21.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.381+0000 7fadd40dd700 1 -- 172.21.15.84:0/4284090142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 msgr2=0x7fadb8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.381+0000 7fadd40dd700 1 --2- 172.21.15.84:0/4284090142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 0x7fadb8003e20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009fb0 tx=0x7fadb8005880 comp rx=0 tx=0).stop 2023-08-31T02:00:21.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.381+0000 7fadd267a700 1 -- 172.21.15.84:0/4284090142 reap_dead start 2023-08-31T02:00:21.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.381+0000 7fadd40dd700 1 -- 172.21.15.84:0/4284090142 shutdown_connections 2023-08-31T02:00:21.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.381+0000 7fadd40dd700 1 -- 172.21.15.84:0/4284090142 >> 172.21.15.84:0/4284090142 conn(0x7fadcc0aea80 msgr2=0x7fadcc0aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.381+0000 7fadd40dd700 1 -- 172.21.15.84:0/4284090142 shutdown_connections 2023-08-31T02:00:21.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.381+0000 7fa4ae96a700 1 Processor -- start 2023-08-31T02:00:21.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.381+0000 7fadd40dd700 1 -- 172.21.15.84:0/4284090142 wait complete. 2023-08-31T02:00:21.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fadd40dd700 1 Processor -- start 2023-08-31T02:00:21.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.382+0000 7fa4ae96a700 1 -- start start 2023-08-31T02:00:21.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4ae96a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806ac20 0x7fa4a80b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4ae96a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a806b000 0x7fa4a81399c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4ae96a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a815c930 0x7fa4a815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4ae96a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a806f980 con 0x7fa4a806b000 2023-08-31T02:00:21.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4ae96a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a815d4a0 con 0x7fa4a815c930 2023-08-31T02:00:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4ae96a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a815d780 con 0x7fa4a806ac20 2023-08-31T02:00:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4acf07700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a815c930 0x7fa4a815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4acf07700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a815c930 0x7fa4a815cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55308/0 (socket says 172.21.15.84:55308) 2023-08-31T02:00:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4acf07700 1 -- 172.21.15.84:0/1738665843 learned_addr learned my addr 172.21.15.84:0/1738665843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4a7fff700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806ac20 0x7fa4a80b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fa4a77fe700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a806b000 0x7fa4a81399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4acf07700 1 -- 172.21.15.84:0/1738665843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806ac20 msgr2=0x7fa4a80b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4acf07700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806ac20 0x7fa4a80b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4acf07700 1 -- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a806b000 msgr2=0x7fa4a81399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4acf07700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a806b000 0x7fa4a81399c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4acf07700 1 -- 172.21.15.84:0/1738665843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0009d00 con 0x7fa4a815c930 2023-08-31T02:00:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4acf07700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a815c930 0x7fa4a815cde0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0023000 tx=0x7fa4a00077f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4a4ff9700 1 -- 172.21.15.84:0/1738665843 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0007b70 con 0x7fa4a815c930 2023-08-31T02:00:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4a4ff9700 1 -- 172.21.15.84:0/1738665843 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa4a0007de0 con 0x7fa4a815c930 2023-08-31T02:00:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4a4ff9700 1 -- 172.21.15.84:0/1738665843 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a002d6a0 con 0x7fa4a815c930 2023-08-31T02:00:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a815da60 con 0x7fa4a815c930 2023-08-31T02:00:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a8139f00 con 0x7fa4a815c930 2023-08-31T02:00:21.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.383+0000 7fadd40dd700 1 -- start start 2023-08-31T02:00:21.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fadd40dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 0x7fadcc151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fadd40dd700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0708e0 0x7fadcc13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fadd40dd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc15ba70 0x7fadcc15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fadd40dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc15c430 con 0x7fadb8003a00 2023-08-31T02:00:21.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fadd40dd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc151860 con 0x7fadcc15ba70 2023-08-31T02:00:21.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.384+0000 7fadd40dd700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc151b40 con 0x7fadcc0708e0 2023-08-31T02:00:21.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fadd1e79700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 0x7fadcc151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fadd1e79700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 0x7fadcc151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51668/0 (socket says 172.21.15.84:51668) 2023-08-31T02:00:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fadd1e79700 1 -- 172.21.15.84:0/29276802 learned_addr learned my addr 172.21.15.84:0/29276802 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fadd1e79700 1 -- 172.21.15.84:0/29276802 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0708e0 msgr2=0x7fadcc13ca60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fadd1e79700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0708e0 0x7fadcc13ca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fadd1e79700 1 -- 172.21.15.84:0/29276802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc15ba70 msgr2=0x7fadcc15bef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fadd1e79700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc15ba70 0x7fadcc15bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.385+0000 7fadd1e79700 1 -- 172.21.15.84:0/29276802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc151e20 con 0x7fadb8003a00 2023-08-31T02:00:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.386+0000 7fadd1e79700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 0x7fadcc151280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fadc4014040 tx=0x7fadc4012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.386+0000 7f1eb83e7700 1 -- 172.21.15.84:0/322240404 shutdown_connections 2023-08-31T02:00:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.388+0000 7fadc27fc700 1 -- 172.21.15.84:0/29276802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc400e040 con 0x7fadb8003a00 2023-08-31T02:00:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.388+0000 7fadc27fc700 1 -- 172.21.15.84:0/29276802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fadc4012e90 con 0x7fadb8003a00 2023-08-31T02:00:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.388+0000 7fadc27fc700 1 -- 172.21.15.84:0/29276802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4009a80 con 0x7fadb8003a00 2023-08-31T02:00:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.388+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc152100 con 0x7fadb8003a00 2023-08-31T02:00:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.388+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc070d60 con 0x7fadb8003a00 2023-08-31T02:00:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.390+0000 7fa4a4ff9700 1 -- 172.21.15.84:0/1738665843 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa4a002d800 con 0x7fa4a815c930 2023-08-31T02:00:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.390+0000 7fa4a4ff9700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa49006a1f0 0x7fa49006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.391+0000 7fa4a4ff9700 1 -- 172.21.15.84:0/1738665843 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4a009b200 con 0x7fa4a815c930 2023-08-31T02:00:21.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4840052f0 con 0x7fa4a815c930 2023-08-31T02:00:21.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.388+0000 7f1eb83e7700 1 -- 172.21.15.84:0/322240404 wait complete. 2023-08-31T02:00:21.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.390+0000 7f1eb83e7700 1 Processor -- start 2023-08-31T02:00:21.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.391+0000 7f1eb83e7700 1 -- start start 2023-08-31T02:00:21.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb83e7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eb00b0d90 0x7f1eb00c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb83e7700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1eb00b1170 0x7f1eb00c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb83e7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00ceb50 0x7f1eb0136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb83e7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb00c4a20 con 0x7f1eb00b0d90 2023-08-31T02:00:21.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb83e7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb014b6d0 con 0x7f1eb00ceb50 2023-08-31T02:00:21.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb83e7700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb014b9b0 con 0x7f1eb00b1170 2023-08-31T02:00:21.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb6984700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00ceb50 0x7f1eb0136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb6984700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00ceb50 0x7f1eb0136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55322/0 (socket says 172.21.15.84:55322) 2023-08-31T02:00:21.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.392+0000 7f1eb6984700 1 -- 172.21.15.84:0/1144764169 learned_addr learned my addr 172.21.15.84:0/1144764169 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:21.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7f1eb5982700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1eb00b1170 0x7f1eb00c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7f1eb5982700 1 -- 172.21.15.84:0/1144764169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00ceb50 msgr2=0x7f1eb0136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7f1eb5982700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00ceb50 0x7f1eb0136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7f1eb5982700 1 -- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eb00b0d90 msgr2=0x7f1eb00c6b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T02:00:21.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7f1eb5982700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eb00b0d90 0x7f1eb00c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7f1eb5982700 1 -- 172.21.15.84:0/1144764169 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac009520 con 0x7f1eb00b1170 2023-08-31T02:00:21.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7f1eb5982700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1eb00b1170 0x7f1eb00c44e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009fd0 tx=0x7f1ea000b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7f1ea6ffd700 1 -- 172.21.15.84:0/1144764169 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0011830 con 0x7f1eb00b1170 2023-08-31T02:00:21.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.393+0000 7fadc27fc700 1 -- 172.21.15.84:0/29276802 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fadc4025440 con 0x7fadb8003a00 2023-08-31T02:00:21.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.394+0000 7fadc27fc700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fadb006a1e0 0x7fadb006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.394+0000 7fadc27fc700 1 -- 172.21.15.84:0/29276802 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fadc408a480 con 0x7fadb8003a00 2023-08-31T02:00:21.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.395+0000 7fadd1678700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fadb006a1e0 0x7fadb006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.395+0000 7fadd1678700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fadb006a1e0 0x7fadb006c6a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fadcc15b4f0 tx=0x7fadbc006800 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.395+0000 7fa4a7fff700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa49006a1f0 0x7fa49006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.394+0000 7f1ea6ffd700 1 -- 172.21.15.84:0/1144764169 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1ea0011aa0 con 0x7f1eb00b1170 2023-08-31T02:00:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.394+0000 7f1ea6ffd700 1 -- 172.21.15.84:0/1144764169 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0010380 con 0x7f1eb00b1170 2023-08-31T02:00:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.394+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb014bc90 con 0x7f1eb00b1170 2023-08-31T02:00:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.394+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb00c8440 con 0x7f1eb00b1170 2023-08-31T02:00:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.395+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb40052f0 con 0x7fadb8003a00 2023-08-31T02:00:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.397+0000 7f1ea6ffd700 1 -- 172.21.15.84:0/1144764169 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ea00104e0 con 0x7f1eb00b1170 2023-08-31T02:00:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.395+0000 7fa4a7fff700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa49006a1f0 0x7fa49006c6b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa498007fd0 tx=0x7fa498009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.397+0000 7fa4a4ff9700 1 -- 172.21.15.84:0/1738665843 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa4a0033070 con 0x7fa4a815c930 2023-08-31T02:00:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.397+0000 7f1ea6ffd700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e9c06a260 0x7f1e9c06c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.397+0000 7f1ea6ffd700 1 -- 172.21.15.84:0/1144764169 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ea0088800 con 0x7f1eb00b1170 2023-08-31T02:00:21.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.404+0000 7f1eb6183700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e9c06a260 0x7f1e9c06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.405+0000 7f1eb6183700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e9c06a260 0x7f1e9c06c720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1eac000c00 tx=0x7f1eac004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.405+0000 7fadc27fc700 1 -- 172.21.15.84:0/29276802 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fadc40559e0 con 0x7fadb8003a00 2023-08-31T02:00:21.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.405+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e980052f0 con 0x7f1eb00b1170 2023-08-31T02:00:21.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.410+0000 7f1ea6ffd700 1 -- 172.21.15.84:0/1144764169 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1ea0086e60 con 0x7f1eb00b1170 2023-08-31T02:00:21.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.445+0000 7f711afe9700 1 -- 172.21.15.84:0/2791705216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70fc004850 msgr2=0x7f70fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.445+0000 7f711afe9700 1 --2- 172.21.15.84:0/2791705216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70fc004850 0x7f70fc004cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7108006fc0 tx=0x7f70fc005880 comp rx=0 tx=0).stop 2023-08-31T02:00:21.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.445+0000 7f7119586700 1 -- 172.21.15.84:0/2791705216 reap_dead start 2023-08-31T02:00:21.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.445+0000 7f711afe9700 1 -- 172.21.15.84:0/2791705216 shutdown_connections 2023-08-31T02:00:21.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.445+0000 7f711afe9700 1 -- 172.21.15.84:0/2791705216 >> 172.21.15.84:0/2791705216 conn(0x7f71140aea80 msgr2=0x7f71140aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.445+0000 7f711afe9700 1 -- 172.21.15.84:0/2791705216 shutdown_connections 2023-08-31T02:00:21.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.445+0000 7f711afe9700 1 -- 172.21.15.84:0/2791705216 wait complete. 2023-08-31T02:00:21.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.447+0000 7f711afe9700 1 Processor -- start 2023-08-31T02:00:21.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.448+0000 7f711afe9700 1 -- start start 2023-08-31T02:00:21.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.449+0000 7f711afe9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70fc004850 0x7f711413a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.450+0000 7f711afe9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71141fe220 0x7f7114140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.450+0000 7f711afe9700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71141414c0 0x7f711413dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.450+0000 7f711afe9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7114141f20 con 0x7f71141fe220 2023-08-31T02:00:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.450+0000 7f711afe9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71140ae070 con 0x7f70fc004850 2023-08-31T02:00:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.450+0000 7f711afe9700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71141ff7f0 con 0x7f71141414c0 2023-08-31T02:00:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.450+0000 7f7119586700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71141414c0 0x7f711413dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.450+0000 7f7119586700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71141414c0 0x7f711413dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.84:45916/0 (socket says 172.21.15.84:45916) 2023-08-31T02:00:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.450+0000 7f7119586700 1 -- 172.21.15.84:0/3008323370 learned_addr learned my addr 172.21.15.84:0/3008323370 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f7119586700 1 -- 172.21.15.84:0/3008323370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70fc004850 msgr2=0x7f711413a700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f7119586700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70fc004850 0x7f711413a700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f7119586700 1 -- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71141fe220 msgr2=0x7f7114140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f7119586700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71141fe220 0x7f7114140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f7119586700 1 -- 172.21.15.84:0/3008323370 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711413ac40 con 0x7f71141414c0 2023-08-31T02:00:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f7119586700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71141414c0 0x7f711413dfa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f71140ca8a0 tx=0x7f710400ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f71117fa700 1 -- 172.21.15.84:0/3008323370 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104016070 con 0x7f71141414c0 2023-08-31T02:00:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f71117fa700 1 -- 172.21.15.84:0/3008323370 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7104004020 con 0x7f71141414c0 2023-08-31T02:00:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f71117fa700 1 -- 172.21.15.84:0/3008323370 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040043f0 con 0x7f71141414c0 2023-08-31T02:00:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71141febe0 con 0x7f71141414c0 2023-08-31T02:00:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.451+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71141ff1a0 con 0x7f71141414c0 2023-08-31T02:00:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.454+0000 7f71117fa700 1 -- 172.21.15.84:0/3008323370 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7104003680 con 0x7f71141414c0 2023-08-31T02:00:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.455+0000 7f71117fa700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a130 0x7f710006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.455+0000 7f71117fa700 1 -- 172.21.15.84:0/3008323370 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7104087f70 con 0x7f71141414c0 2023-08-31T02:00:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.456+0000 7f7118d85700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a130 0x7f710006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.456+0000 7f7118d85700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a130 0x7f710006c5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f710c001fa0 tx=0x7f710c001630 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.461+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7114071740 con 0x7f71141414c0 2023-08-31T02:00:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.461+0000 7f2f65291700 1 -- 172.21.15.84:0/1172394477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f4c005280 msgr2=0x7f2f4c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.461+0000 7f2f65291700 1 --2- 172.21.15.84:0/1172394477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f4c005280 0x7f2f4c00ba10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f48006fd0 tx=0x7f2f4c005880 comp rx=0 tx=0).stop 2023-08-31T02:00:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.461+0000 7f2f5f7fe700 1 -- 172.21.15.84:0/1172394477 reap_dead start 2023-08-31T02:00:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.461+0000 7f2f65291700 1 -- 172.21.15.84:0/1172394477 shutdown_connections 2023-08-31T02:00:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.461+0000 7f2f65291700 1 -- 172.21.15.84:0/1172394477 >> 172.21.15.84:0/1172394477 conn(0x7f2f600aea80 msgr2=0x7f2f600aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.461+0000 7f2f65291700 1 -- 172.21.15.84:0/1172394477 shutdown_connections 2023-08-31T02:00:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.461+0000 7f2f65291700 1 -- 172.21.15.84:0/1172394477 wait complete. 2023-08-31T02:00:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.462+0000 7fb37303b700 1 -- 172.21.15.84:0/788889767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354004850 msgr2=0x7fb354004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.462+0000 7fb37303b700 1 --2- 172.21.15.84:0/788889767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354004850 0x7fb354004cd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009bd0 tx=0x7fb354005880 comp rx=0 tx=0).stop 2023-08-31T02:00:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.463+0000 7f2f65291700 1 Processor -- start 2023-08-31T02:00:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.463+0000 7f2f65291700 1 -- start start 2023-08-31T02:00:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.463+0000 7f2f65291700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c005280 0x7f2f6013fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.463+0000 7f2f65291700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f600b1ca0 0x7f2f601404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.463+0000 7f2f65291700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f600b2120 0x7f2f6015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.463+0000 7f2f65291700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600b0f50 con 0x7f2f4c005280 2023-08-31T02:00:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.463+0000 7f2f65291700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600b11c0 con 0x7f2f600b2120 2023-08-31T02:00:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.463+0000 7f2f65291700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600b14a0 con 0x7f2f600b1ca0 2023-08-31T02:00:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c005280 0x7f2f6013fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c005280 0x7f2f6013fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51718/0 (socket says 172.21.15.84:51718) 2023-08-31T02:00:21.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 -- 172.21.15.84:0/1621856672 learned_addr learned my addr 172.21.15.84:0/1621856672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:21.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5f7fe700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f600b2120 0x7f2f6015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5e7fc700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f600b1ca0 0x7f2f601404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7fb3715d8700 1 -- 172.21.15.84:0/788889767 reap_dead start 2023-08-31T02:00:21.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7fb37303b700 1 -- 172.21.15.84:0/788889767 shutdown_connections 2023-08-31T02:00:21.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7fb37303b700 1 -- 172.21.15.84:0/788889767 >> 172.21.15.84:0/788889767 conn(0x7fb36c0aea80 msgr2=0x7fb36c0aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 -- 172.21.15.84:0/1621856672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f600b1ca0 msgr2=0x7f2f601404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f600b1ca0 0x7f2f601404c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 -- 172.21.15.84:0/1621856672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f600b2120 msgr2=0x7f2f6015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f600b2120 0x7f2f6015d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 -- 172.21.15.84:0/1621856672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f600b1780 con 0x7f2f4c005280 2023-08-31T02:00:21.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f5effd700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c005280 0x7f2f6013fc50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800c450 tx=0x7f2f5800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f577fe700 1 -- 172.21.15.84:0/1621856672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58011790 con 0x7f2f4c005280 2023-08-31T02:00:21.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.464+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f600add20 con 0x7f2f4c005280 2023-08-31T02:00:21.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.465+0000 7fb37303b700 1 -- 172.21.15.84:0/788889767 shutdown_connections 2023-08-31T02:00:21.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.465+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f60140190 con 0x7f2f4c005280 2023-08-31T02:00:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.465+0000 7f2f577fe700 1 -- 172.21.15.84:0/1621856672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f580118f0 con 0x7f2f4c005280 2023-08-31T02:00:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.465+0000 7f2f577fe700 1 -- 172.21.15.84:0/1621856672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58011ca0 con 0x7f2f4c005280 2023-08-31T02:00:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.466+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f440052f0 con 0x7f2f4c005280 2023-08-31T02:00:21.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.466+0000 7f71117fa700 1 -- 172.21.15.84:0/3008323370 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7104053440 con 0x7f71141414c0 2023-08-31T02:00:21.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.465+0000 7fb37303b700 1 -- 172.21.15.84:0/788889767 wait complete. 2023-08-31T02:00:21.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.467+0000 7fb37303b700 1 Processor -- start 2023-08-31T02:00:21.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.467+0000 7f2f577fe700 1 -- 172.21.15.84:0/1621856672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f58012420 con 0x7f2f4c005280 2023-08-31T02:00:21.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.467+0000 7f2f577fe700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f4c06bcb0 0x7f2f4c06e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.467+0000 7f2f577fe700 1 -- 172.21.15.84:0/1621856672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f580886a0 con 0x7f2f4c005280 2023-08-31T02:00:21.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7f2f5e7fc700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f4c06bcb0 0x7f2f4c06e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.467+0000 7fb37303b700 1 -- start start 2023-08-31T02:00:21.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb37303b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb36c201360 0x7fb36c15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb37303b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb36c15c150 0x7fb36c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb37303b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb36c0b2370 0x7fb36c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb37303b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c15c5d0 con 0x7fb36c0b2370 2023-08-31T02:00:21.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb37303b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0afb70 con 0x7fb36c201360 2023-08-31T02:00:21.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb37303b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0afe50 con 0x7fb36c15c150 2023-08-31T02:00:21.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7f2f5e7fc700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f4c06bcb0 0x7f2f4c06e170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f500094f0 tx=0x7f2f50009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb3715d8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb36c0b2370 0x7fb36c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb3715d8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb36c0b2370 0x7fb36c155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51728/0 (socket says 172.21.15.84:51728) 2023-08-31T02:00:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb3715d8700 1 -- 172.21.15.84:0/1849725968 learned_addr learned my addr 172.21.15.84:0/1849725968 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.468+0000 7fb370dd7700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb36c201360 0x7fb36c15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.469+0000 7fb3715d8700 1 -- 172.21.15.84:0/1849725968 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb36c15c150 msgr2=0x7fb36c0b1e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.469+0000 7fb3715d8700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb36c15c150 0x7fb36c0b1e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.469+0000 7fb3715d8700 1 -- 172.21.15.84:0/1849725968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb36c201360 msgr2=0x7fb36c15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.469+0000 7fb3715d8700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb36c201360 0x7fb36c15bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.469+0000 7fb3715d8700 1 -- 172.21.15.84:0/1849725968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c0b0130 con 0x7fb36c0b2370 2023-08-31T02:00:21.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.469+0000 7fb3715d8700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb36c0b2370 0x7fb36c155c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0cca50 tx=0x7fb36400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.472+0000 7fb3697fa700 1 -- 172.21.15.84:0/1849725968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364004da0 con 0x7fb36c0b2370 2023-08-31T02:00:21.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.472+0000 7fb3697fa700 1 -- 172.21.15.84:0/1849725968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb364007070 con 0x7fb36c0b2370 2023-08-31T02:00:21.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.472+0000 7fb3697fa700 1 -- 172.21.15.84:0/1849725968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3640074c0 con 0x7fb36c0b2370 2023-08-31T02:00:21.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.472+0000 7f2f577fe700 1 -- 172.21.15.84:0/1621856672 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2f58053b10 con 0x7f2f4c005280 2023-08-31T02:00:21.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.472+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36c0b0410 con 0x7fb36c0b2370 2023-08-31T02:00:21.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.472+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c201740 con 0x7fb36c0b2370 2023-08-31T02:00:21.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.474+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c0b0930 con 0x7fb36c0b2370 2023-08-31T02:00:21.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.475+0000 7fb3697fa700 1 -- 172.21.15.84:0/1849725968 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb364007620 con 0x7fb36c0b2370 2023-08-31T02:00:21.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.476+0000 7fb3697fa700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb35806a0e0 0x7fb35806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.476+0000 7fb3697fa700 1 -- 172.21.15.84:0/1849725968 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb364088140 con 0x7fb36c0b2370 2023-08-31T02:00:21.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.476+0000 7fb370dd7700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb35806a0e0 0x7fb35806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.476+0000 7fb370dd7700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb35806a0e0 0x7fb35806c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb360006630 tx=0x7fb3600014b0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.481+0000 7fb3697fa700 1 -- 172.21.15.84:0/1849725968 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb364053710 con 0x7fb36c0b2370 2023-08-31T02:00:21.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.486+0000 7f3672169700 1 -- 172.21.15.84:0/2904635433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 msgr2=0x7f3654004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.486+0000 7f3672169700 1 --2- 172.21.15.84:0/2904635433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 0x7f3654004cd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3664009f60 tx=0x7f3654005880 comp rx=0 tx=0).stop 2023-08-31T02:00:21.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.486+0000 7f3672169700 1 -- 172.21.15.84:0/2904635433 shutdown_connections 2023-08-31T02:00:21.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.486+0000 7f3672169700 1 --2- 172.21.15.84:0/2904635433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 0x7f3654004cd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.486+0000 7f3672169700 1 -- 172.21.15.84:0/2904635433 >> 172.21.15.84:0/2904635433 conn(0x7f366c0aea80 msgr2=0x7f366c0aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.493+0000 7f3672169700 1 -- 172.21.15.84:0/2904635433 shutdown_connections 2023-08-31T02:00:21.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.493+0000 7f3672169700 1 -- 172.21.15.84:0/2904635433 wait complete. 2023-08-31T02:00:21.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.495+0000 7f3672169700 1 Processor -- start 2023-08-31T02:00:21.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.495+0000 7f3672169700 1 -- start start 2023-08-31T02:00:21.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.496+0000 7f3672169700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 0x7f366c0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f3672169700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f366c131420 0x7f366c155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f3672169700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f366c155a40 0x7f366c143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f3672169700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c155ef0 con 0x7f3654004850 2023-08-31T02:00:21.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f3672169700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c1318a0 con 0x7f366c131420 2023-08-31T02:00:21.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f3672169700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c145430 con 0x7f366c155a40 2023-08-31T02:00:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f366b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 0x7f366c0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f366b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 0x7f366c0b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51744/0 (socket says 172.21.15.84:51744) 2023-08-31T02:00:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f366b7fe700 1 -- 172.21.15.84:0/3487400353 learned_addr learned my addr 172.21.15.84:0/3487400353 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:21.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.497+0000 7f366bfff700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f366c155a40 0x7f366c143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.498+0000 7f366b7fe700 1 -- 172.21.15.84:0/3487400353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f366c155a40 msgr2=0x7f366c143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.498+0000 7f366b7fe700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f366c155a40 0x7f366c143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.498+0000 7f366b7fe700 1 -- 172.21.15.84:0/3487400353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f366c131420 msgr2=0x7f366c155500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T02:00:21.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.498+0000 7f366b7fe700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f366c131420 0x7f366c155500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.498+0000 7f366b7fe700 1 -- 172.21.15.84:0/3487400353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c145710 con 0x7f3654004850 2023-08-31T02:00:21.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.498+0000 7f366b7fe700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 0x7f366c0b1300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f366000b3e0 tx=0x7f366000b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.499+0000 7f3653fff700 1 -- 172.21.15.84:0/3487400353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011630 con 0x7f3654004850 2023-08-31T02:00:21.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.499+0000 7f3653fff700 1 -- 172.21.15.84:0/3487400353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3660011880 con 0x7f3654004850 2023-08-31T02:00:21.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.499+0000 7f3653fff700 1 -- 172.21.15.84:0/3487400353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011c90 con 0x7f3654004850 2023-08-31T02:00:21.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.501+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c1459f0 con 0x7f3654004850 2023-08-31T02:00:21.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.501+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c145fb0 con 0x7f3654004850 2023-08-31T02:00:21.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.503+0000 7f3653fff700 1 -- 172.21.15.84:0/3487400353 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f366001a460 con 0x7f3654004850 2023-08-31T02:00:21.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.504+0000 7f3653fff700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f365806a0e0 0x7f365806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.504+0000 7f3653fff700 1 -- 172.21.15.84:0/3487400353 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36600882b0 con 0x7f3654004850 2023-08-31T02:00:21.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.504+0000 7f366affd700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f365806a0e0 0x7f365806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.505+0000 7f366affd700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f365806a0e0 0x7f365806c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f366c1310c0 tx=0x7f3664004ca0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.506+0000 7fefb2797700 1 -- 172.21.15.84:0/1143104494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac06b000 msgr2=0x7fefac06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.506+0000 7fefb2797700 1 --2- 172.21.15.84:0/1143104494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac06b000 0x7fefac06d130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefa00098b0 tx=0x7fefa0009bc0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.506+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c070250 con 0x7f3654004850 2023-08-31T02:00:21.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.509+0000 7fefb2797700 1 -- 172.21.15.84:0/1143104494 shutdown_connections 2023-08-31T02:00:21.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.509+0000 7fefb2797700 1 --2- 172.21.15.84:0/1143104494 >> v2:172.21.15.170:3300/0 conn(0x7fefac06ac20 0x7fefac06cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.509+0000 7fefb2797700 1 --2- 172.21.15.84:0/1143104494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac06b000 0x7fefac06d130 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.509+0000 7fefb2797700 1 -- 172.21.15.84:0/1143104494 >> 172.21.15.84:0/1143104494 conn(0x7fefac0aea80 msgr2=0x7fefac0aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.509+0000 7fefb2797700 1 -- 172.21.15.84:0/1143104494 shutdown_connections 2023-08-31T02:00:21.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.516+0000 7f3653fff700 1 -- 172.21.15.84:0/3487400353 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3660053790 con 0x7f3654004850 2023-08-31T02:00:21.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.509+0000 7fefb2797700 1 -- 172.21.15.84:0/1143104494 wait complete. 2023-08-31T02:00:21.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.511+0000 7fefb2797700 1 Processor -- start 2023-08-31T02:00:21.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.520+0000 7fefb2797700 1 -- start start 2023-08-31T02:00:21.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.521+0000 7fefb2797700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefac06ac20 0x7fefac13e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.521+0000 7fefb2797700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefac06b000 0x7fefac1fe410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.521+0000 7fefb2797700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac0c7ef0 0x7fefac15d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.521+0000 7fefb2797700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac06f730 con 0x7fefac06ac20 2023-08-31T02:00:21.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.521+0000 7fefb2797700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0cb6d0 con 0x7fefac06b000 2023-08-31T02:00:21.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.521+0000 7fefb2797700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac06a330 con 0x7fefac0c7ef0 2023-08-31T02:00:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefac06b000 0x7fefac1fe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefac06b000 0x7fefac1fe410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55408/0 (socket says 172.21.15.84:55408) 2023-08-31T02:00:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 -- 172.21.15.84:0/2533605264 learned_addr learned my addr 172.21.15.84:0/2533605264 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefabfff700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefac06ac20 0x7fefac13e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefb0d34700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac0c7ef0 0x7fefac15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 -- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac0c7ef0 msgr2=0x7fefac15d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac0c7ef0 0x7fefac15d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 -- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefac06ac20 msgr2=0x7fefac13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefac06ac20 0x7fefac13e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 -- 172.21.15.84:0/2533605264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00094c0 con 0x7fefac06b000 2023-08-31T02:00:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.522+0000 7fefab7fe700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefac06b000 0x7fefac1fe410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fefa0000c00 tx=0x7fefa0004260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.529+0000 7fefb0d34700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac0c7ef0 0x7fefac15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.529+0000 7fefa8ff9700 1 -- 172.21.15.84:0/2533605264 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa001d070 con 0x7fefac06b000 2023-08-31T02:00:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.529+0000 7fefa8ff9700 1 -- 172.21.15.84:0/2533605264 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fefa0004a40 con 0x7fefac06b000 2023-08-31T02:00:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.529+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac15f7a0 con 0x7fefac06b000 2023-08-31T02:00:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.529+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac155390 con 0x7fefac06b000 2023-08-31T02:00:21.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.529+0000 7fefa8ff9700 1 -- 172.21.15.84:0/2533605264 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0004e50 con 0x7fefac06b000 2023-08-31T02:00:21.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.531+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef880052f0 con 0x7fefac06b000 2023-08-31T02:00:21.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.533+0000 7fefa8ff9700 1 -- 172.21.15.84:0/2533605264 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fefa00429e0 con 0x7fefac06b000 2023-08-31T02:00:21.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.534+0000 7fefa8ff9700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef9006a180 0x7fef9006c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:21.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.534+0000 7fefa8ff9700 1 -- 172.21.15.84:0/2533605264 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fefa0089e80 con 0x7fefac06b000 2023-08-31T02:00:21.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.534+0000 7fefabfff700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef9006a180 0x7fef9006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:21.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.535+0000 7fefabfff700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef9006a180 0x7fef9006c640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefa400f540 tx=0x7fefa400b040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:21.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.537+0000 7fefa8ff9700 1 -- 172.21.15.84:0/2533605264 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fefa00553e0 con 0x7fefac06b000 2023-08-31T02:00:21.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.776+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa484005160 con 0x7fa4a815c930 2023-08-31T02:00:21.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.777+0000 7fa4a4ff9700 1 -- 172.21.15.84:0/1738665843 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4a003d020 con 0x7fa4a815c930 2023-08-31T02:00:21.771 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-08-31T02:00:21.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa49006a1f0 msgr2=0x7fa49006c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa49006a1f0 0x7fa49006c6b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa498007fd0 tx=0x7fa498009040 comp rx=0 tx=0).stop 2023-08-31T02:00:21.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a815c930 msgr2=0x7fa4a815cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a815c930 0x7fa4a815cde0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0023000 tx=0x7fa4a00077f0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 shutdown_connections 2023-08-31T02:00:21.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa49006a1f0 0x7fa49006c6b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a815c930 0x7fa4a815cde0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806ac20 0x7fa4a80b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 --2- 172.21.15.84:0/1738665843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a806b000 0x7fa4a81399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 >> 172.21.15.84:0/1738665843 conn(0x7fa4a80aea80 msgr2=0x7fa4a80ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.781+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 shutdown_connections 2023-08-31T02:00:21.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.782+0000 7fa4ae96a700 1 -- 172.21.15.84:0/1738665843 wait complete. 2023-08-31T02:00:21.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2023-08-31T02:00:21.796 DEBUG:teuthology.parallel:result is None 2023-08-31T02:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.817+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fadb40055a0 con 0x7fadb8003a00 2023-08-31T02:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.817+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1e98005870 con 0x7f1eb00b1170 2023-08-31T02:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.817+0000 7fadc27fc700 1 -- 172.21.15.84:0/29276802 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fadc4059000 con 0x7fadb8003a00 2023-08-31T02:00:21.810 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-08-31T02:00:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.818+0000 7f1ea6ffd700 1 -- 172.21.15.84:0/1144764169 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ea0053c60 con 0x7f1eb00b1170 2023-08-31T02:00:21.811 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-08-31T02:00:21.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.819+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fadb006a1e0 msgr2=0x7fadb006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.819+0000 7fadd40dd700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fadb006a1e0 0x7fadb006c6a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fadcc15b4f0 tx=0x7fadbc006800 comp rx=0 tx=0).stop 2023-08-31T02:00:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.819+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 msgr2=0x7fadcc151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.819+0000 7fadd40dd700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 0x7fadcc151280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fadc4014040 tx=0x7fadc4012960 comp rx=0 tx=0).stop 2023-08-31T02:00:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.820+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 shutdown_connections 2023-08-31T02:00:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.820+0000 7fadd40dd700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fadb006a1e0 0x7fadb006c6a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.820+0000 7fadd40dd700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc15ba70 0x7fadcc15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.820+0000 7fadd40dd700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb8003a00 0x7fadcc151280 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fadc4014040 tx=0x7fadc4012960 comp rx=0 tx=0).stop 2023-08-31T02:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.820+0000 7fadd40dd700 1 --2- 172.21.15.84:0/29276802 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0708e0 0x7fadcc13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.820+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 >> 172.21.15.84:0/29276802 conn(0x7fadcc0aea80 msgr2=0x7fadcc159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.821+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 shutdown_connections 2023-08-31T02:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.821+0000 7fadd40dd700 1 -- 172.21.15.84:0/29276802 wait complete. 2023-08-31T02:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.822+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e9c06a260 msgr2=0x7f1e9c06c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.822+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e9c06a260 0x7f1e9c06c720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1eac000c00 tx=0x7f1eac004750 comp rx=0 tx=0).stop 2023-08-31T02:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.822+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1eb00b1170 msgr2=0x7f1eb00c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.822+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1eb00b1170 0x7f1eb00c44e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009fd0 tx=0x7f1ea000b770 comp rx=0 tx=0).stop 2023-08-31T02:00:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.829+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 shutdown_connections 2023-08-31T02:00:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.829+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e9c06a260 0x7f1e9c06c720 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.829+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb00ceb50 0x7f1eb0136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.829+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eb00b0d90 0x7f1eb00c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.829+0000 7f1eb83e7700 1 --2- 172.21.15.84:0/1144764169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1eb00b1170 0x7f1eb00c44e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.829+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 >> 172.21.15.84:0/1144764169 conn(0x7f1eb0069fd0 msgr2=0x7f1eb01535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.829+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 shutdown_connections 2023-08-31T02:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.829+0000 7f1eb83e7700 1 -- 172.21.15.84:0/1144764169 wait complete. 2023-08-31T02:00:21.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.2 2023-08-31T02:00:21.828 DEBUG:teuthology.parallel:result is None 2023-08-31T02:00:21.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-08-31T02:00:21.835 DEBUG:teuthology.parallel:result is None 2023-08-31T02:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.852+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f44005870 con 0x7f2f4c005280 2023-08-31T02:00:21.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.852+0000 7f2f577fe700 1 -- 172.21.15.84:0/1621856672 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f58015120 con 0x7f2f4c005280 2023-08-31T02:00:21.845 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-08-31T02:00:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f4c06bcb0 msgr2=0x7f2f4c06e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f4c06bcb0 0x7f2f4c06e170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f500094f0 tx=0x7f2f50009040 comp rx=0 tx=0).stop 2023-08-31T02:00:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c005280 msgr2=0x7f2f6013fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c005280 0x7f2f6013fc50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800c450 tx=0x7f2f5800c760 comp rx=0 tx=0).stop 2023-08-31T02:00:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 shutdown_connections 2023-08-31T02:00:21.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f4c06bcb0 0x7f2f4c06e170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f600b2120 0x7f2f6015d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c005280 0x7f2f6013fc50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 --2- 172.21.15.84:0/1621856672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f600b1ca0 0x7f2f601404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 >> 172.21.15.84:0/1621856672 conn(0x7f2f600aea80 msgr2=0x7f2f6015b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 shutdown_connections 2023-08-31T02:00:21.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.856+0000 7f2f65291700 1 -- 172.21.15.84:0/1621856672 wait complete. 2023-08-31T02:00:21.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.861+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f366c04e7c0 con 0x7f3654004850 2023-08-31T02:00:21.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.862+0000 7f3653fff700 1 -- 172.21.15.84:0/3487400353 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3660015070 con 0x7f3654004850 2023-08-31T02:00:21.855 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-08-31T02:00:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.863+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f711404e7c0 con 0x7f71141414c0 2023-08-31T02:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f365806a0e0 msgr2=0x7f365806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f365806a0e0 0x7f365806c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f366c1310c0 tx=0x7f3664004ca0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 msgr2=0x7f366c0b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 0x7f366c0b1300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f366000b3e0 tx=0x7f366000b7a0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 shutdown_connections 2023-08-31T02:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f365806a0e0 0x7f365806c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f366c155a40 0x7f366c143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3654004850 0x7f366c0b1300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 --2- 172.21.15.84:0/3487400353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f366c131420 0x7f366c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 >> 172.21.15.84:0/3487400353 conn(0x7f366c0aea80 msgr2=0x7f366c14ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f71117fa700 1 -- 172.21.15.84:0/3008323370 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7104056a60 con 0x7f71141414c0 2023-08-31T02:00:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 shutdown_connections 2023-08-31T02:00:21.860 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-08-31T02:00:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.864+0000 7f3672169700 1 -- 172.21.15.84:0/3487400353 wait complete. 2023-08-31T02:00:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.867+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a130 msgr2=0x7f710006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.867+0000 7f711afe9700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a130 0x7f710006c5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f710c001fa0 tx=0x7f710c001630 comp rx=0 tx=0).stop 2023-08-31T02:00:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.867+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71141414c0 msgr2=0x7f711413dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.867+0000 7f711afe9700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71141414c0 0x7f711413dfa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f71140ca8a0 tx=0x7f710400ca50 comp rx=0 tx=0).stop 2023-08-31T02:00:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.868+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 shutdown_connections 2023-08-31T02:00:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.868+0000 7f711afe9700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a130 0x7f710006c5f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.868+0000 7f711afe9700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71141414c0 0x7f711413dfa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.868+0000 7f711afe9700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70fc004850 0x7f711413a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.868+0000 7f711afe9700 1 --2- 172.21.15.84:0/3008323370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71141fe220 0x7f7114140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.868+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 >> 172.21.15.84:0/3008323370 conn(0x7f71140aea80 msgr2=0x7f711413f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.869+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 shutdown_connections 2023-08-31T02:00:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.869+0000 7f711afe9700 1 -- 172.21.15.84:0/3008323370 wait complete. 2023-08-31T02:00:21.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.0 2023-08-31T02:00:21.865 DEBUG:teuthology.parallel:result is None 2023-08-31T02:00:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.874+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb36c06d380 con 0x7fb36c0b2370 2023-08-31T02:00:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.874+0000 7fb3697fa700 1 -- 172.21.15.84:0/1849725968 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb364056d30 con 0x7fb36c0b2370 2023-08-31T02:00:21.867 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-08-31T02:00:21.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.876+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb35806a0e0 msgr2=0x7fb35806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.876+0000 7fb37303b700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb35806a0e0 0x7fb35806c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb360006630 tx=0x7fb3600014b0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.876+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb36c0b2370 msgr2=0x7fb36c155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.876+0000 7fb37303b700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb36c0b2370 0x7fb36c155c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0cca50 tx=0x7fb36400c7b0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.877+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 shutdown_connections 2023-08-31T02:00:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.877+0000 7fb37303b700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb35806a0e0 0x7fb35806c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.877+0000 7fb37303b700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb36c0b2370 0x7fb36c155c40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.877+0000 7fb37303b700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb36c201360 0x7fb36c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.877+0000 7fb37303b700 1 --2- 172.21.15.84:0/1849725968 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb36c15c150 0x7fb36c0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.877+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 >> 172.21.15.84:0/1849725968 conn(0x7fb36c0aea80 msgr2=0x7fb36c0ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.877+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 shutdown_connections 2023-08-31T02:00:21.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.877+0000 7fb37303b700 1 -- 172.21.15.84:0/1849725968 wait complete. 2023-08-31T02:00:21.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.4 2023-08-31T02:00:21.873 DEBUG:teuthology.parallel:result is None 2023-08-31T02:00:21.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2023-08-31T02:00:21.876 DEBUG:teuthology.parallel:result is None 2023-08-31T02:00:21.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2023-08-31T02:00:21.883 DEBUG:teuthology.parallel:result is None 2023-08-31T02:00:21.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.904+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef88005160 con 0x7fefac06b000 2023-08-31T02:00:21.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.905+0000 7fefa8ff9700 1 -- 172.21.15.84:0/2533605264 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fefa005c020 con 0x7fefac06b000 2023-08-31T02:00:21.898 INFO:teuthology.orchestra.run.smithi084.stdout:64424509450 2023-08-31T02:00:21.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef9006a180 msgr2=0x7fef9006c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef9006a180 0x7fef9006c640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefa400f540 tx=0x7fefa400b040 comp rx=0 tx=0).stop 2023-08-31T02:00:21.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefac06b000 msgr2=0x7fefac1fe410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:21.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefac06b000 0x7fefac1fe410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fefa0000c00 tx=0x7fefa0004260 comp rx=0 tx=0).stop 2023-08-31T02:00:21.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 shutdown_connections 2023-08-31T02:00:21.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fef9006a180 0x7fef9006c640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefac0c7ef0 0x7fefac15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefac06ac20 0x7fefac13e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 --2- 172.21.15.84:0/2533605264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefac06b000 0x7fefac1fe410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:21.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 >> 172.21.15.84:0/2533605264 conn(0x7fefac0aea80 msgr2=0x7fefac0ad2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:21.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 shutdown_connections 2023-08-31T02:00:21.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:21.907+0000 7fefb2797700 1 -- 172.21.15.84:0/2533605264 wait complete. 2023-08-31T02:00:21.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.1 2023-08-31T02:00:21.912 DEBUG:teuthology.parallel:result is None 2023-08-31T02:00:21.912 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-31T02:00:21.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:00:22.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.082+0000 7fa4c52d0700 1 -- 172.21.15.84:0/415412046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a8004cd0 msgr2=0x7fa4a80050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.082+0000 7fa4c52d0700 1 --2- 172.21.15.84:0/415412046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a8004cd0 0x7fa4a80050d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006f40 tx=0x7fa4a8006990 comp rx=0 tx=0).stop 2023-08-31T02:00:22.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.082+0000 7fa4bf7fe700 1 -- 172.21.15.84:0/415412046 reap_dead start 2023-08-31T02:00:22.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.082+0000 7fa4c52d0700 1 -- 172.21.15.84:0/415412046 shutdown_connections 2023-08-31T02:00:22.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.082+0000 7fa4c52d0700 1 -- 172.21.15.84:0/415412046 >> 172.21.15.84:0/415412046 conn(0x7fa4c00699a0 msgr2=0x7fa4c0069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.082+0000 7fa4c52d0700 1 -- 172.21.15.84:0/415412046 shutdown_connections 2023-08-31T02:00:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.082+0000 7fa4c52d0700 1 -- 172.21.15.84:0/415412046 wait complete. 2023-08-31T02:00:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4c52d0700 1 Processor -- start 2023-08-31T02:00:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4c52d0700 1 -- start start 2023-08-31T02:00:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4c52d0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a8004cd0 0x7fa4c013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4c52d0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c0145210 0x7fa4c0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4c52d0700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c0157220 0x7fa4c015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4c52d0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01576d0 con 0x7fa4c0145210 2023-08-31T02:00:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4c52d0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0144200 con 0x7fa4a8004cd0 2023-08-31T02:00:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4c52d0700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0144450 con 0x7fa4c0157220 2023-08-31T02:00:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.084+0000 7fa4be7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c0145210 0x7fa4c0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4be7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c0145210 0x7fa4c0156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51778/0 (socket says 172.21.15.84:51778) 2023-08-31T02:00:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4be7fc700 1 -- 172.21.15.84:0/656002015 learned_addr learned my addr 172.21.15.84:0/656002015 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4be7fc700 1 -- 172.21.15.84:0/656002015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c0157220 msgr2=0x7fa4c015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4bf7fe700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c0157220 0x7fa4c015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4be7fc700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c0157220 0x7fa4c015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4be7fc700 1 -- 172.21.15.84:0/656002015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a8004cd0 msgr2=0x7fa4c013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4beffd700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a8004cd0 0x7fa4c013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4be7fc700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a8004cd0 0x7fa4c013d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4be7fc700 1 -- 172.21.15.84:0/656002015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0144730 con 0x7fa4c0145210 2023-08-31T02:00:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4be7fc700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c0145210 0x7fa4c0156ce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4003f60 tx=0x7fa4b4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4a77fe700 1 -- 172.21.15.84:0/656002015 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4011840 con 0x7fa4c0145210 2023-08-31T02:00:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4a77fe700 1 -- 172.21.15.84:0/656002015 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa4b40119a0 con 0x7fa4c0145210 2023-08-31T02:00:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c0144a10 con 0x7fa4c0145210 2023-08-31T02:00:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4a77fe700 1 -- 172.21.15.84:0/656002015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4011db0 con 0x7fa4c0145210 2023-08-31T02:00:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.085+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c013de70 con 0x7fa4c0145210 2023-08-31T02:00:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.086+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c0144f30 con 0x7fa4c0145210 2023-08-31T02:00:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.087+0000 7fa4a77fe700 1 -- 172.21.15.84:0/656002015 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa4b40103c0 con 0x7fa4c0145210 2023-08-31T02:00:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.087+0000 7fa4a77fe700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4ac06a110 0x7fa4ac06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.087+0000 7fa4a77fe700 1 -- 172.21.15.84:0/656002015 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4b4089700 con 0x7fa4c0145210 2023-08-31T02:00:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.087+0000 7fa4beffd700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4ac06a110 0x7fa4ac06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.087+0000 7fa4beffd700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4ac06a110 0x7fa4ac06c5d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006f40 tx=0x7fa4b000f000 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.091+0000 7fa4a77fe700 1 -- 172.21.15.84:0/656002015 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa4c0144f30 con 0x7fa4c0145210 2023-08-31T02:00:22.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.279+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4c0144f30 con 0x7fa4ac06a110 2023-08-31T02:00:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.288+0000 7fa4a77fe700 1 -- 172.21.15.84:0/656002015 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345244 (secure 0 0 0) 0x7fa4c0144f30 con 0x7fa4ac06a110 2023-08-31T02:00:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:22.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4ac06a110 msgr2=0x7fa4ac06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4ac06a110 0x7fa4ac06c5d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006f40 tx=0x7fa4b000f000 comp rx=0 tx=0).stop 2023-08-31T02:00:22.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c0145210 msgr2=0x7fa4c0156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c0145210 0x7fa4c0156ce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4003f60 tx=0x7fa4b4003f90 comp rx=0 tx=0).stop 2023-08-31T02:00:22.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 shutdown_connections 2023-08-31T02:00:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa4ac06a110 0x7fa4ac06c5d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c0157220 0x7fa4c015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a8004cd0 0x7fa4c013d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 --2- 172.21.15.84:0/656002015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c0145210 0x7fa4c0156ce0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 >> 172.21.15.84:0/656002015 conn(0x7fa4c00699a0 msgr2=0x7fa4c006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 shutdown_connections 2023-08-31T02:00:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.292+0000 7fa4c52d0700 1 -- 172.21.15.84:0/656002015 wait complete. 2023-08-31T02:00:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:00:22.300 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-08-31T02:00:21.054397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219532,"kb_used_data":3368,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755188,"statfs":{"total":773094113280,"available":772869312512,"internally_reserved":0,"allocated":3448832,"data_stored":2049616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002714"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181204+0000","last_change":"2023-08-31T01:59:59.153066+0000","last_active":"2023-08-31T02:00:03.181204+0000","last_peered":"2023-08-31T02:00:03.181204+0000","last_clean":"2023-08-31T02:00:03.181204+0000","last_became_active":"2023-08-31T01:59:59.152543+0000","last_became_peered":"2023-08-31T01:59:59.152543+0000","last_unstale":"2023-08-31T02:00:03.181204+0000","last_undegraded":"2023-08-31T02:00:03.181204+0000","last_fullsized":"2023-08-31T02:00:03.181204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:17.842126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183513+0000","last_change":"2023-08-31T01:59:59.132145+0000","last_active":"2023-08-31T02:00:03.183513+0000","last_peered":"2023-08-31T02:00:03.183513+0000","last_clean":"2023-08-31T02:00:03.183513+0000","last_became_active":"2023-08-31T01:59:59.131885+0000","last_became_peered":"2023-08-31T01:59:59.131885+0000","last_unstale":"2023-08-31T02:00:03.183513+0000","last_undegraded":"2023-08-31T02:00:03.183513+0000","last_fullsized":"2023-08-31T02:00:03.183513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169077+0000","last_change":"2023-08-31T01:59:59.131265+0000","last_active":"2023-08-31T02:00:03.169077+0000","last_peered":"2023-08-31T02:00:03.169077+0000","last_clean":"2023-08-31T02:00:03.169077+0000","last_became_active":"2023-08-31T01:59:59.130984+0000","last_became_peered":"2023-08-31T01:59:59.130984+0000","last_unstale":"2023-08-31T02:00:03.169077+0000","last_undegraded":"2023-08-31T02:00:03.169077+0000","last_fullsized":"2023-08-31T02:00:03.169077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:24:58.176806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162779+0000","last_change":"2023-08-31T01:59:59.142792+0000","last_active":"2023-08-31T02:00:03.162779+0000","last_peered":"2023-08-31T02:00:03.162779+0000","last_clean":"2023-08-31T02:00:03.162779+0000","last_became_active":"2023-08-31T01:59:59.142520+0000","last_became_peered":"2023-08-31T01:59:59.142520+0000","last_unstale":"2023-08-31T02:00:03.162779+0000","last_undegraded":"2023-08-31T02:00:03.162779+0000","last_fullsized":"2023-08-31T02:00:03.162779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:46.986597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180530+0000","last_change":"2023-08-31T01:59:59.140365+0000","last_active":"2023-08-31T02:00:03.180530+0000","last_peered":"2023-08-31T02:00:03.180530+0000","last_clean":"2023-08-31T02:00:03.180530+0000","last_became_active":"2023-08-31T01:59:59.140113+0000","last_became_peered":"2023-08-31T01:59:59.140113+0000","last_unstale":"2023-08-31T02:00:03.180530+0000","last_undegraded":"2023-08-31T02:00:03.180530+0000","last_fullsized":"2023-08-31T02:00:03.180530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:55:33.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163582+0000","last_change":"2023-08-31T01:59:59.134781+0000","last_active":"2023-08-31T02:00:03.163582+0000","last_peered":"2023-08-31T02:00:03.163582+0000","last_clean":"2023-08-31T02:00:03.163582+0000","last_became_active":"2023-08-31T01:59:59.134480+0000","last_became_peered":"2023-08-31T01:59:59.134480+0000","last_unstale":"2023-08-31T02:00:03.163582+0000","last_undegraded":"2023-08-31T02:00:03.163582+0000","last_fullsized":"2023-08-31T02:00:03.163582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:56:16.408773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181151+0000","last_change":"2023-08-31T01:59:59.138166+0000","last_active":"2023-08-31T02:00:03.181151+0000","last_peered":"2023-08-31T02:00:03.181151+0000","last_clean":"2023-08-31T02:00:03.181151+0000","last_became_active":"2023-08-31T01:59:59.137906+0000","last_became_peered":"2023-08-31T01:59:59.137906+0000","last_unstale":"2023-08-31T02:00:03.181151+0000","last_undegraded":"2023-08-31T02:00:03.181151+0000","last_fullsized":"2023-08-31T02:00:03.181151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:21:43.096879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162548+0000","last_change":"2023-08-31T01:59:59.139015+0000","last_active":"2023-08-31T02:00:03.162548+0000","last_peered":"2023-08-31T02:00:03.162548+0000","last_clean":"2023-08-31T02:00:03.162548+0000","last_became_active":"2023-08-31T01:59:59.138750+0000","last_became_peered":"2023-08-31T01:59:59.138750+0000","last_unstale":"2023-08-31T02:00:03.162548+0000","last_undegraded":"2023-08-31T02:00:03.162548+0000","last_fullsized":"2023-08-31T02:00:03.162548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:41:19.129611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181131+0000","last_change":"2023-08-31T01:59:59.148629+0000","last_active":"2023-08-31T02:00:03.181131+0000","last_peered":"2023-08-31T02:00:03.181131+0000","last_clean":"2023-08-31T02:00:03.181131+0000","last_became_active":"2023-08-31T01:59:59.148368+0000","last_became_peered":"2023-08-31T01:59:59.148368+0000","last_unstale":"2023-08-31T02:00:03.181131+0000","last_undegraded":"2023-08-31T02:00:03.181131+0000","last_fullsized":"2023-08-31T02:00:03.181131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:37:26.875580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170679+0000","last_change":"2023-08-31T01:59:59.146071+0000","last_active":"2023-08-31T02:00:03.170679+0000","last_peered":"2023-08-31T02:00:03.170679+0000","last_clean":"2023-08-31T02:00:03.170679+0000","last_became_active":"2023-08-31T01:59:59.141603+0000","last_became_peered":"2023-08-31T01:59:59.141603+0000","last_unstale":"2023-08-31T02:00:03.170679+0000","last_undegraded":"2023-08-31T02:00:03.170679+0000","last_fullsized":"2023-08-31T02:00:03.170679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:55:33.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171222+0000","last_change":"2023-08-31T01:59:59.146296+0000","last_active":"2023-08-31T02:00:03.171222+0000","last_peered":"2023-08-31T02:00:03.171222+0000","last_clean":"2023-08-31T02:00:03.171222+0000","last_became_active":"2023-08-31T01:59:59.143079+0000","last_became_peered":"2023-08-31T01:59:59.143079+0000","last_unstale":"2023-08-31T02:00:03.171222+0000","last_undegraded":"2023-08-31T02:00:03.171222+0000","last_fullsized":"2023-08-31T02:00:03.171222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:21:43.096879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167674+0000","last_change":"2023-08-31T01:59:59.144579+0000","last_active":"2023-08-31T02:00:03.167674+0000","last_peered":"2023-08-31T02:00:03.167674+0000","last_clean":"2023-08-31T02:00:03.167674+0000","last_became_active":"2023-08-31T01:59:59.144144+0000","last_became_peered":"2023-08-31T01:59:59.144144+0000","last_unstale":"2023-08-31T02:00:03.167674+0000","last_undegraded":"2023-08-31T02:00:03.167674+0000","last_fullsized":"2023-08-31T02:00:03.167674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:41.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162134+0000","last_change":"2023-08-31T01:59:59.153550+0000","last_active":"2023-08-31T02:00:03.162134+0000","last_peered":"2023-08-31T02:00:03.162134+0000","last_clean":"2023-08-31T02:00:03.162134+0000","last_became_active":"2023-08-31T01:59:59.153324+0000","last_became_peered":"2023-08-31T01:59:59.153324+0000","last_unstale":"2023-08-31T02:00:03.162134+0000","last_undegraded":"2023-08-31T02:00:03.162134+0000","last_fullsized":"2023-08-31T02:00:03.162134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:02:02.199676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167186+0000","last_change":"2023-08-31T01:59:59.140970+0000","last_active":"2023-08-31T02:00:03.167186+0000","last_peered":"2023-08-31T02:00:03.167186+0000","last_clean":"2023-08-31T02:00:03.167186+0000","last_became_active":"2023-08-31T01:59:59.140228+0000","last_became_peered":"2023-08-31T01:59:59.140228+0000","last_unstale":"2023-08-31T02:00:03.167186+0000","last_undegraded":"2023-08-31T02:00:03.167186+0000","last_fullsized":"2023-08-31T02:00:03.167186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:28.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181691+0000","last_change":"2023-08-31T01:59:59.134845+0000","last_active":"2023-08-31T02:00:03.181691+0000","last_peered":"2023-08-31T02:00:03.181691+0000","last_clean":"2023-08-31T02:00:03.181691+0000","last_became_active":"2023-08-31T01:59:59.134582+0000","last_became_peered":"2023-08-31T01:59:59.134582+0000","last_unstale":"2023-08-31T02:00:03.181691+0000","last_undegraded":"2023-08-31T02:00:03.181691+0000","last_fullsized":"2023-08-31T02:00:03.181691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162420+0000","last_change":"2023-08-31T01:59:59.129553+0000","last_active":"2023-08-31T02:00:03.162420+0000","last_peered":"2023-08-31T02:00:03.162420+0000","last_clean":"2023-08-31T02:00:03.162420+0000","last_became_active":"2023-08-31T01:59:59.129229+0000","last_became_peered":"2023-08-31T01:59:59.129229+0000","last_unstale":"2023-08-31T02:00:03.162420+0000","last_undegraded":"2023-08-31T02:00:03.162420+0000","last_fullsized":"2023-08-31T02:00:03.162420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:23:18.368239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163287+0000","last_change":"2023-08-31T01:59:59.143663+0000","last_active":"2023-08-31T02:00:03.163287+0000","last_peered":"2023-08-31T02:00:03.163287+0000","last_clean":"2023-08-31T02:00:03.163287+0000","last_became_active":"2023-08-31T01:59:59.143284+0000","last_became_peered":"2023-08-31T01:59:59.143284+0000","last_unstale":"2023-08-31T02:00:03.163287+0000","last_undegraded":"2023-08-31T02:00:03.163287+0000","last_fullsized":"2023-08-31T02:00:03.163287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:57:18.747036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.173127+0000","last_change":"2023-08-31T01:59:59.149136+0000","last_active":"2023-08-31T02:00:03.173127+0000","last_peered":"2023-08-31T02:00:03.173127+0000","last_clean":"2023-08-31T02:00:03.173127+0000","last_became_active":"2023-08-31T01:59:59.148859+0000","last_became_peered":"2023-08-31T01:59:59.148859+0000","last_unstale":"2023-08-31T02:00:03.173127+0000","last_undegraded":"2023-08-31T02:00:03.173127+0000","last_fullsized":"2023-08-31T02:00:03.173127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:15.781174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180955+0000","last_change":"2023-08-31T01:59:59.140287+0000","last_active":"2023-08-31T02:00:03.180955+0000","last_peered":"2023-08-31T02:00:03.180955+0000","last_clean":"2023-08-31T02:00:03.180955+0000","last_became_active":"2023-08-31T01:59:59.140016+0000","last_became_peered":"2023-08-31T01:59:59.140016+0000","last_unstale":"2023-08-31T02:00:03.180955+0000","last_undegraded":"2023-08-31T02:00:03.180955+0000","last_fullsized":"2023-08-31T02:00:03.180955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:42:39.396804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163349+0000","last_change":"2023-08-31T02:00:03.192225+0000","last_active":"2023-08-31T02:00:04.163349+0000","last_peered":"2023-08-31T02:00:04.163349+0000","last_clean":"2023-08-31T02:00:04.163349+0000","last_became_active":"2023-08-31T02:00:03.191659+0000","last_became_peered":"2023-08-31T02:00:03.191659+0000","last_unstale":"2023-08-31T02:00:04.163349+0000","last_undegraded":"2023-08-31T02:00:04.163349+0000","last_fullsized":"2023-08-31T02:00:04.163349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:07.950758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169428+0000","last_change":"2023-08-31T01:59:58.142347+0000","last_active":"2023-08-31T02:00:03.169428+0000","last_peered":"2023-08-31T02:00:03.169428+0000","last_clean":"2023-08-31T02:00:03.169428+0000","last_became_active":"2023-08-31T01:59:58.142075+0000","last_became_peered":"2023-08-31T01:59:58.142075+0000","last_unstale":"2023-08-31T02:00:03.169428+0000","last_undegraded":"2023-08-31T02:00:03.169428+0000","last_fullsized":"2023-08-31T02:00:03.169428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164531+0000","last_change":"2023-08-31T01:59:59.154639+0000","last_active":"2023-08-31T02:00:03.164531+0000","last_peered":"2023-08-31T02:00:03.164531+0000","last_clean":"2023-08-31T02:00:03.164531+0000","last_became_active":"2023-08-31T01:59:59.154308+0000","last_became_peered":"2023-08-31T01:59:59.154308+0000","last_unstale":"2023-08-31T02:00:03.164531+0000","last_undegraded":"2023-08-31T02:00:03.164531+0000","last_fullsized":"2023-08-31T02:00:03.164531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:23:18.368239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163776+0000","last_change":"2023-08-31T02:00:03.188074+0000","last_active":"2023-08-31T02:00:04.163776+0000","last_peered":"2023-08-31T02:00:04.163776+0000","last_clean":"2023-08-31T02:00:04.163776+0000","last_became_active":"2023-08-31T02:00:03.187698+0000","last_became_peered":"2023-08-31T02:00:03.187698+0000","last_unstale":"2023-08-31T02:00:04.163776+0000","last_undegraded":"2023-08-31T02:00:04.163776+0000","last_fullsized":"2023-08-31T02:00:04.163776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:55:06.805698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164700+0000","last_change":"2023-08-31T01:59:58.132279+0000","last_active":"2023-08-31T02:00:03.164700+0000","last_peered":"2023-08-31T02:00:03.164700+0000","last_clean":"2023-08-31T02:00:03.164700+0000","last_became_active":"2023-08-31T01:59:58.132009+0000","last_became_peered":"2023-08-31T01:59:58.132009+0000","last_unstale":"2023-08-31T02:00:03.164700+0000","last_undegraded":"2023-08-31T02:00:03.164700+0000","last_fullsized":"2023-08-31T02:00:03.164700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:02:21.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169076+0000","last_change":"2023-08-31T01:59:59.135972+0000","last_active":"2023-08-31T02:00:03.169076+0000","last_peered":"2023-08-31T02:00:03.169076+0000","last_clean":"2023-08-31T02:00:03.169076+0000","last_became_active":"2023-08-31T01:59:59.135691+0000","last_became_peered":"2023-08-31T01:59:59.135691+0000","last_unstale":"2023-08-31T02:00:03.169076+0000","last_undegraded":"2023-08-31T02:00:03.169076+0000","last_fullsized":"2023-08-31T02:00:03.169076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:03.652877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164169+0000","last_change":"2023-08-31T02:00:03.192204+0000","last_active":"2023-08-31T02:00:04.164169+0000","last_peered":"2023-08-31T02:00:04.164169+0000","last_clean":"2023-08-31T02:00:04.164169+0000","last_became_active":"2023-08-31T02:00:03.191633+0000","last_became_peered":"2023-08-31T02:00:03.191633+0000","last_unstale":"2023-08-31T02:00:04.164169+0000","last_undegraded":"2023-08-31T02:00:04.164169+0000","last_fullsized":"2023-08-31T02:00:04.164169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180816+0000","last_change":"2023-08-31T01:59:58.143879+0000","last_active":"2023-08-31T02:00:03.180816+0000","last_peered":"2023-08-31T02:00:03.180816+0000","last_clean":"2023-08-31T02:00:03.180816+0000","last_became_active":"2023-08-31T01:59:58.143588+0000","last_became_peered":"2023-08-31T01:59:58.143588+0000","last_unstale":"2023-08-31T02:00:03.180816+0000","last_undegraded":"2023-08-31T02:00:03.180816+0000","last_fullsized":"2023-08-31T02:00:03.180816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:46.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162551+0000","last_change":"2023-08-31T01:59:59.136923+0000","last_active":"2023-08-31T02:00:03.162551+0000","last_peered":"2023-08-31T02:00:03.162551+0000","last_clean":"2023-08-31T02:00:03.162551+0000","last_became_active":"2023-08-31T01:59:59.136667+0000","last_became_peered":"2023-08-31T01:59:59.136667+0000","last_unstale":"2023-08-31T02:00:03.162551+0000","last_undegraded":"2023-08-31T02:00:03.162551+0000","last_fullsized":"2023-08-31T02:00:03.162551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:56:30.420963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163855+0000","last_change":"2023-08-31T02:00:03.174239+0000","last_active":"2023-08-31T02:00:04.163855+0000","last_peered":"2023-08-31T02:00:04.163855+0000","last_clean":"2023-08-31T02:00:04.163855+0000","last_became_active":"2023-08-31T02:00:03.173806+0000","last_became_peered":"2023-08-31T02:00:03.173806+0000","last_unstale":"2023-08-31T02:00:04.163855+0000","last_undegraded":"2023-08-31T02:00:04.163855+0000","last_fullsized":"2023-08-31T02:00:04.163855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:07.292454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180701+0000","last_change":"2023-08-31T01:59:58.142035+0000","last_active":"2023-08-31T02:00:03.180701+0000","last_peered":"2023-08-31T02:00:03.180701+0000","last_clean":"2023-08-31T02:00:03.180701+0000","last_became_active":"2023-08-31T01:59:58.141223+0000","last_became_peered":"2023-08-31T01:59:58.141223+0000","last_unstale":"2023-08-31T02:00:03.180701+0000","last_undegraded":"2023-08-31T02:00:03.180701+0000","last_fullsized":"2023-08-31T02:00:03.180701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:54:24.757437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163587+0000","last_change":"2023-08-31T01:59:59.135949+0000","last_active":"2023-08-31T02:00:03.163587+0000","last_peered":"2023-08-31T02:00:03.163587+0000","last_clean":"2023-08-31T02:00:03.163587+0000","last_became_active":"2023-08-31T01:59:59.135657+0000","last_became_peered":"2023-08-31T01:59:59.135657+0000","last_unstale":"2023-08-31T02:00:03.163587+0000","last_undegraded":"2023-08-31T02:00:03.163587+0000","last_fullsized":"2023-08-31T02:00:03.163587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:05:14.371221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163462+0000","last_change":"2023-08-31T02:00:03.197344+0000","last_active":"2023-08-31T02:00:04.163462+0000","last_peered":"2023-08-31T02:00:04.163462+0000","last_clean":"2023-08-31T02:00:04.163462+0000","last_became_active":"2023-08-31T02:00:03.196881+0000","last_became_peered":"2023-08-31T02:00:03.196881+0000","last_unstale":"2023-08-31T02:00:04.163462+0000","last_undegraded":"2023-08-31T02:00:04.163462+0000","last_fullsized":"2023-08-31T02:00:04.163462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:06:25.721250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162344+0000","last_change":"2023-08-31T01:59:58.141370+0000","last_active":"2023-08-31T02:00:03.162344+0000","last_peered":"2023-08-31T02:00:03.162344+0000","last_clean":"2023-08-31T02:00:03.162344+0000","last_became_active":"2023-08-31T01:59:58.141142+0000","last_became_peered":"2023-08-31T01:59:58.141142+0000","last_unstale":"2023-08-31T02:00:03.162344+0000","last_undegraded":"2023-08-31T02:00:03.162344+0000","last_fullsized":"2023-08-31T02:00:03.162344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:59:13.304994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167343+0000","last_change":"2023-08-31T01:59:59.142375+0000","last_active":"2023-08-31T02:00:03.167343+0000","last_peered":"2023-08-31T02:00:03.167343+0000","last_clean":"2023-08-31T02:00:03.167343+0000","last_became_active":"2023-08-31T01:59:59.142081+0000","last_became_peered":"2023-08-31T01:59:59.142081+0000","last_unstale":"2023-08-31T02:00:03.167343+0000","last_undegraded":"2023-08-31T02:00:03.167343+0000","last_fullsized":"2023-08-31T02:00:03.167343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:11.399572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.243672+0000","last_change":"2023-08-31T02:00:03.187642+0000","last_active":"2023-08-31T02:00:04.243672+0000","last_peered":"2023-08-31T02:00:04.243672+0000","last_clean":"2023-08-31T02:00:04.243672+0000","last_became_active":"2023-08-31T02:00:03.187241+0000","last_became_peered":"2023-08-31T02:00:03.187241+0000","last_unstale":"2023-08-31T02:00:04.243672+0000","last_undegraded":"2023-08-31T02:00:04.243672+0000","last_fullsized":"2023-08-31T02:00:04.243672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:02:06.236563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170304+0000","last_change":"2023-08-31T01:59:58.135240+0000","last_active":"2023-08-31T02:00:03.170304+0000","last_peered":"2023-08-31T02:00:03.170304+0000","last_clean":"2023-08-31T02:00:03.170304+0000","last_became_active":"2023-08-31T01:59:58.134970+0000","last_became_peered":"2023-08-31T01:59:58.134970+0000","last_unstale":"2023-08-31T02:00:03.170304+0000","last_undegraded":"2023-08-31T02:00:03.170304+0000","last_fullsized":"2023-08-31T02:00:03.170304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:27.460329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.168630+0000","last_change":"2023-08-31T01:59:59.136910+0000","last_active":"2023-08-31T02:00:03.168630+0000","last_peered":"2023-08-31T02:00:03.168630+0000","last_clean":"2023-08-31T02:00:03.168630+0000","last_became_active":"2023-08-31T01:59:59.136639+0000","last_became_peered":"2023-08-31T01:59:59.136639+0000","last_unstale":"2023-08-31T02:00:03.168630+0000","last_undegraded":"2023-08-31T02:00:03.168630+0000","last_fullsized":"2023-08-31T02:00:03.168630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242167+0000","last_change":"2023-08-31T02:00:03.191155+0000","last_active":"2023-08-31T02:00:04.242167+0000","last_peered":"2023-08-31T02:00:04.242167+0000","last_clean":"2023-08-31T02:00:04.242167+0000","last_became_active":"2023-08-31T02:00:03.190781+0000","last_became_peered":"2023-08-31T02:00:03.190781+0000","last_unstale":"2023-08-31T02:00:04.242167+0000","last_undegraded":"2023-08-31T02:00:04.242167+0000","last_fullsized":"2023-08-31T02:00:04.242167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161935+0000","last_change":"2023-08-31T01:59:58.136133+0000","last_active":"2023-08-31T02:00:03.161935+0000","last_peered":"2023-08-31T02:00:03.161935+0000","last_clean":"2023-08-31T02:00:03.161935+0000","last_became_active":"2023-08-31T01:59:58.135866+0000","last_became_peered":"2023-08-31T01:59:58.135866+0000","last_unstale":"2023-08-31T02:00:03.161935+0000","last_undegraded":"2023-08-31T02:00:03.161935+0000","last_fullsized":"2023-08-31T02:00:03.161935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:07:34.297167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161781+0000","last_change":"2023-08-31T01:59:59.137046+0000","last_active":"2023-08-31T02:00:03.161781+0000","last_peered":"2023-08-31T02:00:03.161781+0000","last_clean":"2023-08-31T02:00:03.161781+0000","last_became_active":"2023-08-31T01:59:59.136766+0000","last_became_peered":"2023-08-31T01:59:59.136766+0000","last_unstale":"2023-08-31T02:00:03.161781+0000","last_undegraded":"2023-08-31T02:00:03.161781+0000","last_fullsized":"2023-08-31T02:00:03.161781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:36.061031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242413+0000","last_change":"2023-08-31T02:00:03.185467+0000","last_active":"2023-08-31T02:00:04.242413+0000","last_peered":"2023-08-31T02:00:04.242413+0000","last_clean":"2023-08-31T02:00:04.242413+0000","last_became_active":"2023-08-31T02:00:03.185055+0000","last_became_peered":"2023-08-31T02:00:03.185055+0000","last_unstale":"2023-08-31T02:00:04.242413+0000","last_undegraded":"2023-08-31T02:00:04.242413+0000","last_fullsized":"2023-08-31T02:00:04.242413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:12:08.637395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163543+0000","last_change":"2023-08-31T01:59:58.135749+0000","last_active":"2023-08-31T02:00:03.163543+0000","last_peered":"2023-08-31T02:00:03.163543+0000","last_clean":"2023-08-31T02:00:03.163543+0000","last_became_active":"2023-08-31T01:59:58.134641+0000","last_became_peered":"2023-08-31T01:59:58.134641+0000","last_unstale":"2023-08-31T02:00:03.163543+0000","last_undegraded":"2023-08-31T02:00:03.163543+0000","last_fullsized":"2023-08-31T02:00:03.163543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:14.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181824+0000","last_change":"2023-08-31T01:59:59.139726+0000","last_active":"2023-08-31T02:00:03.181824+0000","last_peered":"2023-08-31T02:00:03.181824+0000","last_clean":"2023-08-31T02:00:03.181824+0000","last_became_active":"2023-08-31T01:59:59.139453+0000","last_became_peered":"2023-08-31T01:59:59.139453+0000","last_unstale":"2023-08-31T02:00:03.181824+0000","last_undegraded":"2023-08-31T02:00:03.181824+0000","last_fullsized":"2023-08-31T02:00:03.181824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163132+0000","last_change":"2023-08-31T02:00:03.188588+0000","last_active":"2023-08-31T02:00:04.163132+0000","last_peered":"2023-08-31T02:00:04.163132+0000","last_clean":"2023-08-31T02:00:04.163132+0000","last_became_active":"2023-08-31T02:00:03.187651+0000","last_became_peered":"2023-08-31T02:00:03.187651+0000","last_unstale":"2023-08-31T02:00:04.163132+0000","last_undegraded":"2023-08-31T02:00:04.163132+0000","last_fullsized":"2023-08-31T02:00:04.163132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:58:48.531393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171794+0000","last_change":"2023-08-31T01:59:58.137377+0000","last_active":"2023-08-31T02:00:03.171794+0000","last_peered":"2023-08-31T02:00:03.171794+0000","last_clean":"2023-08-31T02:00:03.171794+0000","last_became_active":"2023-08-31T01:59:58.137080+0000","last_became_peered":"2023-08-31T01:59:58.137080+0000","last_unstale":"2023-08-31T02:00:03.171794+0000","last_undegraded":"2023-08-31T02:00:03.171794+0000","last_fullsized":"2023-08-31T02:00:03.171794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:10.392703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163096+0000","last_change":"2023-08-31T01:59:59.138414+0000","last_active":"2023-08-31T02:00:03.163096+0000","last_peered":"2023-08-31T02:00:03.163096+0000","last_clean":"2023-08-31T02:00:03.163096+0000","last_became_active":"2023-08-31T01:59:59.138115+0000","last_became_peered":"2023-08-31T01:59:59.138115+0000","last_unstale":"2023-08-31T02:00:03.163096+0000","last_undegraded":"2023-08-31T02:00:03.163096+0000","last_fullsized":"2023-08-31T02:00:03.163096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:56:15.505917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163393+0000","last_change":"2023-08-31T02:00:03.177589+0000","last_active":"2023-08-31T02:00:04.163393+0000","last_peered":"2023-08-31T02:00:04.163393+0000","last_clean":"2023-08-31T02:00:04.163393+0000","last_became_active":"2023-08-31T02:00:03.177081+0000","last_became_peered":"2023-08-31T02:00:03.177081+0000","last_unstale":"2023-08-31T02:00:04.163393+0000","last_undegraded":"2023-08-31T02:00:04.163393+0000","last_fullsized":"2023-08-31T02:00:04.163393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:45:19.479655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162995+0000","last_change":"2023-08-31T01:59:58.136589+0000","last_active":"2023-08-31T02:00:03.162995+0000","last_peered":"2023-08-31T02:00:03.162995+0000","last_clean":"2023-08-31T02:00:03.162995+0000","last_became_active":"2023-08-31T01:59:58.136034+0000","last_became_peered":"2023-08-31T01:59:58.136034+0000","last_unstale":"2023-08-31T02:00:03.162995+0000","last_undegraded":"2023-08-31T02:00:03.162995+0000","last_fullsized":"2023-08-31T02:00:03.162995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:19:36.193451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169329+0000","last_change":"2023-08-31T01:59:59.131747+0000","last_active":"2023-08-31T02:00:03.169329+0000","last_peered":"2023-08-31T02:00:03.169329+0000","last_clean":"2023-08-31T02:00:03.169329+0000","last_became_active":"2023-08-31T01:59:59.131269+0000","last_became_peered":"2023-08-31T01:59:59.131269+0000","last_unstale":"2023-08-31T02:00:03.169329+0000","last_undegraded":"2023-08-31T02:00:03.169329+0000","last_fullsized":"2023-08-31T02:00:03.169329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164576+0000","last_change":"2023-08-31T02:00:03.191728+0000","last_active":"2023-08-31T02:00:04.164576+0000","last_peered":"2023-08-31T02:00:04.164576+0000","last_clean":"2023-08-31T02:00:04.164576+0000","last_became_active":"2023-08-31T02:00:03.191327+0000","last_became_peered":"2023-08-31T02:00:03.191327+0000","last_unstale":"2023-08-31T02:00:04.164576+0000","last_undegraded":"2023-08-31T02:00:04.164576+0000","last_fullsized":"2023-08-31T02:00:04.164576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183416+0000","last_change":"2023-08-31T01:59:58.138090+0000","last_active":"2023-08-31T02:00:03.183416+0000","last_peered":"2023-08-31T02:00:03.183416+0000","last_clean":"2023-08-31T02:00:03.183416+0000","last_became_active":"2023-08-31T01:59:58.137733+0000","last_became_peered":"2023-08-31T01:59:58.137733+0000","last_unstale":"2023-08-31T02:00:03.183416+0000","last_undegraded":"2023-08-31T02:00:03.183416+0000","last_fullsized":"2023-08-31T02:00:03.183416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167635+0000","last_change":"2023-08-31T01:59:59.139493+0000","last_active":"2023-08-31T02:00:03.167635+0000","last_peered":"2023-08-31T02:00:03.167635+0000","last_clean":"2023-08-31T02:00:03.167635+0000","last_became_active":"2023-08-31T01:59:59.139019+0000","last_became_peered":"2023-08-31T01:59:59.139019+0000","last_unstale":"2023-08-31T02:00:03.167635+0000","last_undegraded":"2023-08-31T02:00:03.167635+0000","last_fullsized":"2023-08-31T02:00:03.167635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:50:02.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241935+0000","last_change":"2023-08-31T02:00:03.184119+0000","last_active":"2023-08-31T02:00:04.241935+0000","last_peered":"2023-08-31T02:00:04.241935+0000","last_clean":"2023-08-31T02:00:04.241935+0000","last_became_active":"2023-08-31T02:00:03.183557+0000","last_became_peered":"2023-08-31T02:00:03.183557+0000","last_unstale":"2023-08-31T02:00:04.241935+0000","last_undegraded":"2023-08-31T02:00:04.241935+0000","last_fullsized":"2023-08-31T02:00:04.241935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:08.828471+0000","last_change":"2023-08-31T01:59:58.138549+0000","last_active":"2023-08-31T02:00:08.828471+0000","last_peered":"2023-08-31T02:00:08.828471+0000","last_clean":"2023-08-31T02:00:08.828471+0000","last_became_active":"2023-08-31T01:59:58.138254+0000","last_became_peered":"2023-08-31T01:59:58.138254+0000","last_unstale":"2023-08-31T02:00:08.828471+0000","last_undegraded":"2023-08-31T02:00:08.828471+0000","last_fullsized":"2023-08-31T02:00:08.828471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180911+0000","last_change":"2023-08-31T01:59:59.147840+0000","last_active":"2023-08-31T02:00:03.180911+0000","last_peered":"2023-08-31T02:00:03.180911+0000","last_clean":"2023-08-31T02:00:03.180911+0000","last_became_active":"2023-08-31T01:59:59.144815+0000","last_became_peered":"2023-08-31T01:59:59.144815+0000","last_unstale":"2023-08-31T02:00:03.180911+0000","last_undegraded":"2023-08-31T02:00:03.180911+0000","last_fullsized":"2023-08-31T02:00:03.180911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:36:25.930421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.165604+0000","last_change":"2023-08-31T02:00:03.184326+0000","last_active":"2023-08-31T02:00:04.165604+0000","last_peered":"2023-08-31T02:00:04.165604+0000","last_clean":"2023-08-31T02:00:04.165604+0000","last_became_active":"2023-08-31T02:00:03.183699+0000","last_became_peered":"2023-08-31T02:00:03.183699+0000","last_unstale":"2023-08-31T02:00:04.165604+0000","last_undegraded":"2023-08-31T02:00:04.165604+0000","last_fullsized":"2023-08-31T02:00:04.165604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:06:25.721250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169606+0000","last_change":"2023-08-31T01:59:58.135348+0000","last_active":"2023-08-31T02:00:03.169606+0000","last_peered":"2023-08-31T02:00:03.169606+0000","last_clean":"2023-08-31T02:00:03.169606+0000","last_became_active":"2023-08-31T01:59:58.135066+0000","last_became_peered":"2023-08-31T01:59:58.135066+0000","last_unstale":"2023-08-31T02:00:03.169606+0000","last_undegraded":"2023-08-31T02:00:03.169606+0000","last_fullsized":"2023-08-31T02:00:03.169606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:32:56.077806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167015+0000","last_change":"2023-08-31T01:59:59.138162+0000","last_active":"2023-08-31T02:00:03.167015+0000","last_peered":"2023-08-31T02:00:03.167015+0000","last_clean":"2023-08-31T02:00:03.167015+0000","last_became_active":"2023-08-31T01:59:59.137839+0000","last_became_peered":"2023-08-31T01:59:59.137839+0000","last_unstale":"2023-08-31T02:00:03.167015+0000","last_undegraded":"2023-08-31T02:00:03.167015+0000","last_fullsized":"2023-08-31T02:00:03.167015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:47.845392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163987+0000","last_change":"2023-08-31T02:00:03.191406+0000","last_active":"2023-08-31T02:00:04.163987+0000","last_peered":"2023-08-31T02:00:04.163987+0000","last_clean":"2023-08-31T02:00:04.163987+0000","last_became_active":"2023-08-31T02:00:03.188162+0000","last_became_peered":"2023-08-31T02:00:03.188162+0000","last_unstale":"2023-08-31T02:00:04.163987+0000","last_undegraded":"2023-08-31T02:00:04.163987+0000","last_fullsized":"2023-08-31T02:00:04.163987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:47:44.042063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162984+0000","last_change":"2023-08-31T01:59:58.131639+0000","last_active":"2023-08-31T02:00:03.162984+0000","last_peered":"2023-08-31T02:00:03.162984+0000","last_clean":"2023-08-31T02:00:03.162984+0000","last_became_active":"2023-08-31T01:59:58.131381+0000","last_became_peered":"2023-08-31T01:59:58.131381+0000","last_unstale":"2023-08-31T02:00:03.162984+0000","last_undegraded":"2023-08-31T02:00:03.162984+0000","last_fullsized":"2023-08-31T02:00:03.162984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:35.054161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180639+0000","last_change":"2023-08-31T01:59:59.148855+0000","last_active":"2023-08-31T02:00:03.180639+0000","last_peered":"2023-08-31T02:00:03.180639+0000","last_clean":"2023-08-31T02:00:03.180639+0000","last_became_active":"2023-08-31T01:59:59.148596+0000","last_became_peered":"2023-08-31T01:59:59.148596+0000","last_unstale":"2023-08-31T02:00:03.180639+0000","last_undegraded":"2023-08-31T02:00:03.180639+0000","last_fullsized":"2023-08-31T02:00:03.180639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:09:06.788463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163483+0000","last_change":"2023-08-31T02:00:03.188719+0000","last_active":"2023-08-31T02:00:04.163483+0000","last_peered":"2023-08-31T02:00:04.163483+0000","last_clean":"2023-08-31T02:00:04.163483+0000","last_became_active":"2023-08-31T02:00:03.188370+0000","last_became_peered":"2023-08-31T02:00:03.188370+0000","last_unstale":"2023-08-31T02:00:04.163483+0000","last_undegraded":"2023-08-31T02:00:04.163483+0000","last_fullsized":"2023-08-31T02:00:04.163483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:47:24.148482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170323+0000","last_change":"2023-08-31T01:59:58.139072+0000","last_active":"2023-08-31T02:00:03.170323+0000","last_peered":"2023-08-31T02:00:03.170323+0000","last_clean":"2023-08-31T02:00:03.170323+0000","last_became_active":"2023-08-31T01:59:58.138813+0000","last_became_peered":"2023-08-31T01:59:58.138813+0000","last_unstale":"2023-08-31T02:00:03.170323+0000","last_undegraded":"2023-08-31T02:00:03.170323+0000","last_fullsized":"2023-08-31T02:00:03.170323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:54:24.757437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170141+0000","last_change":"2023-08-31T01:59:59.141198+0000","last_active":"2023-08-31T02:00:03.170141+0000","last_peered":"2023-08-31T02:00:03.170141+0000","last_clean":"2023-08-31T02:00:03.170141+0000","last_became_active":"2023-08-31T01:59:59.140699+0000","last_became_peered":"2023-08-31T01:59:59.140699+0000","last_unstale":"2023-08-31T02:00:03.170141+0000","last_undegraded":"2023-08-31T02:00:03.170141+0000","last_fullsized":"2023-08-31T02:00:03.170141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:20:43.299746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242253+0000","last_change":"2023-08-31T02:00:03.179770+0000","last_active":"2023-08-31T02:00:04.242253+0000","last_peered":"2023-08-31T02:00:04.242253+0000","last_clean":"2023-08-31T02:00:04.242253+0000","last_became_active":"2023-08-31T02:00:03.179411+0000","last_became_peered":"2023-08-31T02:00:03.179411+0000","last_unstale":"2023-08-31T02:00:04.242253+0000","last_undegraded":"2023-08-31T02:00:04.242253+0000","last_fullsized":"2023-08-31T02:00:04.242253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171952+0000","last_change":"2023-08-31T01:59:58.137410+0000","last_active":"2023-08-31T02:00:03.171952+0000","last_peered":"2023-08-31T02:00:03.171952+0000","last_clean":"2023-08-31T02:00:03.171952+0000","last_became_active":"2023-08-31T01:59:58.137142+0000","last_became_peered":"2023-08-31T01:59:58.137142+0000","last_unstale":"2023-08-31T02:00:03.171952+0000","last_undegraded":"2023-08-31T02:00:03.171952+0000","last_fullsized":"2023-08-31T02:00:03.171952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:08:55.972594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181767+0000","last_change":"2023-08-31T01:59:59.144857+0000","last_active":"2023-08-31T02:00:03.181767+0000","last_peered":"2023-08-31T02:00:03.181767+0000","last_clean":"2023-08-31T02:00:03.181767+0000","last_became_active":"2023-08-31T01:59:59.144565+0000","last_became_peered":"2023-08-31T01:59:59.144565+0000","last_unstale":"2023-08-31T02:00:03.181767+0000","last_undegraded":"2023-08-31T02:00:03.181767+0000","last_fullsized":"2023-08-31T02:00:03.181767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:20:43.299746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163679+0000","last_change":"2023-08-31T02:00:03.188428+0000","last_active":"2023-08-31T02:00:04.163679+0000","last_peered":"2023-08-31T02:00:04.163679+0000","last_clean":"2023-08-31T02:00:04.163679+0000","last_became_active":"2023-08-31T02:00:03.188066+0000","last_became_peered":"2023-08-31T02:00:03.188066+0000","last_unstale":"2023-08-31T02:00:04.163679+0000","last_undegraded":"2023-08-31T02:00:04.163679+0000","last_fullsized":"2023-08-31T02:00:04.163679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:09:10.825351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167768+0000","last_change":"2023-08-31T01:59:58.135253+0000","last_active":"2023-08-31T02:00:03.167768+0000","last_peered":"2023-08-31T02:00:03.167768+0000","last_clean":"2023-08-31T02:00:03.167768+0000","last_became_active":"2023-08-31T01:59:58.134921+0000","last_became_peered":"2023-08-31T01:59:58.134921+0000","last_unstale":"2023-08-31T02:00:03.167768+0000","last_undegraded":"2023-08-31T02:00:03.167768+0000","last_fullsized":"2023-08-31T02:00:03.167768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180877+0000","last_change":"2023-08-31T01:59:59.145059+0000","last_active":"2023-08-31T02:00:03.180877+0000","last_peered":"2023-08-31T02:00:03.180877+0000","last_clean":"2023-08-31T02:00:03.180877+0000","last_became_active":"2023-08-31T01:59:59.144515+0000","last_became_peered":"2023-08-31T01:59:59.144515+0000","last_unstale":"2023-08-31T02:00:03.180877+0000","last_undegraded":"2023-08-31T02:00:03.180877+0000","last_fullsized":"2023-08-31T02:00:03.180877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:44:59.715888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241799+0000","last_change":"2023-08-31T02:00:03.183733+0000","last_active":"2023-08-31T02:00:04.241799+0000","last_peered":"2023-08-31T02:00:04.241799+0000","last_clean":"2023-08-31T02:00:04.241799+0000","last_became_active":"2023-08-31T02:00:03.182189+0000","last_became_peered":"2023-08-31T02:00:03.182189+0000","last_unstale":"2023-08-31T02:00:04.241799+0000","last_undegraded":"2023-08-31T02:00:04.241799+0000","last_fullsized":"2023-08-31T02:00:04.241799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181991+0000","last_change":"2023-08-31T01:59:58.137521+0000","last_active":"2023-08-31T02:00:03.181991+0000","last_peered":"2023-08-31T02:00:03.181991+0000","last_clean":"2023-08-31T02:00:03.181991+0000","last_became_active":"2023-08-31T01:59:58.137005+0000","last_became_peered":"2023-08-31T01:59:58.137005+0000","last_unstale":"2023-08-31T02:00:03.181991+0000","last_undegraded":"2023-08-31T02:00:03.181991+0000","last_fullsized":"2023-08-31T02:00:03.181991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:46.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163694+0000","last_change":"2023-08-31T01:59:59.146679+0000","last_active":"2023-08-31T02:00:03.163694+0000","last_peered":"2023-08-31T02:00:03.163694+0000","last_clean":"2023-08-31T02:00:03.163694+0000","last_became_active":"2023-08-31T01:59:59.146349+0000","last_became_peered":"2023-08-31T01:59:59.146349+0000","last_unstale":"2023-08-31T02:00:03.163694+0000","last_undegraded":"2023-08-31T02:00:03.163694+0000","last_fullsized":"2023-08-31T02:00:03.163694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:16:30.278083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241357+0000","last_change":"2023-08-31T02:00:03.187301+0000","last_active":"2023-08-31T02:00:04.241357+0000","last_peered":"2023-08-31T02:00:04.241357+0000","last_clean":"2023-08-31T02:00:04.241357+0000","last_became_active":"2023-08-31T02:00:03.186919+0000","last_became_peered":"2023-08-31T02:00:03.186919+0000","last_unstale":"2023-08-31T02:00:04.241357+0000","last_undegraded":"2023-08-31T02:00:04.241357+0000","last_fullsized":"2023-08-31T02:00:04.241357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162774+0000","last_change":"2023-08-31T01:59:58.137889+0000","last_active":"2023-08-31T02:00:03.162774+0000","last_peered":"2023-08-31T02:00:03.162774+0000","last_clean":"2023-08-31T02:00:03.162774+0000","last_became_active":"2023-08-31T01:59:58.137474+0000","last_became_peered":"2023-08-31T01:59:58.137474+0000","last_unstale":"2023-08-31T02:00:03.162774+0000","last_undegraded":"2023-08-31T02:00:03.162774+0000","last_fullsized":"2023-08-31T02:00:03.162774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:58:27.973576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167300+0000","last_change":"2023-08-31T01:59:59.135054+0000","last_active":"2023-08-31T02:00:03.167300+0000","last_peered":"2023-08-31T02:00:03.167300+0000","last_clean":"2023-08-31T02:00:03.167300+0000","last_became_active":"2023-08-31T01:59:59.134692+0000","last_became_peered":"2023-08-31T01:59:59.134692+0000","last_unstale":"2023-08-31T02:00:03.167300+0000","last_undegraded":"2023-08-31T02:00:03.167300+0000","last_fullsized":"2023-08-31T02:00:03.167300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:11.423606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241980+0000","last_change":"2023-08-31T02:00:03.183047+0000","last_active":"2023-08-31T02:00:04.241980+0000","last_peered":"2023-08-31T02:00:04.241980+0000","last_clean":"2023-08-31T02:00:04.241980+0000","last_became_active":"2023-08-31T02:00:03.182647+0000","last_became_peered":"2023-08-31T02:00:03.182647+0000","last_unstale":"2023-08-31T02:00:04.241980+0000","last_undegraded":"2023-08-31T02:00:04.241980+0000","last_fullsized":"2023-08-31T02:00:04.241980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:12:08.637395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182207+0000","last_change":"2023-08-31T01:59:59.127102+0000","last_active":"2023-08-31T02:00:03.182207+0000","last_peered":"2023-08-31T02:00:03.182207+0000","last_clean":"2023-08-31T02:00:03.182207+0000","last_became_active":"2023-08-31T01:59:59.126795+0000","last_became_peered":"2023-08-31T01:59:59.126795+0000","last_unstale":"2023-08-31T02:00:03.182207+0000","last_undegraded":"2023-08-31T02:00:03.182207+0000","last_fullsized":"2023-08-31T02:00:03.182207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:03.652877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.172443+0000","last_change":"2023-08-31T01:59:58.128837+0000","last_active":"2023-08-31T02:00:03.172443+0000","last_peered":"2023-08-31T02:00:03.172443+0000","last_clean":"2023-08-31T02:00:03.172443+0000","last_became_active":"2023-08-31T01:59:58.128553+0000","last_became_peered":"2023-08-31T01:59:58.128553+0000","last_unstale":"2023-08-31T02:00:03.172443+0000","last_undegraded":"2023-08-31T02:00:03.172443+0000","last_fullsized":"2023-08-31T02:00:03.172443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:40:45.576262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242548+0000","last_change":"2023-08-31T02:00:03.183013+0000","last_active":"2023-08-31T02:00:04.242548+0000","last_peered":"2023-08-31T02:00:04.242548+0000","last_clean":"2023-08-31T02:00:04.242548+0000","last_became_active":"2023-08-31T02:00:03.182620+0000","last_became_peered":"2023-08-31T02:00:03.182620+0000","last_unstale":"2023-08-31T02:00:04.242548+0000","last_undegraded":"2023-08-31T02:00:04.242548+0000","last_fullsized":"2023-08-31T02:00:04.242548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162206+0000","last_change":"2023-08-31T01:59:59.135012+0000","last_active":"2023-08-31T02:00:03.162206+0000","last_peered":"2023-08-31T02:00:03.162206+0000","last_clean":"2023-08-31T02:00:03.162206+0000","last_became_active":"2023-08-31T01:59:59.134742+0000","last_became_peered":"2023-08-31T01:59:59.134742+0000","last_unstale":"2023-08-31T02:00:03.162206+0000","last_undegraded":"2023-08-31T02:00:03.162206+0000","last_fullsized":"2023-08-31T02:00:03.162206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:09:03.292169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163085+0000","last_change":"2023-08-31T01:59:58.133974+0000","last_active":"2023-08-31T02:00:03.163085+0000","last_peered":"2023-08-31T02:00:03.163085+0000","last_clean":"2023-08-31T02:00:03.163085+0000","last_became_active":"2023-08-31T01:59:58.133700+0000","last_became_peered":"2023-08-31T01:59:58.133700+0000","last_unstale":"2023-08-31T02:00:03.163085+0000","last_undegraded":"2023-08-31T02:00:03.163085+0000","last_fullsized":"2023-08-31T02:00:03.163085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:28:01.725513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180556+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:00:03.180556+0000","last_peered":"2023-08-31T02:00:03.180556+0000","last_clean":"2023-08-31T02:00:03.180556+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:00:03.180556+0000","last_undegraded":"2023-08-31T02:00:03.180556+0000","last_fullsized":"2023-08-31T02:00:03.180556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242374+0000","last_change":"2023-08-31T02:00:03.185255+0000","last_active":"2023-08-31T02:00:04.242374+0000","last_peered":"2023-08-31T02:00:04.242374+0000","last_clean":"2023-08-31T02:00:04.242374+0000","last_became_active":"2023-08-31T02:00:03.184861+0000","last_became_peered":"2023-08-31T02:00:03.184861+0000","last_unstale":"2023-08-31T02:00:04.242374+0000","last_undegraded":"2023-08-31T02:00:04.242374+0000","last_fullsized":"2023-08-31T02:00:04.242374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167610+0000","last_change":"2023-08-31T01:59:59.135368+0000","last_active":"2023-08-31T02:00:03.167610+0000","last_peered":"2023-08-31T02:00:03.167610+0000","last_clean":"2023-08-31T02:00:03.167610+0000","last_became_active":"2023-08-31T01:59:59.135074+0000","last_became_peered":"2023-08-31T01:59:59.135074+0000","last_unstale":"2023-08-31T02:00:03.167610+0000","last_undegraded":"2023-08-31T02:00:03.167610+0000","last_fullsized":"2023-08-31T02:00:03.167610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:41.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180603+0000","last_change":"2023-08-31T01:59:58.141143+0000","last_active":"2023-08-31T02:00:03.180603+0000","last_peered":"2023-08-31T02:00:03.180603+0000","last_clean":"2023-08-31T02:00:03.180603+0000","last_became_active":"2023-08-31T01:59:58.140680+0000","last_became_peered":"2023-08-31T01:59:58.140680+0000","last_unstale":"2023-08-31T02:00:03.180603+0000","last_undegraded":"2023-08-31T02:00:03.180603+0000","last_fullsized":"2023-08-31T02:00:03.180603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241818+0000","last_change":"2023-08-31T02:00:03.187482+0000","last_active":"2023-08-31T02:00:04.241818+0000","last_peered":"2023-08-31T02:00:04.241818+0000","last_clean":"2023-08-31T02:00:04.241818+0000","last_became_active":"2023-08-31T02:00:03.186856+0000","last_became_peered":"2023-08-31T02:00:03.186856+0000","last_unstale":"2023-08-31T02:00:04.241818+0000","last_undegraded":"2023-08-31T02:00:04.241818+0000","last_fullsized":"2023-08-31T02:00:04.241818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180775+0000","last_change":"2023-08-31T01:59:58.143295+0000","last_active":"2023-08-31T02:00:03.180775+0000","last_peered":"2023-08-31T02:00:03.180775+0000","last_clean":"2023-08-31T02:00:03.180775+0000","last_became_active":"2023-08-31T01:59:58.142985+0000","last_became_peered":"2023-08-31T01:59:58.142985+0000","last_unstale":"2023-08-31T02:00:03.180775+0000","last_undegraded":"2023-08-31T02:00:03.180775+0000","last_fullsized":"2023-08-31T02:00:03.180775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182106+0000","last_change":"2023-08-31T01:59:59.127832+0000","last_active":"2023-08-31T02:00:03.182106+0000","last_peered":"2023-08-31T02:00:03.182106+0000","last_clean":"2023-08-31T02:00:03.182106+0000","last_became_active":"2023-08-31T01:59:59.127564+0000","last_became_peered":"2023-08-31T01:59:59.127564+0000","last_unstale":"2023-08-31T02:00:03.182106+0000","last_undegraded":"2023-08-31T02:00:03.182106+0000","last_fullsized":"2023-08-31T02:00:03.182106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.162998+0000","last_change":"2023-08-31T02:00:03.191988+0000","last_active":"2023-08-31T02:00:04.162998+0000","last_peered":"2023-08-31T02:00:04.162998+0000","last_clean":"2023-08-31T02:00:04.162998+0000","last_became_active":"2023-08-31T02:00:03.191349+0000","last_became_peered":"2023-08-31T02:00:03.191349+0000","last_unstale":"2023-08-31T02:00:04.162998+0000","last_undegraded":"2023-08-31T02:00:04.162998+0000","last_fullsized":"2023-08-31T02:00:04.162998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:00:23.252798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183026+0000","last_change":"2023-08-31T01:59:58.138706+0000","last_active":"2023-08-31T02:00:03.183026+0000","last_peered":"2023-08-31T02:00:03.183026+0000","last_clean":"2023-08-31T02:00:03.183026+0000","last_became_active":"2023-08-31T01:59:58.138320+0000","last_became_peered":"2023-08-31T01:59:58.138320+0000","last_unstale":"2023-08-31T02:00:03.183026+0000","last_undegraded":"2023-08-31T02:00:03.183026+0000","last_fullsized":"2023-08-31T02:00:03.183026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:10.392703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164651+0000","last_change":"2023-08-31T01:59:59.144937+0000","last_active":"2023-08-31T02:00:03.164651+0000","last_peered":"2023-08-31T02:00:03.164651+0000","last_clean":"2023-08-31T02:00:03.164651+0000","last_became_active":"2023-08-31T01:59:59.144653+0000","last_became_peered":"2023-08-31T01:59:59.144653+0000","last_unstale":"2023-08-31T02:00:03.164651+0000","last_undegraded":"2023-08-31T02:00:03.164651+0000","last_fullsized":"2023-08-31T02:00:03.164651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:43:55.591253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163711+0000","last_change":"2023-08-31T02:00:03.185348+0000","last_active":"2023-08-31T02:00:04.163711+0000","last_peered":"2023-08-31T02:00:04.163711+0000","last_clean":"2023-08-31T02:00:04.163711+0000","last_became_active":"2023-08-31T02:00:03.184977+0000","last_became_peered":"2023-08-31T02:00:03.184977+0000","last_unstale":"2023-08-31T02:00:04.163711+0000","last_undegraded":"2023-08-31T02:00:04.163711+0000","last_fullsized":"2023-08-31T02:00:04.163711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:36:29.967309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171706+0000","last_change":"2023-08-31T01:59:58.142445+0000","last_active":"2023-08-31T02:00:03.171706+0000","last_peered":"2023-08-31T02:00:03.171706+0000","last_clean":"2023-08-31T02:00:03.171706+0000","last_became_active":"2023-08-31T01:59:58.142166+0000","last_became_peered":"2023-08-31T01:59:58.142166+0000","last_unstale":"2023-08-31T02:00:03.171706+0000","last_undegraded":"2023-08-31T02:00:03.171706+0000","last_fullsized":"2023-08-31T02:00:03.171706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170228+0000","last_change":"2023-08-31T01:59:59.139657+0000","last_active":"2023-08-31T02:00:03.170228+0000","last_peered":"2023-08-31T02:00:03.170228+0000","last_clean":"2023-08-31T02:00:03.170228+0000","last_became_active":"2023-08-31T01:59:59.139380+0000","last_became_peered":"2023-08-31T01:59:59.139380+0000","last_unstale":"2023-08-31T02:00:03.170228+0000","last_undegraded":"2023-08-31T02:00:03.170228+0000","last_fullsized":"2023-08-31T02:00:03.170228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164032+0000","last_change":"2023-08-31T02:00:03.187756+0000","last_active":"2023-08-31T02:00:04.164032+0000","last_peered":"2023-08-31T02:00:04.164032+0000","last_clean":"2023-08-31T02:00:04.164032+0000","last_became_active":"2023-08-31T02:00:03.187322+0000","last_became_peered":"2023-08-31T02:00:03.187322+0000","last_unstale":"2023-08-31T02:00:04.164032+0000","last_undegraded":"2023-08-31T02:00:04.164032+0000","last_fullsized":"2023-08-31T02:00:04.164032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:37:30.912467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180456+0000","last_change":"2023-08-31T01:59:58.143349+0000","last_active":"2023-08-31T02:00:03.180456+0000","last_peered":"2023-08-31T02:00:03.180456+0000","last_clean":"2023-08-31T02:00:03.180456+0000","last_became_active":"2023-08-31T01:59:58.143019+0000","last_became_peered":"2023-08-31T01:59:58.143019+0000","last_unstale":"2023-08-31T02:00:03.180456+0000","last_undegraded":"2023-08-31T02:00:03.180456+0000","last_fullsized":"2023-08-31T02:00:03.180456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:58:23.430586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167307+0000","last_change":"2023-08-31T01:59:59.137822+0000","last_active":"2023-08-31T02:00:03.167307+0000","last_peered":"2023-08-31T02:00:03.167307+0000","last_clean":"2023-08-31T02:00:03.167307+0000","last_became_active":"2023-08-31T01:59:59.137558+0000","last_became_peered":"2023-08-31T01:59:59.137558+0000","last_unstale":"2023-08-31T02:00:03.167307+0000","last_undegraded":"2023-08-31T02:00:03.167307+0000","last_fullsized":"2023-08-31T02:00:03.167307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:32:57.084676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242210+0000","last_change":"2023-08-31T02:00:03.182827+0000","last_active":"2023-08-31T02:00:04.242210+0000","last_peered":"2023-08-31T02:00:04.242210+0000","last_clean":"2023-08-31T02:00:04.242210+0000","last_became_active":"2023-08-31T02:00:03.182438+0000","last_became_peered":"2023-08-31T02:00:03.182438+0000","last_unstale":"2023-08-31T02:00:04.242210+0000","last_undegraded":"2023-08-31T02:00:04.242210+0000","last_fullsized":"2023-08-31T02:00:04.242210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:22:47.889737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182678+0000","last_change":"2023-08-31T01:59:58.142002+0000","last_active":"2023-08-31T02:00:03.182678+0000","last_peered":"2023-08-31T02:00:03.182678+0000","last_clean":"2023-08-31T02:00:03.182678+0000","last_became_active":"2023-08-31T01:59:58.141736+0000","last_became_peered":"2023-08-31T01:59:58.141736+0000","last_unstale":"2023-08-31T02:00:03.182678+0000","last_undegraded":"2023-08-31T02:00:03.182678+0000","last_fullsized":"2023-08-31T02:00:03.182678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:52.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161862+0000","last_change":"2023-08-31T01:59:59.141837+0000","last_active":"2023-08-31T02:00:03.161862+0000","last_peered":"2023-08-31T02:00:03.161862+0000","last_clean":"2023-08-31T02:00:03.161862+0000","last_became_active":"2023-08-31T01:59:59.141556+0000","last_became_peered":"2023-08-31T01:59:59.141556+0000","last_unstale":"2023-08-31T02:00:03.161862+0000","last_undegraded":"2023-08-31T02:00:03.161862+0000","last_fullsized":"2023-08-31T02:00:03.161862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:49:59.637746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164152+0000","last_change":"2023-08-31T02:00:03.189684+0000","last_active":"2023-08-31T02:00:04.164152+0000","last_peered":"2023-08-31T02:00:04.164152+0000","last_clean":"2023-08-31T02:00:04.164152+0000","last_became_active":"2023-08-31T02:00:03.187373+0000","last_became_peered":"2023-08-31T02:00:03.187373+0000","last_unstale":"2023-08-31T02:00:04.164152+0000","last_undegraded":"2023-08-31T02:00:04.164152+0000","last_fullsized":"2023-08-31T02:00:04.164152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:21.879013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182660+0000","last_change":"2023-08-31T01:59:58.136945+0000","last_active":"2023-08-31T02:00:03.182660+0000","last_peered":"2023-08-31T02:00:03.182660+0000","last_clean":"2023-08-31T02:00:03.182660+0000","last_became_active":"2023-08-31T01:59:58.136593+0000","last_became_peered":"2023-08-31T01:59:58.136593+0000","last_unstale":"2023-08-31T02:00:03.182660+0000","last_undegraded":"2023-08-31T02:00:03.182660+0000","last_fullsized":"2023-08-31T02:00:03.182660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:59:35.632366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162451+0000","last_change":"2023-08-31T01:59:59.137446+0000","last_active":"2023-08-31T02:00:03.162451+0000","last_peered":"2023-08-31T02:00:03.162451+0000","last_clean":"2023-08-31T02:00:03.162451+0000","last_became_active":"2023-08-31T01:59:59.137156+0000","last_became_peered":"2023-08-31T01:59:59.137156+0000","last_unstale":"2023-08-31T02:00:03.162451+0000","last_undegraded":"2023-08-31T02:00:03.162451+0000","last_fullsized":"2023-08-31T02:00:03.162451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:58:28.980446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164210+0000","last_change":"2023-08-31T02:00:03.186822+0000","last_active":"2023-08-31T02:00:04.164210+0000","last_peered":"2023-08-31T02:00:04.164210+0000","last_clean":"2023-08-31T02:00:04.164210+0000","last_became_active":"2023-08-31T02:00:03.186360+0000","last_became_peered":"2023-08-31T02:00:03.186360+0000","last_unstale":"2023-08-31T02:00:04.164210+0000","last_undegraded":"2023-08-31T02:00:04.164210+0000","last_fullsized":"2023-08-31T02:00:04.164210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180642+0000","last_change":"2023-08-31T01:59:58.144977+0000","last_active":"2023-08-31T02:00:03.180642+0000","last_peered":"2023-08-31T02:00:03.180642+0000","last_clean":"2023-08-31T02:00:03.180642+0000","last_became_active":"2023-08-31T01:59:58.144682+0000","last_became_peered":"2023-08-31T01:59:58.144682+0000","last_unstale":"2023-08-31T02:00:03.180642+0000","last_undegraded":"2023-08-31T02:00:03.180642+0000","last_fullsized":"2023-08-31T02:00:03.180642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:54:31.237887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170405+0000","last_change":"2023-08-31T01:59:59.145992+0000","last_active":"2023-08-31T02:00:03.170405+0000","last_peered":"2023-08-31T02:00:03.170405+0000","last_clean":"2023-08-31T02:00:03.170405+0000","last_became_active":"2023-08-31T01:59:59.142856+0000","last_became_peered":"2023-08-31T01:59:59.142856+0000","last_unstale":"2023-08-31T02:00:03.170405+0000","last_undegraded":"2023-08-31T02:00:03.170405+0000","last_fullsized":"2023-08-31T02:00:03.170405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241755+0000","last_change":"2023-08-31T02:00:03.189530+0000","last_active":"2023-08-31T02:00:04.241755+0000","last_peered":"2023-08-31T02:00:04.241755+0000","last_clean":"2023-08-31T02:00:04.241755+0000","last_became_active":"2023-08-31T02:00:03.189045+0000","last_became_peered":"2023-08-31T02:00:03.189045+0000","last_unstale":"2023-08-31T02:00:04.241755+0000","last_undegraded":"2023-08-31T02:00:04.241755+0000","last_fullsized":"2023-08-31T02:00:04.241755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.173234+0000","last_change":"2023-08-31T01:59:58.133537+0000","last_active":"2023-08-31T02:00:03.173234+0000","last_peered":"2023-08-31T02:00:03.173234+0000","last_clean":"2023-08-31T02:00:03.173234+0000","last_became_active":"2023-08-31T01:59:58.133222+0000","last_became_peered":"2023-08-31T01:59:58.133222+0000","last_unstale":"2023-08-31T02:00:03.173234+0000","last_undegraded":"2023-08-31T02:00:03.173234+0000","last_fullsized":"2023-08-31T02:00:03.173234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:17.281385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180864+0000","last_change":"2023-08-31T01:59:59.149486+0000","last_active":"2023-08-31T02:00:03.180864+0000","last_peered":"2023-08-31T02:00:03.180864+0000","last_clean":"2023-08-31T02:00:03.180864+0000","last_became_active":"2023-08-31T01:59:59.149195+0000","last_became_peered":"2023-08-31T01:59:59.149195+0000","last_unstale":"2023-08-31T02:00:03.180864+0000","last_undegraded":"2023-08-31T02:00:03.180864+0000","last_fullsized":"2023-08-31T02:00:03.180864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:55:02.768810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241656+0000","last_change":"2023-08-31T02:00:03.194590+0000","last_active":"2023-08-31T02:00:04.241656+0000","last_peered":"2023-08-31T02:00:04.241656+0000","last_clean":"2023-08-31T02:00:04.241656+0000","last_became_active":"2023-08-31T02:00:03.194028+0000","last_became_peered":"2023-08-31T02:00:03.194028+0000","last_unstale":"2023-08-31T02:00:04.241656+0000","last_undegraded":"2023-08-31T02:00:04.241656+0000","last_fullsized":"2023-08-31T02:00:04.241656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:21.879013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183319+0000","last_change":"2023-08-31T01:59:58.140223+0000","last_active":"2023-08-31T02:00:03.183319+0000","last_peered":"2023-08-31T02:00:03.183319+0000","last_clean":"2023-08-31T02:00:03.183319+0000","last_became_active":"2023-08-31T01:59:58.139966+0000","last_became_peered":"2023-08-31T01:59:58.139966+0000","last_unstale":"2023-08-31T02:00:03.183319+0000","last_undegraded":"2023-08-31T02:00:03.183319+0000","last_fullsized":"2023-08-31T02:00:03.183319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162651+0000","last_change":"2023-08-31T01:59:59.139152+0000","last_active":"2023-08-31T02:00:03.162651+0000","last_peered":"2023-08-31T02:00:03.162651+0000","last_clean":"2023-08-31T02:00:03.162651+0000","last_became_active":"2023-08-31T01:59:59.138887+0000","last_became_peered":"2023-08-31T01:59:59.138887+0000","last_unstale":"2023-08-31T02:00:03.162651+0000","last_undegraded":"2023-08-31T02:00:03.162651+0000","last_fullsized":"2023-08-31T02:00:03.162651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:35:52.979172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164612+0000","last_change":"2023-08-31T02:00:03.182923+0000","last_active":"2023-08-31T02:00:04.164612+0000","last_peered":"2023-08-31T02:00:04.164612+0000","last_clean":"2023-08-31T02:00:04.164612+0000","last_became_active":"2023-08-31T02:00:03.182486+0000","last_became_peered":"2023-08-31T02:00:03.182486+0000","last_unstale":"2023-08-31T02:00:04.164612+0000","last_undegraded":"2023-08-31T02:00:04.164612+0000","last_fullsized":"2023-08-31T02:00:04.164612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:45:19.479655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.176209+0000","last_change":"2023-08-31T01:59:58.130739+0000","last_active":"2023-08-31T02:00:03.176209+0000","last_peered":"2023-08-31T02:00:03.176209+0000","last_clean":"2023-08-31T02:00:03.176209+0000","last_became_active":"2023-08-31T01:59:58.130559+0000","last_became_peered":"2023-08-31T01:59:58.130559+0000","last_unstale":"2023-08-31T02:00:03.176209+0000","last_undegraded":"2023-08-31T02:00:03.176209+0000","last_fullsized":"2023-08-31T02:00:03.176209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:52:30.384278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181104+0000","last_change":"2023-08-31T01:59:59.149408+0000","last_active":"2023-08-31T02:00:03.181104+0000","last_peered":"2023-08-31T02:00:03.181104+0000","last_clean":"2023-08-31T02:00:03.181104+0000","last_became_active":"2023-08-31T01:59:59.149129+0000","last_became_peered":"2023-08-31T01:59:59.149129+0000","last_unstale":"2023-08-31T02:00:03.181104+0000","last_undegraded":"2023-08-31T02:00:03.181104+0000","last_fullsized":"2023-08-31T02:00:03.181104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:03.255566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171183+0000","last_change":"2023-08-31T01:59:59.141296+0000","last_active":"2023-08-31T02:00:03.171183+0000","last_peered":"2023-08-31T02:00:03.171183+0000","last_clean":"2023-08-31T02:00:03.171183+0000","last_became_active":"2023-08-31T01:59:59.141010+0000","last_became_peered":"2023-08-31T01:59:59.141010+0000","last_unstale":"2023-08-31T02:00:03.171183+0000","last_undegraded":"2023-08-31T02:00:03.171183+0000","last_fullsized":"2023-08-31T02:00:03.171183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.172411+0000","last_change":"2023-08-31T01:59:59.129754+0000","last_active":"2023-08-31T02:00:03.172411+0000","last_peered":"2023-08-31T02:00:03.172411+0000","last_clean":"2023-08-31T02:00:03.172411+0000","last_became_active":"2023-08-31T01:59:59.127954+0000","last_became_peered":"2023-08-31T01:59:59.127954+0000","last_unstale":"2023-08-31T02:00:03.172411+0000","last_undegraded":"2023-08-31T02:00:03.172411+0000","last_fullsized":"2023-08-31T02:00:03.172411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:19.243425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162957+0000","last_change":"2023-08-31T01:59:59.139684+0000","last_active":"2023-08-31T02:00:03.162957+0000","last_peered":"2023-08-31T02:00:03.162957+0000","last_clean":"2023-08-31T02:00:03.162957+0000","last_became_active":"2023-08-31T01:59:59.139233+0000","last_became_peered":"2023-08-31T01:59:59.139233+0000","last_unstale":"2023-08-31T02:00:03.162957+0000","last_undegraded":"2023-08-31T02:00:03.162957+0000","last_fullsized":"2023-08-31T02:00:03.162957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:50:06.678223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169434+0000","last_change":"2023-08-31T01:59:59.139203+0000","last_active":"2023-08-31T02:00:03.169434+0000","last_peered":"2023-08-31T02:00:03.169434+0000","last_clean":"2023-08-31T02:00:03.169434+0000","last_became_active":"2023-08-31T01:59:59.138931+0000","last_became_peered":"2023-08-31T01:59:59.138931+0000","last_unstale":"2023-08-31T02:00:03.169434+0000","last_undegraded":"2023-08-31T02:00:03.169434+0000","last_fullsized":"2023-08-31T02:00:03.169434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162361+0000","last_change":"2023-08-31T01:59:59.147334+0000","last_active":"2023-08-31T02:00:03.162361+0000","last_peered":"2023-08-31T02:00:03.162361+0000","last_clean":"2023-08-31T02:00:03.162361+0000","last_became_active":"2023-08-31T01:59:59.146910+0000","last_became_peered":"2023-08-31T01:59:59.146910+0000","last_unstale":"2023-08-31T02:00:03.162361+0000","last_undegraded":"2023-08-31T02:00:03.162361+0000","last_fullsized":"2023-08-31T02:00:03.162361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:56:16.408773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183223+0000","last_change":"2023-08-31T01:59:59.139784+0000","last_active":"2023-08-31T02:00:03.183223+0000","last_peered":"2023-08-31T02:00:03.183223+0000","last_clean":"2023-08-31T02:00:03.183223+0000","last_became_active":"2023-08-31T01:59:59.139504+0000","last_became_peered":"2023-08-31T01:59:59.139504+0000","last_unstale":"2023-08-31T02:00:03.183223+0000","last_undegraded":"2023-08-31T02:00:03.183223+0000","last_fullsized":"2023-08-31T02:00:03.183223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:24:58.176806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171308+0000","last_change":"2023-08-31T01:59:59.146628+0000","last_active":"2023-08-31T02:00:03.171308+0000","last_peered":"2023-08-31T02:00:03.171308+0000","last_clean":"2023-08-31T02:00:03.171308+0000","last_became_active":"2023-08-31T01:59:59.146283+0000","last_became_peered":"2023-08-31T01:59:59.146283+0000","last_unstale":"2023-08-31T02:00:03.171308+0000","last_undegraded":"2023-08-31T02:00:03.171308+0000","last_fullsized":"2023-08-31T02:00:03.171308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164760+0000","last_change":"2023-08-31T01:59:59.142109+0000","last_active":"2023-08-31T02:00:03.164760+0000","last_peered":"2023-08-31T02:00:03.164760+0000","last_clean":"2023-08-31T02:00:03.164760+0000","last_became_active":"2023-08-31T01:59:59.141757+0000","last_became_peered":"2023-08-31T01:59:59.141757+0000","last_unstale":"2023-08-31T02:00:03.164760+0000","last_undegraded":"2023-08-31T02:00:03.164760+0000","last_fullsized":"2023-08-31T02:00:03.164760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:13:24.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163648+0000","last_change":"2023-08-31T01:59:59.142887+0000","last_active":"2023-08-31T02:00:03.163648+0000","last_peered":"2023-08-31T02:00:03.163648+0000","last_clean":"2023-08-31T02:00:03.163648+0000","last_became_active":"2023-08-31T01:59:59.142576+0000","last_became_peered":"2023-08-31T01:59:59.142576+0000","last_unstale":"2023-08-31T02:00:03.163648+0000","last_undegraded":"2023-08-31T02:00:03.163648+0000","last_fullsized":"2023-08-31T02:00:03.163648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:13:24.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162037+0000","last_change":"2023-08-31T01:59:59.144355+0000","last_active":"2023-08-31T02:00:03.162037+0000","last_peered":"2023-08-31T02:00:03.162037+0000","last_clean":"2023-08-31T02:00:03.162037+0000","last_became_active":"2023-08-31T01:59:59.144045+0000","last_became_peered":"2023-08-31T01:59:59.144045+0000","last_unstale":"2023-08-31T02:00:03.162037+0000","last_undegraded":"2023-08-31T02:00:03.162037+0000","last_fullsized":"2023-08-31T02:00:03.162037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:36:58.237436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163460+0000","last_change":"2023-08-31T01:59:59.139501+0000","last_active":"2023-08-31T02:00:03.163460+0000","last_peered":"2023-08-31T02:00:03.163460+0000","last_clean":"2023-08-31T02:00:03.163460+0000","last_became_active":"2023-08-31T01:59:59.138918+0000","last_became_peered":"2023-08-31T01:59:59.138918+0000","last_unstale":"2023-08-31T02:00:03.163460+0000","last_undegraded":"2023-08-31T02:00:03.163460+0000","last_fullsized":"2023-08-31T02:00:03.163460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:43:55.591253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169517+0000","last_change":"2023-08-31T01:59:59.143302+0000","last_active":"2023-08-31T02:00:03.169517+0000","last_peered":"2023-08-31T02:00:03.169517+0000","last_clean":"2023-08-31T02:00:03.169517+0000","last_became_active":"2023-08-31T01:59:59.142853+0000","last_became_peered":"2023-08-31T01:59:59.142853+0000","last_unstale":"2023-08-31T02:00:03.169517+0000","last_undegraded":"2023-08-31T02:00:03.169517+0000","last_fullsized":"2023-08-31T02:00:03.169517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:54:32.244757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170712+0000","last_change":"2023-08-31T01:59:59.144185+0000","last_active":"2023-08-31T02:00:03.170712+0000","last_peered":"2023-08-31T02:00:03.170712+0000","last_clean":"2023-08-31T02:00:03.170712+0000","last_became_active":"2023-08-31T01:59:59.143219+0000","last_became_peered":"2023-08-31T01:59:59.143219+0000","last_unstale":"2023-08-31T02:00:03.170712+0000","last_undegraded":"2023-08-31T02:00:03.170712+0000","last_fullsized":"2023-08-31T02:00:03.170712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":107610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.659000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":698400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":698456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":107576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:00:22.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:00:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.470+0000 7fdaf9077700 1 -- 172.21.15.84:0/2697181742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdadc004120 msgr2=0x7fdadc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.470+0000 7fdaf9077700 1 --2- 172.21.15.84:0/2697181742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdadc004120 0x7fdadc004850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdae4001870 tx=0x7fdadc005880 comp rx=0 tx=0).stop 2023-08-31T02:00:22.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.470+0000 7fdaf359e700 1 -- 172.21.15.84:0/2697181742 reap_dead start 2023-08-31T02:00:22.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.470+0000 7fdaf9077700 1 -- 172.21.15.84:0/2697181742 shutdown_connections 2023-08-31T02:00:22.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.470+0000 7fdaf9077700 1 -- 172.21.15.84:0/2697181742 >> 172.21.15.84:0/2697181742 conn(0x7fdaf406fca0 msgr2=0x7fdaf40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:22.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.470+0000 7fdaf9077700 1 -- 172.21.15.84:0/2697181742 shutdown_connections 2023-08-31T02:00:22.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.470+0000 7fdaf9077700 1 -- 172.21.15.84:0/2697181742 wait complete. 2023-08-31T02:00:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.471+0000 7fdaf9077700 1 Processor -- start 2023-08-31T02:00:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.471+0000 7fdaf9077700 1 -- start start 2023-08-31T02:00:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf9077700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdadc004120 0x7fdaf41438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf9077700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaf40b3ca0 0x7fdaf40c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf9077700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaf40b1b90 0x7fdaf40b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf9077700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40b2550 con 0x7fdaf40b1b90 2023-08-31T02:00:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf9077700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40c3d50 con 0x7fdaf40b3ca0 2023-08-31T02:00:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf9077700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40b4520 con 0x7fdadc004120 2023-08-31T02:00:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaf40b1b90 0x7fdaf40b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaf40b1b90 0x7fdaf40b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51800/0 (socket says 172.21.15.84:51800) 2023-08-31T02:00:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 -- 172.21.15.84:0/4049253160 learned_addr learned my addr 172.21.15.84:0/4049253160 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf2d9d700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdadc004120 0x7fdaf41438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf259c700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaf40b3ca0 0x7fdaf40c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 -- 172.21.15.84:0/4049253160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdadc004120 msgr2=0x7fdaf41438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdadc004120 0x7fdaf41438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 -- 172.21.15.84:0/4049253160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaf40b3ca0 msgr2=0x7fdaf40c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaf40b3ca0 0x7fdaf40c1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 -- 172.21.15.84:0/4049253160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40b4800 con 0x7fdaf40b1b90 2023-08-31T02:00:22.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.472+0000 7fdaf359e700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaf40b1b90 0x7fdaf40b2010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000f80 tx=0x7fdaec006330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:22.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.473+0000 7fdadb7fe700 1 -- 172.21.15.84:0/4049253160 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec011660 con 0x7fdaf40b1b90 2023-08-31T02:00:22.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.473+0000 7fdadb7fe700 1 -- 172.21.15.84:0/4049253160 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdaec0118f0 con 0x7fdaf40b1b90 2023-08-31T02:00:22.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.473+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf40b4ae0 con 0x7fdaf40b1b90 2023-08-31T02:00:22.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.473+0000 7fdadb7fe700 1 -- 172.21.15.84:0/4049253160 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec011d00 con 0x7fdaf40b1b90 2023-08-31T02:00:22.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.473+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf40c21c0 con 0x7fdaf40b1b90 2023-08-31T02:00:22.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.474+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf404e7c0 con 0x7fdaf40b1b90 2023-08-31T02:00:22.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.474+0000 7fdadb7fe700 1 -- 172.21.15.84:0/4049253160 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdaec01c460 con 0x7fdaf40b1b90 2023-08-31T02:00:22.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.474+0000 7fdadb7fe700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdae006a0e0 0x7fdae006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.474+0000 7fdadb7fe700 1 -- 172.21.15.84:0/4049253160 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdaec0890a0 con 0x7fdaf40b1b90 2023-08-31T02:00:22.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.474+0000 7fdaf2d9d700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdae006a0e0 0x7fdae006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.475+0000 7fdaf2d9d700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdae006a0e0 0x7fdae006c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009c60 tx=0x7fdae8009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:22.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.479+0000 7fdadb7fe700 1 -- 172.21.15.84:0/4049253160 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdaec054590 con 0x7fdaf40b1b90 2023-08-31T02:00:22.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.665+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdaf4159440 con 0x7fdae006a0e0 2023-08-31T02:00:22.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.673+0000 7fdadb7fe700 1 -- 172.21.15.84:0/4049253160 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345244 (secure 0 0 0) 0x7fdaf4159440 con 0x7fdae006a0e0 2023-08-31T02:00:22.670 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:22.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdae006a0e0 msgr2=0x7fdae006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdae006a0e0 0x7fdae006c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009c60 tx=0x7fdae8009260 comp rx=0 tx=0).stop 2023-08-31T02:00:22.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaf40b1b90 msgr2=0x7fdaf40b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaf40b1b90 0x7fdaf40b2010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000f80 tx=0x7fdaec006330 comp rx=0 tx=0).stop 2023-08-31T02:00:22.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 shutdown_connections 2023-08-31T02:00:22.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdae006a0e0 0x7fdae006c5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaf40b1b90 0x7fdaf40b2010 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdadc004120 0x7fdaf41438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 --2- 172.21.15.84:0/4049253160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaf40b3ca0 0x7fdaf40c1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 >> 172.21.15.84:0/4049253160 conn(0x7fdaf406fca0 msgr2=0x7fdaf40cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:22.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 shutdown_connections 2023-08-31T02:00:22.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.677+0000 7fdaf9077700 1 -- 172.21.15.84:0/4049253160 wait complete. 2023-08-31T02:00:22.675 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:00:22.682 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-08-31T02:00:21.054397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219532,"kb_used_data":3368,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755188,"statfs":{"total":773094113280,"available":772869312512,"internally_reserved":0,"allocated":3448832,"data_stored":2049616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002714"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181204+0000","last_change":"2023-08-31T01:59:59.153066+0000","last_active":"2023-08-31T02:00:03.181204+0000","last_peered":"2023-08-31T02:00:03.181204+0000","last_clean":"2023-08-31T02:00:03.181204+0000","last_became_active":"2023-08-31T01:59:59.152543+0000","last_became_peered":"2023-08-31T01:59:59.152543+0000","last_unstale":"2023-08-31T02:00:03.181204+0000","last_undegraded":"2023-08-31T02:00:03.181204+0000","last_fullsized":"2023-08-31T02:00:03.181204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:17.842126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183513+0000","last_change":"2023-08-31T01:59:59.132145+0000","last_active":"2023-08-31T02:00:03.183513+0000","last_peered":"2023-08-31T02:00:03.183513+0000","last_clean":"2023-08-31T02:00:03.183513+0000","last_became_active":"2023-08-31T01:59:59.131885+0000","last_became_peered":"2023-08-31T01:59:59.131885+0000","last_unstale":"2023-08-31T02:00:03.183513+0000","last_undegraded":"2023-08-31T02:00:03.183513+0000","last_fullsized":"2023-08-31T02:00:03.183513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169077+0000","last_change":"2023-08-31T01:59:59.131265+0000","last_active":"2023-08-31T02:00:03.169077+0000","last_peered":"2023-08-31T02:00:03.169077+0000","last_clean":"2023-08-31T02:00:03.169077+0000","last_became_active":"2023-08-31T01:59:59.130984+0000","last_became_peered":"2023-08-31T01:59:59.130984+0000","last_unstale":"2023-08-31T02:00:03.169077+0000","last_undegraded":"2023-08-31T02:00:03.169077+0000","last_fullsized":"2023-08-31T02:00:03.169077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:24:58.176806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162779+0000","last_change":"2023-08-31T01:59:59.142792+0000","last_active":"2023-08-31T02:00:03.162779+0000","last_peered":"2023-08-31T02:00:03.162779+0000","last_clean":"2023-08-31T02:00:03.162779+0000","last_became_active":"2023-08-31T01:59:59.142520+0000","last_became_peered":"2023-08-31T01:59:59.142520+0000","last_unstale":"2023-08-31T02:00:03.162779+0000","last_undegraded":"2023-08-31T02:00:03.162779+0000","last_fullsized":"2023-08-31T02:00:03.162779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:46.986597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180530+0000","last_change":"2023-08-31T01:59:59.140365+0000","last_active":"2023-08-31T02:00:03.180530+0000","last_peered":"2023-08-31T02:00:03.180530+0000","last_clean":"2023-08-31T02:00:03.180530+0000","last_became_active":"2023-08-31T01:59:59.140113+0000","last_became_peered":"2023-08-31T01:59:59.140113+0000","last_unstale":"2023-08-31T02:00:03.180530+0000","last_undegraded":"2023-08-31T02:00:03.180530+0000","last_fullsized":"2023-08-31T02:00:03.180530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:55:33.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163582+0000","last_change":"2023-08-31T01:59:59.134781+0000","last_active":"2023-08-31T02:00:03.163582+0000","last_peered":"2023-08-31T02:00:03.163582+0000","last_clean":"2023-08-31T02:00:03.163582+0000","last_became_active":"2023-08-31T01:59:59.134480+0000","last_became_peered":"2023-08-31T01:59:59.134480+0000","last_unstale":"2023-08-31T02:00:03.163582+0000","last_undegraded":"2023-08-31T02:00:03.163582+0000","last_fullsized":"2023-08-31T02:00:03.163582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:56:16.408773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181151+0000","last_change":"2023-08-31T01:59:59.138166+0000","last_active":"2023-08-31T02:00:03.181151+0000","last_peered":"2023-08-31T02:00:03.181151+0000","last_clean":"2023-08-31T02:00:03.181151+0000","last_became_active":"2023-08-31T01:59:59.137906+0000","last_became_peered":"2023-08-31T01:59:59.137906+0000","last_unstale":"2023-08-31T02:00:03.181151+0000","last_undegraded":"2023-08-31T02:00:03.181151+0000","last_fullsized":"2023-08-31T02:00:03.181151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:21:43.096879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162548+0000","last_change":"2023-08-31T01:59:59.139015+0000","last_active":"2023-08-31T02:00:03.162548+0000","last_peered":"2023-08-31T02:00:03.162548+0000","last_clean":"2023-08-31T02:00:03.162548+0000","last_became_active":"2023-08-31T01:59:59.138750+0000","last_became_peered":"2023-08-31T01:59:59.138750+0000","last_unstale":"2023-08-31T02:00:03.162548+0000","last_undegraded":"2023-08-31T02:00:03.162548+0000","last_fullsized":"2023-08-31T02:00:03.162548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:41:19.129611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181131+0000","last_change":"2023-08-31T01:59:59.148629+0000","last_active":"2023-08-31T02:00:03.181131+0000","last_peered":"2023-08-31T02:00:03.181131+0000","last_clean":"2023-08-31T02:00:03.181131+0000","last_became_active":"2023-08-31T01:59:59.148368+0000","last_became_peered":"2023-08-31T01:59:59.148368+0000","last_unstale":"2023-08-31T02:00:03.181131+0000","last_undegraded":"2023-08-31T02:00:03.181131+0000","last_fullsized":"2023-08-31T02:00:03.181131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:37:26.875580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170679+0000","last_change":"2023-08-31T01:59:59.146071+0000","last_active":"2023-08-31T02:00:03.170679+0000","last_peered":"2023-08-31T02:00:03.170679+0000","last_clean":"2023-08-31T02:00:03.170679+0000","last_became_active":"2023-08-31T01:59:59.141603+0000","last_became_peered":"2023-08-31T01:59:59.141603+0000","last_unstale":"2023-08-31T02:00:03.170679+0000","last_undegraded":"2023-08-31T02:00:03.170679+0000","last_fullsized":"2023-08-31T02:00:03.170679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:55:33.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171222+0000","last_change":"2023-08-31T01:59:59.146296+0000","last_active":"2023-08-31T02:00:03.171222+0000","last_peered":"2023-08-31T02:00:03.171222+0000","last_clean":"2023-08-31T02:00:03.171222+0000","last_became_active":"2023-08-31T01:59:59.143079+0000","last_became_peered":"2023-08-31T01:59:59.143079+0000","last_unstale":"2023-08-31T02:00:03.171222+0000","last_undegraded":"2023-08-31T02:00:03.171222+0000","last_fullsized":"2023-08-31T02:00:03.171222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:21:43.096879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167674+0000","last_change":"2023-08-31T01:59:59.144579+0000","last_active":"2023-08-31T02:00:03.167674+0000","last_peered":"2023-08-31T02:00:03.167674+0000","last_clean":"2023-08-31T02:00:03.167674+0000","last_became_active":"2023-08-31T01:59:59.144144+0000","last_became_peered":"2023-08-31T01:59:59.144144+0000","last_unstale":"2023-08-31T02:00:03.167674+0000","last_undegraded":"2023-08-31T02:00:03.167674+0000","last_fullsized":"2023-08-31T02:00:03.167674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:41.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162134+0000","last_change":"2023-08-31T01:59:59.153550+0000","last_active":"2023-08-31T02:00:03.162134+0000","last_peered":"2023-08-31T02:00:03.162134+0000","last_clean":"2023-08-31T02:00:03.162134+0000","last_became_active":"2023-08-31T01:59:59.153324+0000","last_became_peered":"2023-08-31T01:59:59.153324+0000","last_unstale":"2023-08-31T02:00:03.162134+0000","last_undegraded":"2023-08-31T02:00:03.162134+0000","last_fullsized":"2023-08-31T02:00:03.162134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:02:02.199676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167186+0000","last_change":"2023-08-31T01:59:59.140970+0000","last_active":"2023-08-31T02:00:03.167186+0000","last_peered":"2023-08-31T02:00:03.167186+0000","last_clean":"2023-08-31T02:00:03.167186+0000","last_became_active":"2023-08-31T01:59:59.140228+0000","last_became_peered":"2023-08-31T01:59:59.140228+0000","last_unstale":"2023-08-31T02:00:03.167186+0000","last_undegraded":"2023-08-31T02:00:03.167186+0000","last_fullsized":"2023-08-31T02:00:03.167186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:28.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181691+0000","last_change":"2023-08-31T01:59:59.134845+0000","last_active":"2023-08-31T02:00:03.181691+0000","last_peered":"2023-08-31T02:00:03.181691+0000","last_clean":"2023-08-31T02:00:03.181691+0000","last_became_active":"2023-08-31T01:59:59.134582+0000","last_became_peered":"2023-08-31T01:59:59.134582+0000","last_unstale":"2023-08-31T02:00:03.181691+0000","last_undegraded":"2023-08-31T02:00:03.181691+0000","last_fullsized":"2023-08-31T02:00:03.181691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162420+0000","last_change":"2023-08-31T01:59:59.129553+0000","last_active":"2023-08-31T02:00:03.162420+0000","last_peered":"2023-08-31T02:00:03.162420+0000","last_clean":"2023-08-31T02:00:03.162420+0000","last_became_active":"2023-08-31T01:59:59.129229+0000","last_became_peered":"2023-08-31T01:59:59.129229+0000","last_unstale":"2023-08-31T02:00:03.162420+0000","last_undegraded":"2023-08-31T02:00:03.162420+0000","last_fullsized":"2023-08-31T02:00:03.162420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:23:18.368239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163287+0000","last_change":"2023-08-31T01:59:59.143663+0000","last_active":"2023-08-31T02:00:03.163287+0000","last_peered":"2023-08-31T02:00:03.163287+0000","last_clean":"2023-08-31T02:00:03.163287+0000","last_became_active":"2023-08-31T01:59:59.143284+0000","last_became_peered":"2023-08-31T01:59:59.143284+0000","last_unstale":"2023-08-31T02:00:03.163287+0000","last_undegraded":"2023-08-31T02:00:03.163287+0000","last_fullsized":"2023-08-31T02:00:03.163287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:57:18.747036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.173127+0000","last_change":"2023-08-31T01:59:59.149136+0000","last_active":"2023-08-31T02:00:03.173127+0000","last_peered":"2023-08-31T02:00:03.173127+0000","last_clean":"2023-08-31T02:00:03.173127+0000","last_became_active":"2023-08-31T01:59:59.148859+0000","last_became_peered":"2023-08-31T01:59:59.148859+0000","last_unstale":"2023-08-31T02:00:03.173127+0000","last_undegraded":"2023-08-31T02:00:03.173127+0000","last_fullsized":"2023-08-31T02:00:03.173127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:15.781174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180955+0000","last_change":"2023-08-31T01:59:59.140287+0000","last_active":"2023-08-31T02:00:03.180955+0000","last_peered":"2023-08-31T02:00:03.180955+0000","last_clean":"2023-08-31T02:00:03.180955+0000","last_became_active":"2023-08-31T01:59:59.140016+0000","last_became_peered":"2023-08-31T01:59:59.140016+0000","last_unstale":"2023-08-31T02:00:03.180955+0000","last_undegraded":"2023-08-31T02:00:03.180955+0000","last_fullsized":"2023-08-31T02:00:03.180955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:42:39.396804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163349+0000","last_change":"2023-08-31T02:00:03.192225+0000","last_active":"2023-08-31T02:00:04.163349+0000","last_peered":"2023-08-31T02:00:04.163349+0000","last_clean":"2023-08-31T02:00:04.163349+0000","last_became_active":"2023-08-31T02:00:03.191659+0000","last_became_peered":"2023-08-31T02:00:03.191659+0000","last_unstale":"2023-08-31T02:00:04.163349+0000","last_undegraded":"2023-08-31T02:00:04.163349+0000","last_fullsized":"2023-08-31T02:00:04.163349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:07.950758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169428+0000","last_change":"2023-08-31T01:59:58.142347+0000","last_active":"2023-08-31T02:00:03.169428+0000","last_peered":"2023-08-31T02:00:03.169428+0000","last_clean":"2023-08-31T02:00:03.169428+0000","last_became_active":"2023-08-31T01:59:58.142075+0000","last_became_peered":"2023-08-31T01:59:58.142075+0000","last_unstale":"2023-08-31T02:00:03.169428+0000","last_undegraded":"2023-08-31T02:00:03.169428+0000","last_fullsized":"2023-08-31T02:00:03.169428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164531+0000","last_change":"2023-08-31T01:59:59.154639+0000","last_active":"2023-08-31T02:00:03.164531+0000","last_peered":"2023-08-31T02:00:03.164531+0000","last_clean":"2023-08-31T02:00:03.164531+0000","last_became_active":"2023-08-31T01:59:59.154308+0000","last_became_peered":"2023-08-31T01:59:59.154308+0000","last_unstale":"2023-08-31T02:00:03.164531+0000","last_undegraded":"2023-08-31T02:00:03.164531+0000","last_fullsized":"2023-08-31T02:00:03.164531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:23:18.368239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163776+0000","last_change":"2023-08-31T02:00:03.188074+0000","last_active":"2023-08-31T02:00:04.163776+0000","last_peered":"2023-08-31T02:00:04.163776+0000","last_clean":"2023-08-31T02:00:04.163776+0000","last_became_active":"2023-08-31T02:00:03.187698+0000","last_became_peered":"2023-08-31T02:00:03.187698+0000","last_unstale":"2023-08-31T02:00:04.163776+0000","last_undegraded":"2023-08-31T02:00:04.163776+0000","last_fullsized":"2023-08-31T02:00:04.163776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:55:06.805698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164700+0000","last_change":"2023-08-31T01:59:58.132279+0000","last_active":"2023-08-31T02:00:03.164700+0000","last_peered":"2023-08-31T02:00:03.164700+0000","last_clean":"2023-08-31T02:00:03.164700+0000","last_became_active":"2023-08-31T01:59:58.132009+0000","last_became_peered":"2023-08-31T01:59:58.132009+0000","last_unstale":"2023-08-31T02:00:03.164700+0000","last_undegraded":"2023-08-31T02:00:03.164700+0000","last_fullsized":"2023-08-31T02:00:03.164700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:02:21.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169076+0000","last_change":"2023-08-31T01:59:59.135972+0000","last_active":"2023-08-31T02:00:03.169076+0000","last_peered":"2023-08-31T02:00:03.169076+0000","last_clean":"2023-08-31T02:00:03.169076+0000","last_became_active":"2023-08-31T01:59:59.135691+0000","last_became_peered":"2023-08-31T01:59:59.135691+0000","last_unstale":"2023-08-31T02:00:03.169076+0000","last_undegraded":"2023-08-31T02:00:03.169076+0000","last_fullsized":"2023-08-31T02:00:03.169076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:03.652877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164169+0000","last_change":"2023-08-31T02:00:03.192204+0000","last_active":"2023-08-31T02:00:04.164169+0000","last_peered":"2023-08-31T02:00:04.164169+0000","last_clean":"2023-08-31T02:00:04.164169+0000","last_became_active":"2023-08-31T02:00:03.191633+0000","last_became_peered":"2023-08-31T02:00:03.191633+0000","last_unstale":"2023-08-31T02:00:04.164169+0000","last_undegraded":"2023-08-31T02:00:04.164169+0000","last_fullsized":"2023-08-31T02:00:04.164169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180816+0000","last_change":"2023-08-31T01:59:58.143879+0000","last_active":"2023-08-31T02:00:03.180816+0000","last_peered":"2023-08-31T02:00:03.180816+0000","last_clean":"2023-08-31T02:00:03.180816+0000","last_became_active":"2023-08-31T01:59:58.143588+0000","last_became_peered":"2023-08-31T01:59:58.143588+0000","last_unstale":"2023-08-31T02:00:03.180816+0000","last_undegraded":"2023-08-31T02:00:03.180816+0000","last_fullsized":"2023-08-31T02:00:03.180816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:46.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162551+0000","last_change":"2023-08-31T01:59:59.136923+0000","last_active":"2023-08-31T02:00:03.162551+0000","last_peered":"2023-08-31T02:00:03.162551+0000","last_clean":"2023-08-31T02:00:03.162551+0000","last_became_active":"2023-08-31T01:59:59.136667+0000","last_became_peered":"2023-08-31T01:59:59.136667+0000","last_unstale":"2023-08-31T02:00:03.162551+0000","last_undegraded":"2023-08-31T02:00:03.162551+0000","last_fullsized":"2023-08-31T02:00:03.162551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:56:30.420963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163855+0000","last_change":"2023-08-31T02:00:03.174239+0000","last_active":"2023-08-31T02:00:04.163855+0000","last_peered":"2023-08-31T02:00:04.163855+0000","last_clean":"2023-08-31T02:00:04.163855+0000","last_became_active":"2023-08-31T02:00:03.173806+0000","last_became_peered":"2023-08-31T02:00:03.173806+0000","last_unstale":"2023-08-31T02:00:04.163855+0000","last_undegraded":"2023-08-31T02:00:04.163855+0000","last_fullsized":"2023-08-31T02:00:04.163855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:07.292454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180701+0000","last_change":"2023-08-31T01:59:58.142035+0000","last_active":"2023-08-31T02:00:03.180701+0000","last_peered":"2023-08-31T02:00:03.180701+0000","last_clean":"2023-08-31T02:00:03.180701+0000","last_became_active":"2023-08-31T01:59:58.141223+0000","last_became_peered":"2023-08-31T01:59:58.141223+0000","last_unstale":"2023-08-31T02:00:03.180701+0000","last_undegraded":"2023-08-31T02:00:03.180701+0000","last_fullsized":"2023-08-31T02:00:03.180701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:54:24.757437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163587+0000","last_change":"2023-08-31T01:59:59.135949+0000","last_active":"2023-08-31T02:00:03.163587+0000","last_peered":"2023-08-31T02:00:03.163587+0000","last_clean":"2023-08-31T02:00:03.163587+0000","last_became_active":"2023-08-31T01:59:59.135657+0000","last_became_peered":"2023-08-31T01:59:59.135657+0000","last_unstale":"2023-08-31T02:00:03.163587+0000","last_undegraded":"2023-08-31T02:00:03.163587+0000","last_fullsized":"2023-08-31T02:00:03.163587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:05:14.371221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163462+0000","last_change":"2023-08-31T02:00:03.197344+0000","last_active":"2023-08-31T02:00:04.163462+0000","last_peered":"2023-08-31T02:00:04.163462+0000","last_clean":"2023-08-31T02:00:04.163462+0000","last_became_active":"2023-08-31T02:00:03.196881+0000","last_became_peered":"2023-08-31T02:00:03.196881+0000","last_unstale":"2023-08-31T02:00:04.163462+0000","last_undegraded":"2023-08-31T02:00:04.163462+0000","last_fullsized":"2023-08-31T02:00:04.163462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:06:25.721250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162344+0000","last_change":"2023-08-31T01:59:58.141370+0000","last_active":"2023-08-31T02:00:03.162344+0000","last_peered":"2023-08-31T02:00:03.162344+0000","last_clean":"2023-08-31T02:00:03.162344+0000","last_became_active":"2023-08-31T01:59:58.141142+0000","last_became_peered":"2023-08-31T01:59:58.141142+0000","last_unstale":"2023-08-31T02:00:03.162344+0000","last_undegraded":"2023-08-31T02:00:03.162344+0000","last_fullsized":"2023-08-31T02:00:03.162344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:59:13.304994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167343+0000","last_change":"2023-08-31T01:59:59.142375+0000","last_active":"2023-08-31T02:00:03.167343+0000","last_peered":"2023-08-31T02:00:03.167343+0000","last_clean":"2023-08-31T02:00:03.167343+0000","last_became_active":"2023-08-31T01:59:59.142081+0000","last_became_peered":"2023-08-31T01:59:59.142081+0000","last_unstale":"2023-08-31T02:00:03.167343+0000","last_undegraded":"2023-08-31T02:00:03.167343+0000","last_fullsized":"2023-08-31T02:00:03.167343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:11.399572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.243672+0000","last_change":"2023-08-31T02:00:03.187642+0000","last_active":"2023-08-31T02:00:04.243672+0000","last_peered":"2023-08-31T02:00:04.243672+0000","last_clean":"2023-08-31T02:00:04.243672+0000","last_became_active":"2023-08-31T02:00:03.187241+0000","last_became_peered":"2023-08-31T02:00:03.187241+0000","last_unstale":"2023-08-31T02:00:04.243672+0000","last_undegraded":"2023-08-31T02:00:04.243672+0000","last_fullsized":"2023-08-31T02:00:04.243672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:02:06.236563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170304+0000","last_change":"2023-08-31T01:59:58.135240+0000","last_active":"2023-08-31T02:00:03.170304+0000","last_peered":"2023-08-31T02:00:03.170304+0000","last_clean":"2023-08-31T02:00:03.170304+0000","last_became_active":"2023-08-31T01:59:58.134970+0000","last_became_peered":"2023-08-31T01:59:58.134970+0000","last_unstale":"2023-08-31T02:00:03.170304+0000","last_undegraded":"2023-08-31T02:00:03.170304+0000","last_fullsized":"2023-08-31T02:00:03.170304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:27.460329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.168630+0000","last_change":"2023-08-31T01:59:59.136910+0000","last_active":"2023-08-31T02:00:03.168630+0000","last_peered":"2023-08-31T02:00:03.168630+0000","last_clean":"2023-08-31T02:00:03.168630+0000","last_became_active":"2023-08-31T01:59:59.136639+0000","last_became_peered":"2023-08-31T01:59:59.136639+0000","last_unstale":"2023-08-31T02:00:03.168630+0000","last_undegraded":"2023-08-31T02:00:03.168630+0000","last_fullsized":"2023-08-31T02:00:03.168630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242167+0000","last_change":"2023-08-31T02:00:03.191155+0000","last_active":"2023-08-31T02:00:04.242167+0000","last_peered":"2023-08-31T02:00:04.242167+0000","last_clean":"2023-08-31T02:00:04.242167+0000","last_became_active":"2023-08-31T02:00:03.190781+0000","last_became_peered":"2023-08-31T02:00:03.190781+0000","last_unstale":"2023-08-31T02:00:04.242167+0000","last_undegraded":"2023-08-31T02:00:04.242167+0000","last_fullsized":"2023-08-31T02:00:04.242167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161935+0000","last_change":"2023-08-31T01:59:58.136133+0000","last_active":"2023-08-31T02:00:03.161935+0000","last_peered":"2023-08-31T02:00:03.161935+0000","last_clean":"2023-08-31T02:00:03.161935+0000","last_became_active":"2023-08-31T01:59:58.135866+0000","last_became_peered":"2023-08-31T01:59:58.135866+0000","last_unstale":"2023-08-31T02:00:03.161935+0000","last_undegraded":"2023-08-31T02:00:03.161935+0000","last_fullsized":"2023-08-31T02:00:03.161935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:07:34.297167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161781+0000","last_change":"2023-08-31T01:59:59.137046+0000","last_active":"2023-08-31T02:00:03.161781+0000","last_peered":"2023-08-31T02:00:03.161781+0000","last_clean":"2023-08-31T02:00:03.161781+0000","last_became_active":"2023-08-31T01:59:59.136766+0000","last_became_peered":"2023-08-31T01:59:59.136766+0000","last_unstale":"2023-08-31T02:00:03.161781+0000","last_undegraded":"2023-08-31T02:00:03.161781+0000","last_fullsized":"2023-08-31T02:00:03.161781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:36.061031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242413+0000","last_change":"2023-08-31T02:00:03.185467+0000","last_active":"2023-08-31T02:00:04.242413+0000","last_peered":"2023-08-31T02:00:04.242413+0000","last_clean":"2023-08-31T02:00:04.242413+0000","last_became_active":"2023-08-31T02:00:03.185055+0000","last_became_peered":"2023-08-31T02:00:03.185055+0000","last_unstale":"2023-08-31T02:00:04.242413+0000","last_undegraded":"2023-08-31T02:00:04.242413+0000","last_fullsized":"2023-08-31T02:00:04.242413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:12:08.637395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163543+0000","last_change":"2023-08-31T01:59:58.135749+0000","last_active":"2023-08-31T02:00:03.163543+0000","last_peered":"2023-08-31T02:00:03.163543+0000","last_clean":"2023-08-31T02:00:03.163543+0000","last_became_active":"2023-08-31T01:59:58.134641+0000","last_became_peered":"2023-08-31T01:59:58.134641+0000","last_unstale":"2023-08-31T02:00:03.163543+0000","last_undegraded":"2023-08-31T02:00:03.163543+0000","last_fullsized":"2023-08-31T02:00:03.163543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:51:14.774305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181824+0000","last_change":"2023-08-31T01:59:59.139726+0000","last_active":"2023-08-31T02:00:03.181824+0000","last_peered":"2023-08-31T02:00:03.181824+0000","last_clean":"2023-08-31T02:00:03.181824+0000","last_became_active":"2023-08-31T01:59:59.139453+0000","last_became_peered":"2023-08-31T01:59:59.139453+0000","last_unstale":"2023-08-31T02:00:03.181824+0000","last_undegraded":"2023-08-31T02:00:03.181824+0000","last_fullsized":"2023-08-31T02:00:03.181824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163132+0000","last_change":"2023-08-31T02:00:03.188588+0000","last_active":"2023-08-31T02:00:04.163132+0000","last_peered":"2023-08-31T02:00:04.163132+0000","last_clean":"2023-08-31T02:00:04.163132+0000","last_became_active":"2023-08-31T02:00:03.187651+0000","last_became_peered":"2023-08-31T02:00:03.187651+0000","last_unstale":"2023-08-31T02:00:04.163132+0000","last_undegraded":"2023-08-31T02:00:04.163132+0000","last_fullsized":"2023-08-31T02:00:04.163132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:58:48.531393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171794+0000","last_change":"2023-08-31T01:59:58.137377+0000","last_active":"2023-08-31T02:00:03.171794+0000","last_peered":"2023-08-31T02:00:03.171794+0000","last_clean":"2023-08-31T02:00:03.171794+0000","last_became_active":"2023-08-31T01:59:58.137080+0000","last_became_peered":"2023-08-31T01:59:58.137080+0000","last_unstale":"2023-08-31T02:00:03.171794+0000","last_undegraded":"2023-08-31T02:00:03.171794+0000","last_fullsized":"2023-08-31T02:00:03.171794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:10.392703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163096+0000","last_change":"2023-08-31T01:59:59.138414+0000","last_active":"2023-08-31T02:00:03.163096+0000","last_peered":"2023-08-31T02:00:03.163096+0000","last_clean":"2023-08-31T02:00:03.163096+0000","last_became_active":"2023-08-31T01:59:59.138115+0000","last_became_peered":"2023-08-31T01:59:59.138115+0000","last_unstale":"2023-08-31T02:00:03.163096+0000","last_undegraded":"2023-08-31T02:00:03.163096+0000","last_fullsized":"2023-08-31T02:00:03.163096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:56:15.505917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163393+0000","last_change":"2023-08-31T02:00:03.177589+0000","last_active":"2023-08-31T02:00:04.163393+0000","last_peered":"2023-08-31T02:00:04.163393+0000","last_clean":"2023-08-31T02:00:04.163393+0000","last_became_active":"2023-08-31T02:00:03.177081+0000","last_became_peered":"2023-08-31T02:00:03.177081+0000","last_unstale":"2023-08-31T02:00:04.163393+0000","last_undegraded":"2023-08-31T02:00:04.163393+0000","last_fullsized":"2023-08-31T02:00:04.163393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:45:19.479655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162995+0000","last_change":"2023-08-31T01:59:58.136589+0000","last_active":"2023-08-31T02:00:03.162995+0000","last_peered":"2023-08-31T02:00:03.162995+0000","last_clean":"2023-08-31T02:00:03.162995+0000","last_became_active":"2023-08-31T01:59:58.136034+0000","last_became_peered":"2023-08-31T01:59:58.136034+0000","last_unstale":"2023-08-31T02:00:03.162995+0000","last_undegraded":"2023-08-31T02:00:03.162995+0000","last_fullsized":"2023-08-31T02:00:03.162995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:19:36.193451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169329+0000","last_change":"2023-08-31T01:59:59.131747+0000","last_active":"2023-08-31T02:00:03.169329+0000","last_peered":"2023-08-31T02:00:03.169329+0000","last_clean":"2023-08-31T02:00:03.169329+0000","last_became_active":"2023-08-31T01:59:59.131269+0000","last_became_peered":"2023-08-31T01:59:59.131269+0000","last_unstale":"2023-08-31T02:00:03.169329+0000","last_undegraded":"2023-08-31T02:00:03.169329+0000","last_fullsized":"2023-08-31T02:00:03.169329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164576+0000","last_change":"2023-08-31T02:00:03.191728+0000","last_active":"2023-08-31T02:00:04.164576+0000","last_peered":"2023-08-31T02:00:04.164576+0000","last_clean":"2023-08-31T02:00:04.164576+0000","last_became_active":"2023-08-31T02:00:03.191327+0000","last_became_peered":"2023-08-31T02:00:03.191327+0000","last_unstale":"2023-08-31T02:00:04.164576+0000","last_undegraded":"2023-08-31T02:00:04.164576+0000","last_fullsized":"2023-08-31T02:00:04.164576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183416+0000","last_change":"2023-08-31T01:59:58.138090+0000","last_active":"2023-08-31T02:00:03.183416+0000","last_peered":"2023-08-31T02:00:03.183416+0000","last_clean":"2023-08-31T02:00:03.183416+0000","last_became_active":"2023-08-31T01:59:58.137733+0000","last_became_peered":"2023-08-31T01:59:58.137733+0000","last_unstale":"2023-08-31T02:00:03.183416+0000","last_undegraded":"2023-08-31T02:00:03.183416+0000","last_fullsized":"2023-08-31T02:00:03.183416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167635+0000","last_change":"2023-08-31T01:59:59.139493+0000","last_active":"2023-08-31T02:00:03.167635+0000","last_peered":"2023-08-31T02:00:03.167635+0000","last_clean":"2023-08-31T02:00:03.167635+0000","last_became_active":"2023-08-31T01:59:59.139019+0000","last_became_peered":"2023-08-31T01:59:59.139019+0000","last_unstale":"2023-08-31T02:00:03.167635+0000","last_undegraded":"2023-08-31T02:00:03.167635+0000","last_fullsized":"2023-08-31T02:00:03.167635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:50:02.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241935+0000","last_change":"2023-08-31T02:00:03.184119+0000","last_active":"2023-08-31T02:00:04.241935+0000","last_peered":"2023-08-31T02:00:04.241935+0000","last_clean":"2023-08-31T02:00:04.241935+0000","last_became_active":"2023-08-31T02:00:03.183557+0000","last_became_peered":"2023-08-31T02:00:03.183557+0000","last_unstale":"2023-08-31T02:00:04.241935+0000","last_undegraded":"2023-08-31T02:00:04.241935+0000","last_fullsized":"2023-08-31T02:00:04.241935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:08.828471+0000","last_change":"2023-08-31T01:59:58.138549+0000","last_active":"2023-08-31T02:00:08.828471+0000","last_peered":"2023-08-31T02:00:08.828471+0000","last_clean":"2023-08-31T02:00:08.828471+0000","last_became_active":"2023-08-31T01:59:58.138254+0000","last_became_peered":"2023-08-31T01:59:58.138254+0000","last_unstale":"2023-08-31T02:00:08.828471+0000","last_undegraded":"2023-08-31T02:00:08.828471+0000","last_fullsized":"2023-08-31T02:00:08.828471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180911+0000","last_change":"2023-08-31T01:59:59.147840+0000","last_active":"2023-08-31T02:00:03.180911+0000","last_peered":"2023-08-31T02:00:03.180911+0000","last_clean":"2023-08-31T02:00:03.180911+0000","last_became_active":"2023-08-31T01:59:59.144815+0000","last_became_peered":"2023-08-31T01:59:59.144815+0000","last_unstale":"2023-08-31T02:00:03.180911+0000","last_undegraded":"2023-08-31T02:00:03.180911+0000","last_fullsized":"2023-08-31T02:00:03.180911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:36:25.930421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.165604+0000","last_change":"2023-08-31T02:00:03.184326+0000","last_active":"2023-08-31T02:00:04.165604+0000","last_peered":"2023-08-31T02:00:04.165604+0000","last_clean":"2023-08-31T02:00:04.165604+0000","last_became_active":"2023-08-31T02:00:03.183699+0000","last_became_peered":"2023-08-31T02:00:03.183699+0000","last_unstale":"2023-08-31T02:00:04.165604+0000","last_undegraded":"2023-08-31T02:00:04.165604+0000","last_fullsized":"2023-08-31T02:00:04.165604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:06:25.721250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169606+0000","last_change":"2023-08-31T01:59:58.135348+0000","last_active":"2023-08-31T02:00:03.169606+0000","last_peered":"2023-08-31T02:00:03.169606+0000","last_clean":"2023-08-31T02:00:03.169606+0000","last_became_active":"2023-08-31T01:59:58.135066+0000","last_became_peered":"2023-08-31T01:59:58.135066+0000","last_unstale":"2023-08-31T02:00:03.169606+0000","last_undegraded":"2023-08-31T02:00:03.169606+0000","last_fullsized":"2023-08-31T02:00:03.169606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:32:56.077806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167015+0000","last_change":"2023-08-31T01:59:59.138162+0000","last_active":"2023-08-31T02:00:03.167015+0000","last_peered":"2023-08-31T02:00:03.167015+0000","last_clean":"2023-08-31T02:00:03.167015+0000","last_became_active":"2023-08-31T01:59:59.137839+0000","last_became_peered":"2023-08-31T01:59:59.137839+0000","last_unstale":"2023-08-31T02:00:03.167015+0000","last_undegraded":"2023-08-31T02:00:03.167015+0000","last_fullsized":"2023-08-31T02:00:03.167015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:47.845392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163987+0000","last_change":"2023-08-31T02:00:03.191406+0000","last_active":"2023-08-31T02:00:04.163987+0000","last_peered":"2023-08-31T02:00:04.163987+0000","last_clean":"2023-08-31T02:00:04.163987+0000","last_became_active":"2023-08-31T02:00:03.188162+0000","last_became_peered":"2023-08-31T02:00:03.188162+0000","last_unstale":"2023-08-31T02:00:04.163987+0000","last_undegraded":"2023-08-31T02:00:04.163987+0000","last_fullsized":"2023-08-31T02:00:04.163987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:47:44.042063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162984+0000","last_change":"2023-08-31T01:59:58.131639+0000","last_active":"2023-08-31T02:00:03.162984+0000","last_peered":"2023-08-31T02:00:03.162984+0000","last_clean":"2023-08-31T02:00:03.162984+0000","last_became_active":"2023-08-31T01:59:58.131381+0000","last_became_peered":"2023-08-31T01:59:58.131381+0000","last_unstale":"2023-08-31T02:00:03.162984+0000","last_undegraded":"2023-08-31T02:00:03.162984+0000","last_fullsized":"2023-08-31T02:00:03.162984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:35.054161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180639+0000","last_change":"2023-08-31T01:59:59.148855+0000","last_active":"2023-08-31T02:00:03.180639+0000","last_peered":"2023-08-31T02:00:03.180639+0000","last_clean":"2023-08-31T02:00:03.180639+0000","last_became_active":"2023-08-31T01:59:59.148596+0000","last_became_peered":"2023-08-31T01:59:59.148596+0000","last_unstale":"2023-08-31T02:00:03.180639+0000","last_undegraded":"2023-08-31T02:00:03.180639+0000","last_fullsized":"2023-08-31T02:00:03.180639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:09:06.788463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163483+0000","last_change":"2023-08-31T02:00:03.188719+0000","last_active":"2023-08-31T02:00:04.163483+0000","last_peered":"2023-08-31T02:00:04.163483+0000","last_clean":"2023-08-31T02:00:04.163483+0000","last_became_active":"2023-08-31T02:00:03.188370+0000","last_became_peered":"2023-08-31T02:00:03.188370+0000","last_unstale":"2023-08-31T02:00:04.163483+0000","last_undegraded":"2023-08-31T02:00:04.163483+0000","last_fullsized":"2023-08-31T02:00:04.163483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:47:24.148482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170323+0000","last_change":"2023-08-31T01:59:58.139072+0000","last_active":"2023-08-31T02:00:03.170323+0000","last_peered":"2023-08-31T02:00:03.170323+0000","last_clean":"2023-08-31T02:00:03.170323+0000","last_became_active":"2023-08-31T01:59:58.138813+0000","last_became_peered":"2023-08-31T01:59:58.138813+0000","last_unstale":"2023-08-31T02:00:03.170323+0000","last_undegraded":"2023-08-31T02:00:03.170323+0000","last_fullsized":"2023-08-31T02:00:03.170323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:54:24.757437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170141+0000","last_change":"2023-08-31T01:59:59.141198+0000","last_active":"2023-08-31T02:00:03.170141+0000","last_peered":"2023-08-31T02:00:03.170141+0000","last_clean":"2023-08-31T02:00:03.170141+0000","last_became_active":"2023-08-31T01:59:59.140699+0000","last_became_peered":"2023-08-31T01:59:59.140699+0000","last_unstale":"2023-08-31T02:00:03.170141+0000","last_undegraded":"2023-08-31T02:00:03.170141+0000","last_fullsized":"2023-08-31T02:00:03.170141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:20:43.299746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242253+0000","last_change":"2023-08-31T02:00:03.179770+0000","last_active":"2023-08-31T02:00:04.242253+0000","last_peered":"2023-08-31T02:00:04.242253+0000","last_clean":"2023-08-31T02:00:04.242253+0000","last_became_active":"2023-08-31T02:00:03.179411+0000","last_became_peered":"2023-08-31T02:00:03.179411+0000","last_unstale":"2023-08-31T02:00:04.242253+0000","last_undegraded":"2023-08-31T02:00:04.242253+0000","last_fullsized":"2023-08-31T02:00:04.242253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171952+0000","last_change":"2023-08-31T01:59:58.137410+0000","last_active":"2023-08-31T02:00:03.171952+0000","last_peered":"2023-08-31T02:00:03.171952+0000","last_clean":"2023-08-31T02:00:03.171952+0000","last_became_active":"2023-08-31T01:59:58.137142+0000","last_became_peered":"2023-08-31T01:59:58.137142+0000","last_unstale":"2023-08-31T02:00:03.171952+0000","last_undegraded":"2023-08-31T02:00:03.171952+0000","last_fullsized":"2023-08-31T02:00:03.171952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:08:55.972594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181767+0000","last_change":"2023-08-31T01:59:59.144857+0000","last_active":"2023-08-31T02:00:03.181767+0000","last_peered":"2023-08-31T02:00:03.181767+0000","last_clean":"2023-08-31T02:00:03.181767+0000","last_became_active":"2023-08-31T01:59:59.144565+0000","last_became_peered":"2023-08-31T01:59:59.144565+0000","last_unstale":"2023-08-31T02:00:03.181767+0000","last_undegraded":"2023-08-31T02:00:03.181767+0000","last_fullsized":"2023-08-31T02:00:03.181767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:20:43.299746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163679+0000","last_change":"2023-08-31T02:00:03.188428+0000","last_active":"2023-08-31T02:00:04.163679+0000","last_peered":"2023-08-31T02:00:04.163679+0000","last_clean":"2023-08-31T02:00:04.163679+0000","last_became_active":"2023-08-31T02:00:03.188066+0000","last_became_peered":"2023-08-31T02:00:03.188066+0000","last_unstale":"2023-08-31T02:00:04.163679+0000","last_undegraded":"2023-08-31T02:00:04.163679+0000","last_fullsized":"2023-08-31T02:00:04.163679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:09:10.825351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167768+0000","last_change":"2023-08-31T01:59:58.135253+0000","last_active":"2023-08-31T02:00:03.167768+0000","last_peered":"2023-08-31T02:00:03.167768+0000","last_clean":"2023-08-31T02:00:03.167768+0000","last_became_active":"2023-08-31T01:59:58.134921+0000","last_became_peered":"2023-08-31T01:59:58.134921+0000","last_unstale":"2023-08-31T02:00:03.167768+0000","last_undegraded":"2023-08-31T02:00:03.167768+0000","last_fullsized":"2023-08-31T02:00:03.167768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180877+0000","last_change":"2023-08-31T01:59:59.145059+0000","last_active":"2023-08-31T02:00:03.180877+0000","last_peered":"2023-08-31T02:00:03.180877+0000","last_clean":"2023-08-31T02:00:03.180877+0000","last_became_active":"2023-08-31T01:59:59.144515+0000","last_became_peered":"2023-08-31T01:59:59.144515+0000","last_unstale":"2023-08-31T02:00:03.180877+0000","last_undegraded":"2023-08-31T02:00:03.180877+0000","last_fullsized":"2023-08-31T02:00:03.180877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:44:59.715888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241799+0000","last_change":"2023-08-31T02:00:03.183733+0000","last_active":"2023-08-31T02:00:04.241799+0000","last_peered":"2023-08-31T02:00:04.241799+0000","last_clean":"2023-08-31T02:00:04.241799+0000","last_became_active":"2023-08-31T02:00:03.182189+0000","last_became_peered":"2023-08-31T02:00:03.182189+0000","last_unstale":"2023-08-31T02:00:04.241799+0000","last_undegraded":"2023-08-31T02:00:04.241799+0000","last_fullsized":"2023-08-31T02:00:04.241799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181991+0000","last_change":"2023-08-31T01:59:58.137521+0000","last_active":"2023-08-31T02:00:03.181991+0000","last_peered":"2023-08-31T02:00:03.181991+0000","last_clean":"2023-08-31T02:00:03.181991+0000","last_became_active":"2023-08-31T01:59:58.137005+0000","last_became_peered":"2023-08-31T01:59:58.137005+0000","last_unstale":"2023-08-31T02:00:03.181991+0000","last_undegraded":"2023-08-31T02:00:03.181991+0000","last_fullsized":"2023-08-31T02:00:03.181991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:19:46.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163694+0000","last_change":"2023-08-31T01:59:59.146679+0000","last_active":"2023-08-31T02:00:03.163694+0000","last_peered":"2023-08-31T02:00:03.163694+0000","last_clean":"2023-08-31T02:00:03.163694+0000","last_became_active":"2023-08-31T01:59:59.146349+0000","last_became_peered":"2023-08-31T01:59:59.146349+0000","last_unstale":"2023-08-31T02:00:03.163694+0000","last_undegraded":"2023-08-31T02:00:03.163694+0000","last_fullsized":"2023-08-31T02:00:03.163694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:16:30.278083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241357+0000","last_change":"2023-08-31T02:00:03.187301+0000","last_active":"2023-08-31T02:00:04.241357+0000","last_peered":"2023-08-31T02:00:04.241357+0000","last_clean":"2023-08-31T02:00:04.241357+0000","last_became_active":"2023-08-31T02:00:03.186919+0000","last_became_peered":"2023-08-31T02:00:03.186919+0000","last_unstale":"2023-08-31T02:00:04.241357+0000","last_undegraded":"2023-08-31T02:00:04.241357+0000","last_fullsized":"2023-08-31T02:00:04.241357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162774+0000","last_change":"2023-08-31T01:59:58.137889+0000","last_active":"2023-08-31T02:00:03.162774+0000","last_peered":"2023-08-31T02:00:03.162774+0000","last_clean":"2023-08-31T02:00:03.162774+0000","last_became_active":"2023-08-31T01:59:58.137474+0000","last_became_peered":"2023-08-31T01:59:58.137474+0000","last_unstale":"2023-08-31T02:00:03.162774+0000","last_undegraded":"2023-08-31T02:00:03.162774+0000","last_fullsized":"2023-08-31T02:00:03.162774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:58:27.973576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167300+0000","last_change":"2023-08-31T01:59:59.135054+0000","last_active":"2023-08-31T02:00:03.167300+0000","last_peered":"2023-08-31T02:00:03.167300+0000","last_clean":"2023-08-31T02:00:03.167300+0000","last_became_active":"2023-08-31T01:59:59.134692+0000","last_became_peered":"2023-08-31T01:59:59.134692+0000","last_unstale":"2023-08-31T02:00:03.167300+0000","last_undegraded":"2023-08-31T02:00:03.167300+0000","last_fullsized":"2023-08-31T02:00:03.167300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:11.423606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241980+0000","last_change":"2023-08-31T02:00:03.183047+0000","last_active":"2023-08-31T02:00:04.241980+0000","last_peered":"2023-08-31T02:00:04.241980+0000","last_clean":"2023-08-31T02:00:04.241980+0000","last_became_active":"2023-08-31T02:00:03.182647+0000","last_became_peered":"2023-08-31T02:00:03.182647+0000","last_unstale":"2023-08-31T02:00:04.241980+0000","last_undegraded":"2023-08-31T02:00:04.241980+0000","last_fullsized":"2023-08-31T02:00:04.241980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:12:08.637395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182207+0000","last_change":"2023-08-31T01:59:59.127102+0000","last_active":"2023-08-31T02:00:03.182207+0000","last_peered":"2023-08-31T02:00:03.182207+0000","last_clean":"2023-08-31T02:00:03.182207+0000","last_became_active":"2023-08-31T01:59:59.126795+0000","last_became_peered":"2023-08-31T01:59:59.126795+0000","last_unstale":"2023-08-31T02:00:03.182207+0000","last_undegraded":"2023-08-31T02:00:03.182207+0000","last_fullsized":"2023-08-31T02:00:03.182207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:03.652877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.172443+0000","last_change":"2023-08-31T01:59:58.128837+0000","last_active":"2023-08-31T02:00:03.172443+0000","last_peered":"2023-08-31T02:00:03.172443+0000","last_clean":"2023-08-31T02:00:03.172443+0000","last_became_active":"2023-08-31T01:59:58.128553+0000","last_became_peered":"2023-08-31T01:59:58.128553+0000","last_unstale":"2023-08-31T02:00:03.172443+0000","last_undegraded":"2023-08-31T02:00:03.172443+0000","last_fullsized":"2023-08-31T02:00:03.172443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:40:45.576262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242548+0000","last_change":"2023-08-31T02:00:03.183013+0000","last_active":"2023-08-31T02:00:04.242548+0000","last_peered":"2023-08-31T02:00:04.242548+0000","last_clean":"2023-08-31T02:00:04.242548+0000","last_became_active":"2023-08-31T02:00:03.182620+0000","last_became_peered":"2023-08-31T02:00:03.182620+0000","last_unstale":"2023-08-31T02:00:04.242548+0000","last_undegraded":"2023-08-31T02:00:04.242548+0000","last_fullsized":"2023-08-31T02:00:04.242548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162206+0000","last_change":"2023-08-31T01:59:59.135012+0000","last_active":"2023-08-31T02:00:03.162206+0000","last_peered":"2023-08-31T02:00:03.162206+0000","last_clean":"2023-08-31T02:00:03.162206+0000","last_became_active":"2023-08-31T01:59:59.134742+0000","last_became_peered":"2023-08-31T01:59:59.134742+0000","last_unstale":"2023-08-31T02:00:03.162206+0000","last_undegraded":"2023-08-31T02:00:03.162206+0000","last_fullsized":"2023-08-31T02:00:03.162206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:09:03.292169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163085+0000","last_change":"2023-08-31T01:59:58.133974+0000","last_active":"2023-08-31T02:00:03.163085+0000","last_peered":"2023-08-31T02:00:03.163085+0000","last_clean":"2023-08-31T02:00:03.163085+0000","last_became_active":"2023-08-31T01:59:58.133700+0000","last_became_peered":"2023-08-31T01:59:58.133700+0000","last_unstale":"2023-08-31T02:00:03.163085+0000","last_undegraded":"2023-08-31T02:00:03.163085+0000","last_fullsized":"2023-08-31T02:00:03.163085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:28:01.725513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180556+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:00:03.180556+0000","last_peered":"2023-08-31T02:00:03.180556+0000","last_clean":"2023-08-31T02:00:03.180556+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:00:03.180556+0000","last_undegraded":"2023-08-31T02:00:03.180556+0000","last_fullsized":"2023-08-31T02:00:03.180556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242374+0000","last_change":"2023-08-31T02:00:03.185255+0000","last_active":"2023-08-31T02:00:04.242374+0000","last_peered":"2023-08-31T02:00:04.242374+0000","last_clean":"2023-08-31T02:00:04.242374+0000","last_became_active":"2023-08-31T02:00:03.184861+0000","last_became_peered":"2023-08-31T02:00:03.184861+0000","last_unstale":"2023-08-31T02:00:04.242374+0000","last_undegraded":"2023-08-31T02:00:04.242374+0000","last_fullsized":"2023-08-31T02:00:04.242374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:54:48.202310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167610+0000","last_change":"2023-08-31T01:59:59.135368+0000","last_active":"2023-08-31T02:00:03.167610+0000","last_peered":"2023-08-31T02:00:03.167610+0000","last_clean":"2023-08-31T02:00:03.167610+0000","last_became_active":"2023-08-31T01:59:59.135074+0000","last_became_peered":"2023-08-31T01:59:59.135074+0000","last_unstale":"2023-08-31T02:00:03.167610+0000","last_undegraded":"2023-08-31T02:00:03.167610+0000","last_fullsized":"2023-08-31T02:00:03.167610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:41.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180603+0000","last_change":"2023-08-31T01:59:58.141143+0000","last_active":"2023-08-31T02:00:03.180603+0000","last_peered":"2023-08-31T02:00:03.180603+0000","last_clean":"2023-08-31T02:00:03.180603+0000","last_became_active":"2023-08-31T01:59:58.140680+0000","last_became_peered":"2023-08-31T01:59:58.140680+0000","last_unstale":"2023-08-31T02:00:03.180603+0000","last_undegraded":"2023-08-31T02:00:03.180603+0000","last_fullsized":"2023-08-31T02:00:03.180603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241818+0000","last_change":"2023-08-31T02:00:03.187482+0000","last_active":"2023-08-31T02:00:04.241818+0000","last_peered":"2023-08-31T02:00:04.241818+0000","last_clean":"2023-08-31T02:00:04.241818+0000","last_became_active":"2023-08-31T02:00:03.186856+0000","last_became_peered":"2023-08-31T02:00:03.186856+0000","last_unstale":"2023-08-31T02:00:04.241818+0000","last_undegraded":"2023-08-31T02:00:04.241818+0000","last_fullsized":"2023-08-31T02:00:04.241818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180775+0000","last_change":"2023-08-31T01:59:58.143295+0000","last_active":"2023-08-31T02:00:03.180775+0000","last_peered":"2023-08-31T02:00:03.180775+0000","last_clean":"2023-08-31T02:00:03.180775+0000","last_became_active":"2023-08-31T01:59:58.142985+0000","last_became_peered":"2023-08-31T01:59:58.142985+0000","last_unstale":"2023-08-31T02:00:03.180775+0000","last_undegraded":"2023-08-31T02:00:03.180775+0000","last_fullsized":"2023-08-31T02:00:03.180775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:10:40.175561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182106+0000","last_change":"2023-08-31T01:59:59.127832+0000","last_active":"2023-08-31T02:00:03.182106+0000","last_peered":"2023-08-31T02:00:03.182106+0000","last_clean":"2023-08-31T02:00:03.182106+0000","last_became_active":"2023-08-31T01:59:59.127564+0000","last_became_peered":"2023-08-31T01:59:59.127564+0000","last_unstale":"2023-08-31T02:00:03.182106+0000","last_undegraded":"2023-08-31T02:00:03.182106+0000","last_fullsized":"2023-08-31T02:00:03.182106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.162998+0000","last_change":"2023-08-31T02:00:03.191988+0000","last_active":"2023-08-31T02:00:04.162998+0000","last_peered":"2023-08-31T02:00:04.162998+0000","last_clean":"2023-08-31T02:00:04.162998+0000","last_became_active":"2023-08-31T02:00:03.191349+0000","last_became_peered":"2023-08-31T02:00:03.191349+0000","last_unstale":"2023-08-31T02:00:04.162998+0000","last_undegraded":"2023-08-31T02:00:04.162998+0000","last_fullsized":"2023-08-31T02:00:04.162998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:00:23.252798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183026+0000","last_change":"2023-08-31T01:59:58.138706+0000","last_active":"2023-08-31T02:00:03.183026+0000","last_peered":"2023-08-31T02:00:03.183026+0000","last_clean":"2023-08-31T02:00:03.183026+0000","last_became_active":"2023-08-31T01:59:58.138320+0000","last_became_peered":"2023-08-31T01:59:58.138320+0000","last_unstale":"2023-08-31T02:00:03.183026+0000","last_undegraded":"2023-08-31T02:00:03.183026+0000","last_fullsized":"2023-08-31T02:00:03.183026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:38:10.392703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164651+0000","last_change":"2023-08-31T01:59:59.144937+0000","last_active":"2023-08-31T02:00:03.164651+0000","last_peered":"2023-08-31T02:00:03.164651+0000","last_clean":"2023-08-31T02:00:03.164651+0000","last_became_active":"2023-08-31T01:59:59.144653+0000","last_became_peered":"2023-08-31T01:59:59.144653+0000","last_unstale":"2023-08-31T02:00:03.164651+0000","last_undegraded":"2023-08-31T02:00:03.164651+0000","last_fullsized":"2023-08-31T02:00:03.164651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:43:55.591253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.163711+0000","last_change":"2023-08-31T02:00:03.185348+0000","last_active":"2023-08-31T02:00:04.163711+0000","last_peered":"2023-08-31T02:00:04.163711+0000","last_clean":"2023-08-31T02:00:04.163711+0000","last_became_active":"2023-08-31T02:00:03.184977+0000","last_became_peered":"2023-08-31T02:00:03.184977+0000","last_unstale":"2023-08-31T02:00:04.163711+0000","last_undegraded":"2023-08-31T02:00:04.163711+0000","last_fullsized":"2023-08-31T02:00:04.163711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:36:29.967309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171706+0000","last_change":"2023-08-31T01:59:58.142445+0000","last_active":"2023-08-31T02:00:03.171706+0000","last_peered":"2023-08-31T02:00:03.171706+0000","last_clean":"2023-08-31T02:00:03.171706+0000","last_became_active":"2023-08-31T01:59:58.142166+0000","last_became_peered":"2023-08-31T01:59:58.142166+0000","last_unstale":"2023-08-31T02:00:03.171706+0000","last_undegraded":"2023-08-31T02:00:03.171706+0000","last_fullsized":"2023-08-31T02:00:03.171706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:35.559503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170228+0000","last_change":"2023-08-31T01:59:59.139657+0000","last_active":"2023-08-31T02:00:03.170228+0000","last_peered":"2023-08-31T02:00:03.170228+0000","last_clean":"2023-08-31T02:00:03.170228+0000","last_became_active":"2023-08-31T01:59:59.139380+0000","last_became_peered":"2023-08-31T01:59:59.139380+0000","last_unstale":"2023-08-31T02:00:03.170228+0000","last_undegraded":"2023-08-31T02:00:03.170228+0000","last_fullsized":"2023-08-31T02:00:03.170228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164032+0000","last_change":"2023-08-31T02:00:03.187756+0000","last_active":"2023-08-31T02:00:04.164032+0000","last_peered":"2023-08-31T02:00:04.164032+0000","last_clean":"2023-08-31T02:00:04.164032+0000","last_became_active":"2023-08-31T02:00:03.187322+0000","last_became_peered":"2023-08-31T02:00:03.187322+0000","last_unstale":"2023-08-31T02:00:04.164032+0000","last_undegraded":"2023-08-31T02:00:04.164032+0000","last_fullsized":"2023-08-31T02:00:04.164032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:37:30.912467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180456+0000","last_change":"2023-08-31T01:59:58.143349+0000","last_active":"2023-08-31T02:00:03.180456+0000","last_peered":"2023-08-31T02:00:03.180456+0000","last_clean":"2023-08-31T02:00:03.180456+0000","last_became_active":"2023-08-31T01:59:58.143019+0000","last_became_peered":"2023-08-31T01:59:58.143019+0000","last_unstale":"2023-08-31T02:00:03.180456+0000","last_undegraded":"2023-08-31T02:00:03.180456+0000","last_fullsized":"2023-08-31T02:00:03.180456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:58:23.430586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.167307+0000","last_change":"2023-08-31T01:59:59.137822+0000","last_active":"2023-08-31T02:00:03.167307+0000","last_peered":"2023-08-31T02:00:03.167307+0000","last_clean":"2023-08-31T02:00:03.167307+0000","last_became_active":"2023-08-31T01:59:59.137558+0000","last_became_peered":"2023-08-31T01:59:59.137558+0000","last_unstale":"2023-08-31T02:00:03.167307+0000","last_undegraded":"2023-08-31T02:00:03.167307+0000","last_fullsized":"2023-08-31T02:00:03.167307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:32:57.084676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.242210+0000","last_change":"2023-08-31T02:00:03.182827+0000","last_active":"2023-08-31T02:00:04.242210+0000","last_peered":"2023-08-31T02:00:04.242210+0000","last_clean":"2023-08-31T02:00:04.242210+0000","last_became_active":"2023-08-31T02:00:03.182438+0000","last_became_peered":"2023-08-31T02:00:03.182438+0000","last_unstale":"2023-08-31T02:00:04.242210+0000","last_undegraded":"2023-08-31T02:00:04.242210+0000","last_fullsized":"2023-08-31T02:00:04.242210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:22:47.889737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182678+0000","last_change":"2023-08-31T01:59:58.142002+0000","last_active":"2023-08-31T02:00:03.182678+0000","last_peered":"2023-08-31T02:00:03.182678+0000","last_clean":"2023-08-31T02:00:03.182678+0000","last_became_active":"2023-08-31T01:59:58.141736+0000","last_became_peered":"2023-08-31T01:59:58.141736+0000","last_unstale":"2023-08-31T02:00:03.182678+0000","last_undegraded":"2023-08-31T02:00:03.182678+0000","last_fullsized":"2023-08-31T02:00:03.182678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:52.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.161862+0000","last_change":"2023-08-31T01:59:59.141837+0000","last_active":"2023-08-31T02:00:03.161862+0000","last_peered":"2023-08-31T02:00:03.161862+0000","last_clean":"2023-08-31T02:00:03.161862+0000","last_became_active":"2023-08-31T01:59:59.141556+0000","last_became_peered":"2023-08-31T01:59:59.141556+0000","last_unstale":"2023-08-31T02:00:03.161862+0000","last_undegraded":"2023-08-31T02:00:03.161862+0000","last_fullsized":"2023-08-31T02:00:03.161862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:49:59.637746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164152+0000","last_change":"2023-08-31T02:00:03.189684+0000","last_active":"2023-08-31T02:00:04.164152+0000","last_peered":"2023-08-31T02:00:04.164152+0000","last_clean":"2023-08-31T02:00:04.164152+0000","last_became_active":"2023-08-31T02:00:03.187373+0000","last_became_peered":"2023-08-31T02:00:03.187373+0000","last_unstale":"2023-08-31T02:00:04.164152+0000","last_undegraded":"2023-08-31T02:00:04.164152+0000","last_fullsized":"2023-08-31T02:00:04.164152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:21.879013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.182660+0000","last_change":"2023-08-31T01:59:58.136945+0000","last_active":"2023-08-31T02:00:03.182660+0000","last_peered":"2023-08-31T02:00:03.182660+0000","last_clean":"2023-08-31T02:00:03.182660+0000","last_became_active":"2023-08-31T01:59:58.136593+0000","last_became_peered":"2023-08-31T01:59:58.136593+0000","last_unstale":"2023-08-31T02:00:03.182660+0000","last_undegraded":"2023-08-31T02:00:03.182660+0000","last_fullsized":"2023-08-31T02:00:03.182660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:59:35.632366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162451+0000","last_change":"2023-08-31T01:59:59.137446+0000","last_active":"2023-08-31T02:00:03.162451+0000","last_peered":"2023-08-31T02:00:03.162451+0000","last_clean":"2023-08-31T02:00:03.162451+0000","last_became_active":"2023-08-31T01:59:59.137156+0000","last_became_peered":"2023-08-31T01:59:59.137156+0000","last_unstale":"2023-08-31T02:00:03.162451+0000","last_undegraded":"2023-08-31T02:00:03.162451+0000","last_fullsized":"2023-08-31T02:00:03.162451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:58:28.980446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164210+0000","last_change":"2023-08-31T02:00:03.186822+0000","last_active":"2023-08-31T02:00:04.164210+0000","last_peered":"2023-08-31T02:00:04.164210+0000","last_clean":"2023-08-31T02:00:04.164210+0000","last_became_active":"2023-08-31T02:00:03.186360+0000","last_became_peered":"2023-08-31T02:00:03.186360+0000","last_unstale":"2023-08-31T02:00:04.164210+0000","last_undegraded":"2023-08-31T02:00:04.164210+0000","last_fullsized":"2023-08-31T02:00:04.164210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:37:09.437523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180642+0000","last_change":"2023-08-31T01:59:58.144977+0000","last_active":"2023-08-31T02:00:03.180642+0000","last_peered":"2023-08-31T02:00:03.180642+0000","last_clean":"2023-08-31T02:00:03.180642+0000","last_became_active":"2023-08-31T01:59:58.144682+0000","last_became_peered":"2023-08-31T01:59:58.144682+0000","last_unstale":"2023-08-31T02:00:03.180642+0000","last_undegraded":"2023-08-31T02:00:03.180642+0000","last_fullsized":"2023-08-31T02:00:03.180642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:54:31.237887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170405+0000","last_change":"2023-08-31T01:59:59.145992+0000","last_active":"2023-08-31T02:00:03.170405+0000","last_peered":"2023-08-31T02:00:03.170405+0000","last_clean":"2023-08-31T02:00:03.170405+0000","last_became_active":"2023-08-31T01:59:59.142856+0000","last_became_peered":"2023-08-31T01:59:59.142856+0000","last_unstale":"2023-08-31T02:00:03.170405+0000","last_undegraded":"2023-08-31T02:00:03.170405+0000","last_fullsized":"2023-08-31T02:00:03.170405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:55:37.306441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241755+0000","last_change":"2023-08-31T02:00:03.189530+0000","last_active":"2023-08-31T02:00:04.241755+0000","last_peered":"2023-08-31T02:00:04.241755+0000","last_clean":"2023-08-31T02:00:04.241755+0000","last_became_active":"2023-08-31T02:00:03.189045+0000","last_became_peered":"2023-08-31T02:00:03.189045+0000","last_unstale":"2023-08-31T02:00:04.241755+0000","last_undegraded":"2023-08-31T02:00:04.241755+0000","last_fullsized":"2023-08-31T02:00:04.241755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:17:40.987227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.173234+0000","last_change":"2023-08-31T01:59:58.133537+0000","last_active":"2023-08-31T02:00:03.173234+0000","last_peered":"2023-08-31T02:00:03.173234+0000","last_clean":"2023-08-31T02:00:03.173234+0000","last_became_active":"2023-08-31T01:59:58.133222+0000","last_became_peered":"2023-08-31T01:59:58.133222+0000","last_unstale":"2023-08-31T02:00:03.173234+0000","last_undegraded":"2023-08-31T02:00:03.173234+0000","last_fullsized":"2023-08-31T02:00:03.173234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:17.281385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.180864+0000","last_change":"2023-08-31T01:59:59.149486+0000","last_active":"2023-08-31T02:00:03.180864+0000","last_peered":"2023-08-31T02:00:03.180864+0000","last_clean":"2023-08-31T02:00:03.180864+0000","last_became_active":"2023-08-31T01:59:59.149195+0000","last_became_peered":"2023-08-31T01:59:59.149195+0000","last_unstale":"2023-08-31T02:00:03.180864+0000","last_undegraded":"2023-08-31T02:00:03.180864+0000","last_fullsized":"2023-08-31T02:00:03.180864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:55:02.768810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.241656+0000","last_change":"2023-08-31T02:00:03.194590+0000","last_active":"2023-08-31T02:00:04.241656+0000","last_peered":"2023-08-31T02:00:04.241656+0000","last_clean":"2023-08-31T02:00:04.241656+0000","last_became_active":"2023-08-31T02:00:03.194028+0000","last_became_peered":"2023-08-31T02:00:03.194028+0000","last_unstale":"2023-08-31T02:00:04.241656+0000","last_undegraded":"2023-08-31T02:00:04.241656+0000","last_fullsized":"2023-08-31T02:00:04.241656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:21.879013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183319+0000","last_change":"2023-08-31T01:59:58.140223+0000","last_active":"2023-08-31T02:00:03.183319+0000","last_peered":"2023-08-31T02:00:03.183319+0000","last_clean":"2023-08-31T02:00:03.183319+0000","last_became_active":"2023-08-31T01:59:58.139966+0000","last_became_peered":"2023-08-31T01:59:58.139966+0000","last_unstale":"2023-08-31T02:00:03.183319+0000","last_undegraded":"2023-08-31T02:00:03.183319+0000","last_fullsized":"2023-08-31T02:00:03.183319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162651+0000","last_change":"2023-08-31T01:59:59.139152+0000","last_active":"2023-08-31T02:00:03.162651+0000","last_peered":"2023-08-31T02:00:03.162651+0000","last_clean":"2023-08-31T02:00:03.162651+0000","last_became_active":"2023-08-31T01:59:59.138887+0000","last_became_peered":"2023-08-31T01:59:59.138887+0000","last_unstale":"2023-08-31T02:00:03.162651+0000","last_undegraded":"2023-08-31T02:00:03.162651+0000","last_fullsized":"2023-08-31T02:00:03.162651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:35:52.979172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T02:00:04.164612+0000","last_change":"2023-08-31T02:00:03.182923+0000","last_active":"2023-08-31T02:00:04.164612+0000","last_peered":"2023-08-31T02:00:04.164612+0000","last_clean":"2023-08-31T02:00:04.164612+0000","last_became_active":"2023-08-31T02:00:03.182486+0000","last_became_peered":"2023-08-31T02:00:03.182486+0000","last_unstale":"2023-08-31T02:00:04.164612+0000","last_undegraded":"2023-08-31T02:00:04.164612+0000","last_fullsized":"2023-08-31T02:00:04.164612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:00:02.151047+0000","last_clean_scrub_stamp":"2023-08-31T02:00:02.151047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:45:19.479655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.176209+0000","last_change":"2023-08-31T01:59:58.130739+0000","last_active":"2023-08-31T02:00:03.176209+0000","last_peered":"2023-08-31T02:00:03.176209+0000","last_clean":"2023-08-31T02:00:03.176209+0000","last_became_active":"2023-08-31T01:59:58.130559+0000","last_became_peered":"2023-08-31T01:59:58.130559+0000","last_unstale":"2023-08-31T02:00:03.176209+0000","last_undegraded":"2023-08-31T02:00:03.176209+0000","last_fullsized":"2023-08-31T02:00:03.176209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:57.107290+0000","last_clean_scrub_stamp":"2023-08-31T01:59:57.107290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:52:30.384278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.181104+0000","last_change":"2023-08-31T01:59:59.149408+0000","last_active":"2023-08-31T02:00:03.181104+0000","last_peered":"2023-08-31T02:00:03.181104+0000","last_clean":"2023-08-31T02:00:03.181104+0000","last_became_active":"2023-08-31T01:59:59.149129+0000","last_became_peered":"2023-08-31T01:59:59.149129+0000","last_unstale":"2023-08-31T02:00:03.181104+0000","last_undegraded":"2023-08-31T02:00:03.181104+0000","last_fullsized":"2023-08-31T02:00:03.181104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:45:03.255566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171183+0000","last_change":"2023-08-31T01:59:59.141296+0000","last_active":"2023-08-31T02:00:03.171183+0000","last_peered":"2023-08-31T02:00:03.171183+0000","last_clean":"2023-08-31T02:00:03.171183+0000","last_became_active":"2023-08-31T01:59:59.141010+0000","last_became_peered":"2023-08-31T01:59:59.141010+0000","last_unstale":"2023-08-31T02:00:03.171183+0000","last_undegraded":"2023-08-31T02:00:03.171183+0000","last_fullsized":"2023-08-31T02:00:03.171183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.172411+0000","last_change":"2023-08-31T01:59:59.129754+0000","last_active":"2023-08-31T02:00:03.172411+0000","last_peered":"2023-08-31T02:00:03.172411+0000","last_clean":"2023-08-31T02:00:03.172411+0000","last_became_active":"2023-08-31T01:59:59.127954+0000","last_became_peered":"2023-08-31T01:59:59.127954+0000","last_unstale":"2023-08-31T02:00:03.172411+0000","last_undegraded":"2023-08-31T02:00:03.172411+0000","last_fullsized":"2023-08-31T02:00:03.172411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:19.243425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162957+0000","last_change":"2023-08-31T01:59:59.139684+0000","last_active":"2023-08-31T02:00:03.162957+0000","last_peered":"2023-08-31T02:00:03.162957+0000","last_clean":"2023-08-31T02:00:03.162957+0000","last_became_active":"2023-08-31T01:59:59.139233+0000","last_became_peered":"2023-08-31T01:59:59.139233+0000","last_unstale":"2023-08-31T02:00:03.162957+0000","last_undegraded":"2023-08-31T02:00:03.162957+0000","last_fullsized":"2023-08-31T02:00:03.162957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:50:06.678223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169434+0000","last_change":"2023-08-31T01:59:59.139203+0000","last_active":"2023-08-31T02:00:03.169434+0000","last_peered":"2023-08-31T02:00:03.169434+0000","last_clean":"2023-08-31T02:00:03.169434+0000","last_became_active":"2023-08-31T01:59:59.138931+0000","last_became_peered":"2023-08-31T01:59:59.138931+0000","last_unstale":"2023-08-31T02:00:03.169434+0000","last_undegraded":"2023-08-31T02:00:03.169434+0000","last_fullsized":"2023-08-31T02:00:03.169434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:08:51.629657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162361+0000","last_change":"2023-08-31T01:59:59.147334+0000","last_active":"2023-08-31T02:00:03.162361+0000","last_peered":"2023-08-31T02:00:03.162361+0000","last_clean":"2023-08-31T02:00:03.162361+0000","last_became_active":"2023-08-31T01:59:59.146910+0000","last_became_peered":"2023-08-31T01:59:59.146910+0000","last_unstale":"2023-08-31T02:00:03.162361+0000","last_undegraded":"2023-08-31T02:00:03.162361+0000","last_fullsized":"2023-08-31T02:00:03.162361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:56:16.408773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.183223+0000","last_change":"2023-08-31T01:59:59.139784+0000","last_active":"2023-08-31T02:00:03.183223+0000","last_peered":"2023-08-31T02:00:03.183223+0000","last_clean":"2023-08-31T02:00:03.183223+0000","last_became_active":"2023-08-31T01:59:59.139504+0000","last_became_peered":"2023-08-31T01:59:59.139504+0000","last_unstale":"2023-08-31T02:00:03.183223+0000","last_undegraded":"2023-08-31T02:00:03.183223+0000","last_fullsized":"2023-08-31T02:00:03.183223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:24:58.176806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.171308+0000","last_change":"2023-08-31T01:59:59.146628+0000","last_active":"2023-08-31T02:00:03.171308+0000","last_peered":"2023-08-31T02:00:03.171308+0000","last_clean":"2023-08-31T02:00:03.171308+0000","last_became_active":"2023-08-31T01:59:59.146283+0000","last_became_peered":"2023-08-31T01:59:59.146283+0000","last_unstale":"2023-08-31T02:00:03.171308+0000","last_undegraded":"2023-08-31T02:00:03.171308+0000","last_fullsized":"2023-08-31T02:00:03.171308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:06:41.700547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.164760+0000","last_change":"2023-08-31T01:59:59.142109+0000","last_active":"2023-08-31T02:00:03.164760+0000","last_peered":"2023-08-31T02:00:03.164760+0000","last_clean":"2023-08-31T02:00:03.164760+0000","last_became_active":"2023-08-31T01:59:59.141757+0000","last_became_peered":"2023-08-31T01:59:59.141757+0000","last_unstale":"2023-08-31T02:00:03.164760+0000","last_undegraded":"2023-08-31T02:00:03.164760+0000","last_fullsized":"2023-08-31T02:00:03.164760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:13:24.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163648+0000","last_change":"2023-08-31T01:59:59.142887+0000","last_active":"2023-08-31T02:00:03.163648+0000","last_peered":"2023-08-31T02:00:03.163648+0000","last_clean":"2023-08-31T02:00:03.163648+0000","last_became_active":"2023-08-31T01:59:59.142576+0000","last_became_peered":"2023-08-31T01:59:59.142576+0000","last_unstale":"2023-08-31T02:00:03.163648+0000","last_undegraded":"2023-08-31T02:00:03.163648+0000","last_fullsized":"2023-08-31T02:00:03.163648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:13:24.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.162037+0000","last_change":"2023-08-31T01:59:59.144355+0000","last_active":"2023-08-31T02:00:03.162037+0000","last_peered":"2023-08-31T02:00:03.162037+0000","last_clean":"2023-08-31T02:00:03.162037+0000","last_became_active":"2023-08-31T01:59:59.144045+0000","last_became_peered":"2023-08-31T01:59:59.144045+0000","last_unstale":"2023-08-31T02:00:03.162037+0000","last_undegraded":"2023-08-31T02:00:03.162037+0000","last_fullsized":"2023-08-31T02:00:03.162037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:36:58.237436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.163460+0000","last_change":"2023-08-31T01:59:59.139501+0000","last_active":"2023-08-31T02:00:03.163460+0000","last_peered":"2023-08-31T02:00:03.163460+0000","last_clean":"2023-08-31T02:00:03.163460+0000","last_became_active":"2023-08-31T01:59:59.138918+0000","last_became_peered":"2023-08-31T01:59:59.138918+0000","last_unstale":"2023-08-31T02:00:03.163460+0000","last_undegraded":"2023-08-31T02:00:03.163460+0000","last_fullsized":"2023-08-31T02:00:03.163460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:43:55.591253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.169517+0000","last_change":"2023-08-31T01:59:59.143302+0000","last_active":"2023-08-31T02:00:03.169517+0000","last_peered":"2023-08-31T02:00:03.169517+0000","last_clean":"2023-08-31T02:00:03.169517+0000","last_became_active":"2023-08-31T01:59:59.142853+0000","last_became_peered":"2023-08-31T01:59:59.142853+0000","last_unstale":"2023-08-31T02:00:03.169517+0000","last_undegraded":"2023-08-31T02:00:03.169517+0000","last_fullsized":"2023-08-31T02:00:03.169517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:54:32.244757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T02:00:03.170712+0000","last_change":"2023-08-31T01:59:59.144185+0000","last_active":"2023-08-31T02:00:03.170712+0000","last_peered":"2023-08-31T02:00:03.170712+0000","last_clean":"2023-08-31T02:00:03.170712+0000","last_became_active":"2023-08-31T01:59:59.143219+0000","last_became_peered":"2023-08-31T01:59:59.143219+0000","last_unstale":"2023-08-31T02:00:03.170712+0000","last_undegraded":"2023-08-31T02:00:03.170712+0000","last_fullsized":"2023-08-31T02:00:03.170712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:58.114159+0000","last_clean_scrub_stamp":"2023-08-31T01:59:58.114159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:04:42.647971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":107610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.659000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":698400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":698456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":107576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:00:22.689 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-31T02:00:22.690 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-31T02:00:22.690 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-31T02:00:22.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-31T02:00:22.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.851+0000 7fd4e17bb700 1 -- 172.21.15.84:0/3782132304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c4003a30 msgr2=0x7fd4c4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.851+0000 7fd4e17bb700 1 --2- 172.21.15.84:0/3782132304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c4003a30 0x7fd4c4003e50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000c310 tx=0x7fd4c4005880 comp rx=0 tx=0).stop 2023-08-31T02:00:22.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.851+0000 7fd4db7fe700 1 -- 172.21.15.84:0/3782132304 reap_dead start 2023-08-31T02:00:22.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.852+0000 7fd4e17bb700 1 -- 172.21.15.84:0/3782132304 shutdown_connections 2023-08-31T02:00:22.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.852+0000 7fd4e17bb700 1 -- 172.21.15.84:0/3782132304 >> 172.21.15.84:0/3782132304 conn(0x7fd4dc0699a0 msgr2=0x7fd4dc069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.852+0000 7fd4e17bb700 1 -- 172.21.15.84:0/3782132304 shutdown_connections 2023-08-31T02:00:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.852+0000 7fd4e17bb700 1 -- 172.21.15.84:0/3782132304 wait complete. 2023-08-31T02:00:22.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.853+0000 7fd4e17bb700 1 Processor -- start 2023-08-31T02:00:22.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.853+0000 7fd4e17bb700 1 -- start start 2023-08-31T02:00:22.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4e17bb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4c4003a30 0x7fd4dc0c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4e17bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4dc0c8d60 0x7fd4dc0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4e17bb700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4dc0c7690 0x7fd4dc0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4e17bb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0c8940 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4e17bb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0c7cc0 con 0x7fd4c4003a30 2023-08-31T02:00:22.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4e17bb700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0c7fa0 con 0x7fd4dc0c7690 2023-08-31T02:00:22.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4dc0c8d60 0x7fd4dc0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4dc0c8d60 0x7fd4dc0c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51818/0 (socket says 172.21.15.84:51818) 2023-08-31T02:00:22.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 -- 172.21.15.84:0/1844529763 learned_addr learned my addr 172.21.15.84:0/1844529763 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:22.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4daffd700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4c4003a30 0x7fd4dc0c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4db7fe700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4dc0c7690 0x7fd4dc0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 -- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4dc0c7690 msgr2=0x7fd4dc0c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4dc0c7690 0x7fd4dc0c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 -- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4c4003a30 msgr2=0x7fd4dc0c1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:22.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4c4003a30 0x7fd4dc0c1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:22.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 -- 172.21.15.84:0/1844529763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc0c8280 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4daffd700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4c4003a30 0x7fd4dc0c1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:22.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4da7fc700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4dc0c8d60 0x7fd4dc0c7150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc004ed0 tx=0x7fd4cc001530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:22.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4c37fe700 1 -- 172.21.15.84:0/1844529763 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc011660 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4c37fe700 1 -- 172.21.15.84:0/1844529763 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd4cc0118b0 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4dc0c8560 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4c37fe700 1 -- 172.21.15.84:0/1844529763 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc011c40 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.854+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4dc0c1ab0 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.855+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4dc0c8a80 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.856+0000 7fd4c37fe700 1 -- 172.21.15.84:0/1844529763 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd4cc01a400 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.856+0000 7fd4c37fe700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4c806a0e0 0x7fd4c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.856+0000 7fd4daffd700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4c806a0e0 0x7fd4c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.856+0000 7fd4c37fe700 1 -- 172.21.15.84:0/1844529763 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4cc0893c0 con 0x7fd4dc0c8d60 2023-08-31T02:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.857+0000 7fd4daffd700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4c806a0e0 0x7fd4c806c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0c2480 tx=0x7fd4d000f000 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:22.860+0000 7fd4c37fe700 1 -- 172.21.15.84:0/1844529763 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd4dc0c8a80 con 0x7fd4dc0c8d60 2023-08-31T02:00:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.092+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd4dc0c8a80 con 0x7fd4dc0c8d60 2023-08-31T02:00:23.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.092+0000 7fd4c37fe700 1 -- 172.21.15.84:0/1844529763 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd4dc0c8a80 con 0x7fd4dc0c8d60 2023-08-31T02:00:23.086 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:23.086 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-31T02:00:23.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4c806a0e0 msgr2=0x7fd4c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4c806a0e0 0x7fd4c806c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0c2480 tx=0x7fd4d000f000 comp rx=0 tx=0).stop 2023-08-31T02:00:23.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4dc0c8d60 msgr2=0x7fd4dc0c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4dc0c8d60 0x7fd4dc0c7150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc004ed0 tx=0x7fd4cc001530 comp rx=0 tx=0).stop 2023-08-31T02:00:23.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 shutdown_connections 2023-08-31T02:00:23.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4c806a0e0 0x7fd4c806c5a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4dc0c7690 0x7fd4dc0c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4c4003a30 0x7fd4dc0c1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 --2- 172.21.15.84:0/1844529763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4dc0c8d60 0x7fd4dc0c7150 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.094+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 >> 172.21.15.84:0/1844529763 conn(0x7fd4dc0699a0 msgr2=0x7fd4dc1595d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.095+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 shutdown_connections 2023-08-31T02:00:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.095+0000 7fd4e17bb700 1 -- 172.21.15.84:0/1844529763 wait complete. 2023-08-31T02:00:23.099 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-31T02:00:23.100 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.231+0000 7f93e9a45700 1 -- 172.21.15.84:0/1038390056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 msgr2=0x7f93e40b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.231+0000 7f93e9a45700 1 --2- 172.21.15.84:0/1038390056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 0x7f93e40b2ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f93d80098c0 tx=0x7f93d8009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.231+0000 7f93e9a45700 1 -- 172.21.15.84:0/1038390056 shutdown_connections 2023-08-31T02:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.231+0000 7f93e9a45700 1 --2- 172.21.15.84:0/1038390056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 0x7f93e40b2ce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.231+0000 7f93e9a45700 1 -- 172.21.15.84:0/1038390056 >> 172.21.15.84:0/1038390056 conn(0x7f93e40cdce0 msgr2=0x7f93e40ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.231+0000 7f93e9a45700 1 -- 172.21.15.84:0/1038390056 shutdown_connections 2023-08-31T02:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.231+0000 7f93e9a45700 1 -- 172.21.15.84:0/1038390056 wait complete. 2023-08-31T02:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.232+0000 7f93e9a45700 1 Processor -- start 2023-08-31T02:00:23.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.232+0000 7f93e9a45700 1 -- start start 2023-08-31T02:00:23.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e9a45700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93e40cc9a0 0x7f93e4156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e9a45700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 0x7f93e414ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e9a45700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e415fa70 0x7f93e40b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e9a45700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e414fd30 con 0x7f93e415b670 2023-08-31T02:00:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e9a45700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40c5b30 con 0x7f93e415fa70 2023-08-31T02:00:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e9a45700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e41544e0 con 0x7f93e40cc9a0 2023-08-31T02:00:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 0x7f93e414ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 0x7f93e414ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51832/0 (socket says 172.21.15.84:51832) 2023-08-31T02:00:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.233+0000 7f93e27fc700 1 -- 172.21.15.84:0/3256315478 learned_addr learned my addr 172.21.15.84:0/3256315478 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e2ffd700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93e40cc9a0 0x7f93e4156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e37fe700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e415fa70 0x7f93e40b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e27fc700 1 -- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93e40cc9a0 msgr2=0x7f93e4156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e27fc700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93e40cc9a0 0x7f93e4156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e27fc700 1 -- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e415fa70 msgr2=0x7f93e40b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e27fc700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e415fa70 0x7f93e40b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e27fc700 1 -- 172.21.15.84:0/3256315478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8009520 con 0x7f93e415b670 2023-08-31T02:00:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e2ffd700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93e40cc9a0 0x7f93e4156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e37fe700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e415fa70 0x7f93e40b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e27fc700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 0x7f93e414ecb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93d40011e0 tx=0x7f93d400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:23.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93cbfff700 1 -- 172.21.15.84:0/3256315478 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40054e0 con 0x7f93e415b670 2023-08-31T02:00:23.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93cbfff700 1 -- 172.21.15.84:0/3256315478 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93d4003680 con 0x7f93e415b670 2023-08-31T02:00:23.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e40c5dd0 con 0x7f93e415b670 2023-08-31T02:00:23.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93cbfff700 1 -- 172.21.15.84:0/3256315478 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4003a90 con 0x7f93e415b670 2023-08-31T02:00:23.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.234+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e40c6390 con 0x7f93e415b670 2023-08-31T02:00:23.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.235+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e40c6580 con 0x7f93e415b670 2023-08-31T02:00:23.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.235+0000 7f93cbfff700 1 -- 172.21.15.84:0/3256315478 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f93d4003bf0 con 0x7f93e415b670 2023-08-31T02:00:23.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.236+0000 7f93cbfff700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f93d006a0e0 0x7f93d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.236+0000 7f93cbfff700 1 -- 172.21.15.84:0/3256315478 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93d4087df0 con 0x7f93e415b670 2023-08-31T02:00:23.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.236+0000 7f93e2ffd700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f93d006a0e0 0x7f93d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.236+0000 7f93e2ffd700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f93d006a0e0 0x7f93d006c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009230 tx=0x7f93d80047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:23.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.240+0000 7f93cbfff700 1 -- 172.21.15.84:0/3256315478 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f93d40532f0 con 0x7f93e415b670 2023-08-31T02:00:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.433+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e404e7c0 con 0x7f93e415b670 2023-08-31T02:00:23.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.434+0000 7f93cbfff700 1 -- 172.21.15.84:0/3256315478 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f93d4056910 con 0x7f93e415b670 2023-08-31T02:00:23.428 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:23.429 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f93d006a0e0 msgr2=0x7f93d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f93d006a0e0 0x7f93d006c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009230 tx=0x7f93d80047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 msgr2=0x7f93e414ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 0x7f93e414ecb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93d40011e0 tx=0x7f93d400cae0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 shutdown_connections 2023-08-31T02:00:23.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f93d006a0e0 0x7f93d006c5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e415fa70 0x7f93e40b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93e40cc9a0 0x7f93e4156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 --2- 172.21.15.84:0/3256315478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93e415b670 0x7f93e414ecb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 >> 172.21.15.84:0/3256315478 conn(0x7f93e40cdce0 msgr2=0x7f93e415a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 shutdown_connections 2023-08-31T02:00:23.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.436+0000 7f93e9a45700 1 -- 172.21.15.84:0/3256315478 wait complete. 2023-08-31T02:00:23.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:23.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:23.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.576+0000 7f2a17343700 1 -- 172.21.15.84:0/562653512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015bce0 msgr2=0x7f2a100c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.576+0000 7f2a17343700 1 --2- 172.21.15.84:0/562653512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015bce0 0x7f2a100c9bc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2a100661a0 tx=0x7f2a0c009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.576+0000 7f2a17343700 1 -- 172.21.15.84:0/562653512 shutdown_connections 2023-08-31T02:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.576+0000 7f2a17343700 1 --2- 172.21.15.84:0/562653512 >> v2:172.21.15.170:3300/0 conn(0x7f2a1015b790 0x7f2a1006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.576+0000 7f2a17343700 1 --2- 172.21.15.84:0/562653512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015bce0 0x7f2a100c9bc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.576+0000 7f2a17343700 1 -- 172.21.15.84:0/562653512 >> 172.21.15.84:0/562653512 conn(0x7f2a100afb00 msgr2=0x7f2a100aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:23.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.576+0000 7f2a17343700 1 -- 172.21.15.84:0/562653512 shutdown_connections 2023-08-31T02:00:23.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.576+0000 7f2a17343700 1 -- 172.21.15.84:0/562653512 wait complete. 2023-08-31T02:00:23.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.577+0000 7f2a17343700 1 Processor -- start 2023-08-31T02:00:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.577+0000 7f2a17343700 1 -- start start 2023-08-31T02:00:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a17343700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a100ca100 0x7f2a1014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a17343700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015b790 0x7f2a100b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a17343700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a1015bce0 0x7f2a100ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a17343700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100b1690 con 0x7f2a1015b790 2023-08-31T02:00:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a17343700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100b1970 con 0x7f2a100ca100 2023-08-31T02:00:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a17343700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100b1c50 con 0x7f2a1015bce0 2023-08-31T02:00:23.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a148de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015b790 0x7f2a100b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a148de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015b790 0x7f2a100b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51846/0 (socket says 172.21.15.84:51846) 2023-08-31T02:00:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a148de700 1 -- 172.21.15.84:0/3570994249 learned_addr learned my addr 172.21.15.84:0/3570994249 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a150df700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a100ca100 0x7f2a1014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a158e0700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a1015bce0 0x7f2a100ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a148de700 1 -- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a1015bce0 msgr2=0x7f2a100ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a148de700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a1015bce0 0x7f2a100ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a148de700 1 -- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a100ca100 msgr2=0x7f2a1014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a148de700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a100ca100 0x7f2a1014c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a148de700 1 -- 172.21.15.84:0/3570994249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c0095f0 con 0x7f2a1015b790 2023-08-31T02:00:23.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.578+0000 7f2a158e0700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a1015bce0 0x7f2a100ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:23.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.579+0000 7f2a148de700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015b790 0x7f2a100b0bd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0098e0 tx=0x7f2a0c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:23.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.579+0000 7f2a05ffb700 1 -- 172.21.15.84:0/3570994249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c01c070 con 0x7f2a1015b790 2023-08-31T02:00:23.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.579+0000 7f2a05ffb700 1 -- 172.21.15.84:0/3570994249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2a0c003890 con 0x7f2a1015b790 2023-08-31T02:00:23.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.579+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a100b1f30 con 0x7f2a1015b790 2023-08-31T02:00:23.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.579+0000 7f2a05ffb700 1 -- 172.21.15.84:0/3570994249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c003c80 con 0x7f2a1015b790 2023-08-31T02:00:23.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.579+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1015a140 con 0x7f2a1015b790 2023-08-31T02:00:23.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.580+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a100b2450 con 0x7f2a1015b790 2023-08-31T02:00:23.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.580+0000 7f2a05ffb700 1 -- 172.21.15.84:0/3570994249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a0c00f460 con 0x7f2a1015b790 2023-08-31T02:00:23.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.581+0000 7f2a05ffb700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f29f406a0e0 0x7f29f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.581+0000 7f2a150df700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f29f406a0e0 0x7f29f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.581+0000 7f2a05ffb700 1 -- 172.21.15.84:0/3570994249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a0c089cb0 con 0x7f2a1015b790 2023-08-31T02:00:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.581+0000 7f2a150df700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f29f406a0e0 0x7f29f406c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005950 tx=0x7f2a000058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.585+0000 7f2a05ffb700 1 -- 172.21.15.84:0/3570994249 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a100b2450 con 0x7f2a1015b790 2023-08-31T02:00:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.774+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a100b2450 con 0x7f2a1015b790 2023-08-31T02:00:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.775+0000 7f2a05ffb700 1 -- 172.21.15.84:0/3570994249 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a100b2450 con 0x7f2a1015b790 2023-08-31T02:00:23.768 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f29f406a0e0 msgr2=0x7f29f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f29f406a0e0 0x7f29f406c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005950 tx=0x7f2a000058e0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015b790 msgr2=0x7f2a100b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015b790 0x7f2a100b0bd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0098e0 tx=0x7f2a0c00be90 comp rx=0 tx=0).stop 2023-08-31T02:00:23.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 shutdown_connections 2023-08-31T02:00:23.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f29f406a0e0 0x7f29f406c5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a1015bce0 0x7f2a100ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a100ca100 0x7f2a1014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 --2- 172.21.15.84:0/3570994249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a1015b790 0x7f2a100b0bd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 >> 172.21.15.84:0/3570994249 conn(0x7f2a100afb00 msgr2=0x7f2a1014cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:23.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 shutdown_connections 2023-08-31T02:00:23.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.777+0000 7f2a17343700 1 -- 172.21.15.84:0/3570994249 wait complete. 2023-08-31T02:00:23.781 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 -- 172.21.15.84:0/3440378163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca40ca100 msgr2=0x7f8ca40c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 --2- 172.21.15.84:0/3440378163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca40ca100 0x7f8ca40c8550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40cba80 tx=0x7f8c9c00b380 comp rx=0 tx=0).stop 2023-08-31T02:00:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 -- 172.21.15.84:0/3440378163 shutdown_connections 2023-08-31T02:00:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 --2- 172.21.15.84:0/3440378163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca40ca100 0x7f8ca40c8550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 --2- 172.21.15.84:0/3440378163 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415b790 0x7f8ca406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 --2- 172.21.15.84:0/3440378163 >> v2:172.21.15.170:3300/0 conn(0x7f8ca415bce0 0x7f8ca40c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 -- 172.21.15.84:0/3440378163 >> 172.21.15.84:0/3440378163 conn(0x7f8ca40afb00 msgr2=0x7f8ca40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 -- 172.21.15.84:0/3440378163 shutdown_connections 2023-08-31T02:00:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.913+0000 7f8cab70d700 1 -- 172.21.15.84:0/3440378163 wait complete. 2023-08-31T02:00:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.915+0000 7f8cab70d700 1 Processor -- start 2023-08-31T02:00:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.915+0000 7f8cab70d700 1 -- start start 2023-08-31T02:00:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8cab70d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40ca100 0x7f8ca40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8cab70d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415b790 0x7f8ca4150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8cab70d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca415bce0 0x7f8ca406a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8cab70d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40b1140 con 0x7f8ca415bce0 2023-08-31T02:00:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8cab70d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca4150a90 con 0x7f8ca40ca100 2023-08-31T02:00:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8cab70d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40ad3b0 con 0x7f8ca415b790 2023-08-31T02:00:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca415bce0 0x7f8ca406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca415bce0 0x7f8ca406a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51862/0 (socket says 172.21.15.84:51862) 2023-08-31T02:00:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 -- 172.21.15.84:0/2212741000 learned_addr learned my addr 172.21.15.84:0/2212741000 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca8ca8700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415b790 0x7f8ca4150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca94a9700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40ca100 0x7f8ca40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 -- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415b790 msgr2=0x7f8ca4150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415b790 0x7f8ca4150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 -- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40ca100 msgr2=0x7f8ca40aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:23.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40ca100 0x7f8ca40aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:23.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 -- 172.21.15.84:0/2212741000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c009d00 con 0x7f8ca415bce0 2023-08-31T02:00:23.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca8ca8700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415b790 0x7f8ca4150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:23.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca94a9700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40ca100 0x7f8ca40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:23.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8ca9caa700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca415bce0 0x7f8ca406a230 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8ca406e800 tx=0x7f8c9c007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:23.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8c99ffb700 1 -- 172.21.15.84:0/2212741000 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00e040 con 0x7f8ca415bce0 2023-08-31T02:00:23.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8c99ffb700 1 -- 172.21.15.84:0/2212741000 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c9c01d890 con 0x7f8ca415bce0 2023-08-31T02:00:23.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8c99ffb700 1 -- 172.21.15.84:0/2212741000 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c01dce0 con 0x7f8ca415bce0 2023-08-31T02:00:23.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.916+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca40ab230 con 0x7f8ca415bce0 2023-08-31T02:00:23.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.917+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca40ab7f0 con 0x7f8ca415bce0 2023-08-31T02:00:23.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.918+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca404e7c0 con 0x7f8ca415bce0 2023-08-31T02:00:23.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.918+0000 7f8c99ffb700 1 -- 172.21.15.84:0/2212741000 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c9c01b450 con 0x7f8ca415bce0 2023-08-31T02:00:23.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.918+0000 7f8c99ffb700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c8806a0e0 0x7f8c8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:23.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.918+0000 7f8c99ffb700 1 -- 172.21.15.84:0/2212741000 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c9c08a9e0 con 0x7f8ca415bce0 2023-08-31T02:00:23.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.919+0000 7f8ca94a9700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c8806a0e0 0x7f8c8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:23.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.919+0000 7f8ca94a9700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c8806a0e0 0x7f8c8806c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0005fd0 tx=0x7f8ca0005f60 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:23.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:23.923+0000 7f8c99ffb700 1 -- 172.21.15.84:0/2212741000 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8c9c055f70 con 0x7f8ca415bce0 2023-08-31T02:00:24.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.114+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ca406c7b0 con 0x7f8ca415bce0 2023-08-31T02:00:24.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.115+0000 7f8c99ffb700 1 -- 172.21.15.84:0/2212741000 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c9c059590 con 0x7f8ca415bce0 2023-08-31T02:00:24.108 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c8806a0e0 msgr2=0x7f8c8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c8806a0e0 0x7f8c8806c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0005fd0 tx=0x7f8ca0005f60 comp rx=0 tx=0).stop 2023-08-31T02:00:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca415bce0 msgr2=0x7f8ca406a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca415bce0 0x7f8ca406a230 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8ca406e800 tx=0x7f8c9c007c10 comp rx=0 tx=0).stop 2023-08-31T02:00:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 shutdown_connections 2023-08-31T02:00:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c8806a0e0 0x7f8c8806c5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca415bce0 0x7f8ca406a230 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40ca100 0x7f8ca40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 --2- 172.21.15.84:0/2212741000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415b790 0x7f8ca4150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 >> 172.21.15.84:0/2212741000 conn(0x7f8ca40afb00 msgr2=0x7f8ca40cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 shutdown_connections 2023-08-31T02:00:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.117+0000 7f8cab70d700 1 -- 172.21.15.84:0/2212741000 wait complete. 2023-08-31T02:00:24.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:24.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.255+0000 7f4b90782700 1 -- 172.21.15.84:0/524269341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 msgr2=0x7f4b8806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.255+0000 7f4b90782700 1 --2- 172.21.15.84:0/524269341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 0x7f4b8806c720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b840098c0 tx=0x7f4b84009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.255+0000 7f4b90782700 1 -- 172.21.15.84:0/524269341 shutdown_connections 2023-08-31T02:00:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.255+0000 7f4b90782700 1 --2- 172.21.15.84:0/524269341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 0x7f4b8806c720 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.255+0000 7f4b90782700 1 --2- 172.21.15.84:0/524269341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8815bce0 0x7f4b880c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.255+0000 7f4b90782700 1 -- 172.21.15.84:0/524269341 >> 172.21.15.84:0/524269341 conn(0x7f4b880afb00 msgr2=0x7f4b880aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.255+0000 7f4b90782700 1 -- 172.21.15.84:0/524269341 shutdown_connections 2023-08-31T02:00:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.255+0000 7f4b90782700 1 -- 172.21.15.84:0/524269341 wait complete. 2023-08-31T02:00:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b90782700 1 Processor -- start 2023-08-31T02:00:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b90782700 1 -- start start 2023-08-31T02:00:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b90782700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b880ca100 0x7f4b880c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b90782700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 0x7f4b8814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b90782700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8815bce0 0x7f4b880c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b90782700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880b2f70 con 0x7f4b8815b790 2023-08-31T02:00:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b90782700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8814ca50 con 0x7f4b8815bce0 2023-08-31T02:00:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b90782700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c8420 con 0x7f4b880ca100 2023-08-31T02:00:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b8dd1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 0x7f4b8814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b8dd1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 0x7f4b8814c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51874/0 (socket says 172.21.15.84:51874) 2023-08-31T02:00:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b8dd1d700 1 -- 172.21.15.84:0/1695762205 learned_addr learned my addr 172.21.15.84:0/1695762205 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.257+0000 7f4b8e51e700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b880ca100 0x7f4b880c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.258+0000 7f4b8ed1f700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8815bce0 0x7f4b880c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.258+0000 7f4b8dd1d700 1 -- 172.21.15.84:0/1695762205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b880ca100 msgr2=0x7f4b880c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.258+0000 7f4b8dd1d700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b880ca100 0x7f4b880c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.258+0000 7f4b8dd1d700 1 -- 172.21.15.84:0/1695762205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8815bce0 msgr2=0x7f4b880c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.258+0000 7f4b8dd1d700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8815bce0 0x7f4b880c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.258+0000 7f4b8dd1d700 1 -- 172.21.15.84:0/1695762205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84009520 con 0x7f4b8815b790 2023-08-31T02:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.258+0000 7f4b8dd1d700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 0x7f4b8814c510 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d980 tx=0x7f4b7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.260+0000 7f4b7effd700 1 -- 172.21.15.84:0/1695762205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800f890 con 0x7f4b8815b790 2023-08-31T02:00:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.260+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b880b2640 con 0x7f4b8815b790 2023-08-31T02:00:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.260+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b880b2c00 con 0x7f4b8815b790 2023-08-31T02:00:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.260+0000 7f4b7effd700 1 -- 172.21.15.84:0/1695762205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4b7800fae0 con 0x7f4b8815b790 2023-08-31T02:00:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.260+0000 7f4b7effd700 1 -- 172.21.15.84:0/1695762205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800fe70 con 0x7f4b8815b790 2023-08-31T02:00:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.261+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b700052f0 con 0x7f4b8815b790 2023-08-31T02:00:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.261+0000 7f4b7effd700 1 -- 172.21.15.84:0/1695762205 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b78010460 con 0x7f4b8815b790 2023-08-31T02:00:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.262+0000 7f4b7effd700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b6c06a0e0 0x7f4b6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.262+0000 7f4b7effd700 1 -- 172.21.15.84:0/1695762205 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b780889e0 con 0x7f4b8815b790 2023-08-31T02:00:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.262+0000 7f4b8e51e700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b6c06a0e0 0x7f4b6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.262+0000 7f4b8e51e700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b6c06a0e0 0x7f4b6c06c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009230 tx=0x7f4b84019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.266+0000 7f4b7effd700 1 -- 172.21.15.84:0/1695762205 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b78053e50 con 0x7f4b8815b790 2023-08-31T02:00:24.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.454+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b70005b20 con 0x7f4b8815b790 2023-08-31T02:00:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.454+0000 7f4b7effd700 1 -- 172.21.15.84:0/1695762205 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b78057470 con 0x7f4b8815b790 2023-08-31T02:00:24.448 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b6c06a0e0 msgr2=0x7f4b6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b6c06a0e0 0x7f4b6c06c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009230 tx=0x7f4b84019040 comp rx=0 tx=0).stop 2023-08-31T02:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 msgr2=0x7f4b8814c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 0x7f4b8814c510 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d980 tx=0x7f4b7800dc90 comp rx=0 tx=0).stop 2023-08-31T02:00:24.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 shutdown_connections 2023-08-31T02:00:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4b6c06a0e0 0x7f4b6c06c5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8815bce0 0x7f4b880c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b880ca100 0x7f4b880c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 --2- 172.21.15.84:0/1695762205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8815b790 0x7f4b8814c510 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.456+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 >> 172.21.15.84:0/1695762205 conn(0x7f4b880afb00 msgr2=0x7f4b8815a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:24.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.457+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 shutdown_connections 2023-08-31T02:00:24.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.457+0000 7f4b90782700 1 -- 172.21.15.84:0/1695762205 wait complete. 2023-08-31T02:00:24.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.594+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4055570177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80d0da0 msgr2=0x7fa7b80cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.594+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4055570177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80d0da0 0x7fa7b80cf590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009f60 tx=0x7fa7b0009f90 comp rx=0 tx=0).stop 2023-08-31T02:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.594+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4055570177 shutdown_connections 2023-08-31T02:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.594+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4055570177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80d0da0 0x7fa7b80cf590 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.594+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4055570177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b80b33e0 0x7fa7b80b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.594+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4055570177 >> 172.21.15.84:0/4055570177 conn(0x7fa7b80cdcd0 msgr2=0x7fa7b80ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:24.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.594+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4055570177 shutdown_connections 2023-08-31T02:00:24.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.594+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4055570177 wait complete. 2023-08-31T02:00:24.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.595+0000 7fa7bd7cc700 1 Processor -- start 2023-08-31T02:00:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.595+0000 7fa7bd7cc700 1 -- start start 2023-08-31T02:00:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7bd7cc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80b33e0 0x7fa7b814b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7bd7cc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b80d0da0 0x7fa7b81f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7bd7cc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b815b4d0 0x7fa7b81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7bd7cc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b815bc40 con 0x7fa7b815b4d0 2023-08-31T02:00:24.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7bd7cc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81f1d70 con 0x7fa7b80b33e0 2023-08-31T02:00:24.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7bd7cc700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81f2050 con 0x7fa7b80d0da0 2023-08-31T02:00:24.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7b77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b815b4d0 0x7fa7b81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7b77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b815b4d0 0x7fa7b81582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51890/0 (socket says 172.21.15.84:51890) 2023-08-31T02:00:24.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7b77fe700 1 -- 172.21.15.84:0/4171643974 learned_addr learned my addr 172.21.15.84:0/4171643974 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:24.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.596+0000 7fa7b67fc700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b80d0da0 0x7fa7b81f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b6ffd700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80b33e0 0x7fa7b814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b77fe700 1 -- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b80d0da0 msgr2=0x7fa7b81f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b77fe700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b80d0da0 0x7fa7b81f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b77fe700 1 -- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80b33e0 msgr2=0x7fa7b814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b77fe700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80b33e0 0x7fa7b814b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b77fe700 1 -- 172.21.15.84:0/4171643974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0009c40 con 0x7fa7b815b4d0 2023-08-31T02:00:24.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b67fc700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b80d0da0 0x7fa7b81f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:24.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b6ffd700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80b33e0 0x7fa7b814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:24.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7b77fe700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b815b4d0 0x7fa7b81582e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b610 tx=0x7fa7b0007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:24.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa79f7fe700 1 -- 172.21.15.84:0/4171643974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000e040 con 0x7fa7b815b4d0 2023-08-31T02:00:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa79f7fe700 1 -- 172.21.15.84:0/4171643974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa7b001d890 con 0x7fa7b815b4d0 2023-08-31T02:00:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b815bf00 con 0x7fa7b815b4d0 2023-08-31T02:00:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa79f7fe700 1 -- 172.21.15.84:0/4171643974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b001dc80 con 0x7fa7b815b4d0 2023-08-31T02:00:24.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.597+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b8151ee0 con 0x7fa7b815b4d0 2023-08-31T02:00:24.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.598+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b804e7c0 con 0x7fa7b815b4d0 2023-08-31T02:00:24.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.598+0000 7fa79f7fe700 1 -- 172.21.15.84:0/4171643974 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7b001b450 con 0x7fa7b815b4d0 2023-08-31T02:00:24.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.599+0000 7fa79f7fe700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa7a406a0e0 0x7fa7a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.599+0000 7fa79f7fe700 1 -- 172.21.15.84:0/4171643974 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7b008a580 con 0x7fa7b815b4d0 2023-08-31T02:00:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.599+0000 7fa7b6ffd700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa7a406a0e0 0x7fa7a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.599+0000 7fa7b6ffd700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa7a406a0e0 0x7fa7a406c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7b81e6ad0 tx=0x7fa7a8009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:24.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.603+0000 7fa79f7fe700 1 -- 172.21.15.84:0/4171643974 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa7b0055950 con 0x7fa7b815b4d0 2023-08-31T02:00:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.791+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa7b8152300 con 0x7fa7b815b4d0 2023-08-31T02:00:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.792+0000 7fa79f7fe700 1 -- 172.21.15.84:0/4171643974 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa7b0007e60 con 0x7fa7b815b4d0 2023-08-31T02:00:24.785 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa7a406a0e0 msgr2=0x7fa7a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa7a406a0e0 0x7fa7a406c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7b81e6ad0 tx=0x7fa7a8009040 comp rx=0 tx=0).stop 2023-08-31T02:00:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b815b4d0 msgr2=0x7fa7b81582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b815b4d0 0x7fa7b81582e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b610 tx=0x7fa7b0007b50 comp rx=0 tx=0).stop 2023-08-31T02:00:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 shutdown_connections 2023-08-31T02:00:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa7a406a0e0 0x7fa7a406c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7b815b4d0 0x7fa7b81582e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b80b33e0 0x7fa7b814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 --2- 172.21.15.84:0/4171643974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b80d0da0 0x7fa7b81f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 >> 172.21.15.84:0/4171643974 conn(0x7fa7b80cdcd0 msgr2=0x7fa7b814f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:24.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 shutdown_connections 2023-08-31T02:00:24.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.794+0000 7fa7bd7cc700 1 -- 172.21.15.84:0/4171643974 wait complete. 2023-08-31T02:00:24.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:00:24.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.927+0000 7fca23953700 1 -- 172.21.15.84:0/857344993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b2b60 msgr2=0x7fca1c071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.927+0000 7fca23953700 1 --2- 172.21.15.84:0/857344993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b2b60 0x7fca1c071050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fca1c06c1f0 tx=0x7fca1400b330 comp rx=0 tx=0).stop 2023-08-31T02:00:24.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.927+0000 7fca23953700 1 -- 172.21.15.84:0/857344993 shutdown_connections 2023-08-31T02:00:24.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.927+0000 7fca23953700 1 --2- 172.21.15.84:0/857344993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b2b60 0x7fca1c071050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.927+0000 7fca23953700 1 --2- 172.21.15.84:0/857344993 >> v2:172.21.15.170:3300/0 conn(0x7fca1c0b26e0 0x7fca1c070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.927+0000 7fca23953700 1 -- 172.21.15.84:0/857344993 >> 172.21.15.84:0/857344993 conn(0x7fca1c0699a0 msgr2=0x7fca1c069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:24.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.928+0000 7fca23953700 1 -- 172.21.15.84:0/857344993 shutdown_connections 2023-08-31T02:00:24.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.928+0000 7fca23953700 1 -- 172.21.15.84:0/857344993 wait complete. 2023-08-31T02:00:24.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.929+0000 7fca23953700 1 Processor -- start 2023-08-31T02:00:24.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.929+0000 7fca23953700 1 -- start start 2023-08-31T02:00:24.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.929+0000 7fca23953700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b26e0 0x7fca1c1e1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.929+0000 7fca23953700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca1c0b2b60 0x7fca1c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.929+0000 7fca23953700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca1c155fa0 0x7fca1c1477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.929+0000 7fca23953700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c148370 con 0x7fca1c0b26e0 2023-08-31T02:00:24.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.929+0000 7fca23953700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c1e1f80 con 0x7fca1c155fa0 2023-08-31T02:00:24.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.929+0000 7fca23953700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c1485c0 con 0x7fca1c0b2b60 2023-08-31T02:00:24.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b26e0 0x7fca1c1e1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b26e0 0x7fca1c1e1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51900/0 (socket says 172.21.15.84:51900) 2023-08-31T02:00:24.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 -- 172.21.15.84:0/861672541 learned_addr learned my addr 172.21.15.84:0/861672541 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:24.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca20eee700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca1c0b2b60 0x7fca1c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca21ef0700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca1c155fa0 0x7fca1c1477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 -- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca1c0b2b60 msgr2=0x7fca1c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca1c0b2b60 0x7fca1c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 -- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca1c155fa0 msgr2=0x7fca1c1477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:24.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca1c155fa0 0x7fca1c1477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:24.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 -- 172.21.15.84:0/861672541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca14009c40 con 0x7fca1c0b26e0 2023-08-31T02:00:24.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca21ef0700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca1c155fa0 0x7fca1c1477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:24.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca216ef700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b26e0 0x7fca1c1e1960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00c450 tx=0x7fca0c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:24.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca11ffb700 1 -- 172.21.15.84:0/861672541 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c011880 con 0x7fca1c0b26e0 2023-08-31T02:00:24.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca11ffb700 1 -- 172.21.15.84:0/861672541 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca0c011ad0 con 0x7fca1c0b26e0 2023-08-31T02:00:24.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1c1488a0 con 0x7fca1c0b26e0 2023-08-31T02:00:24.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca11ffb700 1 -- 172.21.15.84:0/861672541 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0103d0 con 0x7fca1c0b26e0 2023-08-31T02:00:24.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.930+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c1e3a10 con 0x7fca1c0b26e0 2023-08-31T02:00:24.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.931+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1c148dc0 con 0x7fca1c0b26e0 2023-08-31T02:00:24.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.931+0000 7fca11ffb700 1 -- 172.21.15.84:0/861672541 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fca0c010530 con 0x7fca1c0b26e0 2023-08-31T02:00:24.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.932+0000 7fca11ffb700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca0006a0b0 0x7fca0006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.932+0000 7fca11ffb700 1 -- 172.21.15.84:0/861672541 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca0c08a4f0 con 0x7fca1c0b26e0 2023-08-31T02:00:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.932+0000 7fca20eee700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca0006a0b0 0x7fca0006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.932+0000 7fca20eee700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca0006a0b0 0x7fca0006c570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca18005950 tx=0x7fca180058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:24.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:24.936+0000 7fca11ffb700 1 -- 172.21.15.84:0/861672541 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fca1c148dc0 con 0x7fca1c0b26e0 2023-08-31T02:00:25.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.165+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca1c148dc0 con 0x7fca1c0b26e0 2023-08-31T02:00:25.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.166+0000 7fca11ffb700 1 -- 172.21.15.84:0/861672541 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fca1c148dc0 con 0x7fca1c0b26e0 2023-08-31T02:00:25.159 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:25.159 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:16.191493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T02:00:25.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca0006a0b0 msgr2=0x7fca0006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca0006a0b0 0x7fca0006c570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca18005950 tx=0x7fca180058e0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b26e0 msgr2=0x7fca1c1e1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b26e0 0x7fca1c1e1960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00c450 tx=0x7fca0c00c810 comp rx=0 tx=0).stop 2023-08-31T02:00:25.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 shutdown_connections 2023-08-31T02:00:25.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca0006a0b0 0x7fca0006c570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca1c155fa0 0x7fca1c1477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca1c0b26e0 0x7fca1c1e1960 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 --2- 172.21.15.84:0/861672541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca1c0b2b60 0x7fca1c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 >> 172.21.15.84:0/861672541 conn(0x7fca1c0699a0 msgr2=0x7fca1c14be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:25.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 shutdown_connections 2023-08-31T02:00:25.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.168+0000 7fca23953700 1 -- 172.21.15.84:0/861672541 wait complete. 2023-08-31T02:00:25.164 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-08-31T02:00:25.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:25.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.304+0000 7f2bde5a1700 1 -- 172.21.15.84:0/1978233666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc4004d90 msgr2=0x7f2bc4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.304+0000 7f2bde5a1700 1 --2- 172.21.15.84:0/1978233666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc4004d90 0x7f2bc4005210 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0001e10 tx=0x7f2bc4005880 comp rx=0 tx=0).stop 2023-08-31T02:00:25.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.304+0000 7f2bddda0700 1 -- 172.21.15.84:0/1978233666 reap_dead start 2023-08-31T02:00:25.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.304+0000 7f2bde5a1700 1 -- 172.21.15.84:0/1978233666 shutdown_connections 2023-08-31T02:00:25.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.304+0000 7f2bde5a1700 1 -- 172.21.15.84:0/1978233666 >> 172.21.15.84:0/1978233666 conn(0x7f2bd80ca820 msgr2=0x7f2bd80cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:25.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.304+0000 7f2bde5a1700 1 -- 172.21.15.84:0/1978233666 shutdown_connections 2023-08-31T02:00:25.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.304+0000 7f2bde5a1700 1 -- 172.21.15.84:0/1978233666 wait complete. 2023-08-31T02:00:25.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.305+0000 7f2bde5a1700 1 Processor -- start 2023-08-31T02:00:25.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.305+0000 7f2bde5a1700 1 -- start start 2023-08-31T02:00:25.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bde5a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd815a330 0x7f2bd80c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bde5a1700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd815a710 0x7f2bd80c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bde5a1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd8149140 0x7f2bd81495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bde5a1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80c9440 con 0x7f2bd815a330 2023-08-31T02:00:25.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bde5a1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80c8540 con 0x7f2bd8149140 2023-08-31T02:00:25.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bde5a1700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80c74a0 con 0x7f2bd815a710 2023-08-31T02:00:25.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdd59f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd815a330 0x7f2bd80c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdd59f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd815a330 0x7f2bd80c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51922/0 (socket says 172.21.15.84:51922) 2023-08-31T02:00:25.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdd59f700 1 -- 172.21.15.84:0/2188153828 learned_addr learned my addr 172.21.15.84:0/2188153828 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:25.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdcd9e700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd815a710 0x7f2bd80c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bddda0700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd8149140 0x7f2bd81495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdd59f700 1 -- 172.21.15.84:0/2188153828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd815a710 msgr2=0x7f2bd80c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdd59f700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd815a710 0x7f2bd80c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdd59f700 1 -- 172.21.15.84:0/2188153828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd8149140 msgr2=0x7f2bd81495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdd59f700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd8149140 0x7f2bd81495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.306+0000 7f2bdd59f700 1 -- 172.21.15.84:0/2188153828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd80c7780 con 0x7f2bd815a330 2023-08-31T02:00:25.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.307+0000 7f2bdd59f700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd815a330 0x7f2bd80c6da0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8001270 tx=0x7f2bc8003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:25.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.307+0000 7f2bcdffb700 1 -- 172.21.15.84:0/2188153828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8011840 con 0x7f2bd815a330 2023-08-31T02:00:25.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.307+0000 7f2bcdffb700 1 -- 172.21.15.84:0/2188153828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2bc80119c0 con 0x7f2bd815a330 2023-08-31T02:00:25.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.307+0000 7f2bcdffb700 1 -- 172.21.15.84:0/2188153828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8011dd0 con 0x7f2bd815a330 2023-08-31T02:00:25.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.307+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd80c7a60 con 0x7f2bd815a330 2023-08-31T02:00:25.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.307+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd80c8020 con 0x7f2bd815a330 2023-08-31T02:00:25.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.308+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd8067120 con 0x7f2bd815a330 2023-08-31T02:00:25.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.308+0000 7f2bcdffb700 1 -- 172.21.15.84:0/2188153828 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2bc80103c0 con 0x7f2bd815a330 2023-08-31T02:00:25.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.308+0000 7f2bcdffb700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2bbc06a110 0x7f2bbc06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.309+0000 7f2bcdffb700 1 -- 172.21.15.84:0/2188153828 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2bc8089640 con 0x7f2bd815a330 2023-08-31T02:00:25.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.309+0000 7f2bdcd9e700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2bbc06a110 0x7f2bbc06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.309+0000 7f2bdcd9e700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2bbc06a110 0x7f2bbc06c5d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2bd806ab50 tx=0x7f2bd4009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:25.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.313+0000 7f2bcdffb700 1 -- 172.21.15.84:0/2188153828 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2bc8054aa0 con 0x7f2bd815a330 2023-08-31T02:00:25.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.506+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bd806e1d0 con 0x7f2bd815a330 2023-08-31T02:00:25.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.507+0000 7f2bcdffb700 1 -- 172.21.15.84:0/2188153828 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f2bd806e1d0 con 0x7f2bd815a330 2023-08-31T02:00:25.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:25.501 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:25.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2bbc06a110 msgr2=0x7f2bbc06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2bbc06a110 0x7f2bbc06c5d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2bd806ab50 tx=0x7f2bd4009260 comp rx=0 tx=0).stop 2023-08-31T02:00:25.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd815a330 msgr2=0x7f2bd80c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd815a330 0x7f2bd80c6da0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8001270 tx=0x7f2bc8003a40 comp rx=0 tx=0).stop 2023-08-31T02:00:25.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 shutdown_connections 2023-08-31T02:00:25.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2bbc06a110 0x7f2bbc06c5d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd8149140 0x7f2bd81495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd815a330 0x7f2bd80c6da0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 --2- 172.21.15.84:0/2188153828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd815a710 0x7f2bd80c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 >> 172.21.15.84:0/2188153828 conn(0x7f2bd80ca820 msgr2=0x7f2bd80ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:25.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 shutdown_connections 2023-08-31T02:00:25.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.509+0000 7f2bde5a1700 1 -- 172.21.15.84:0/2188153828 wait complete. 2023-08-31T02:00:25.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:25.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.648+0000 7fa33e670700 1 -- 172.21.15.84:0/915485894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa320004850 msgr2=0x7fa320004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.648+0000 7fa33e670700 1 --2- 172.21.15.84:0/915485894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa320004850 0x7fa320004cd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3280016f0 tx=0x7fa320005880 comp rx=0 tx=0).stop 2023-08-31T02:00:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.648+0000 7fa33e670700 1 -- 172.21.15.84:0/915485894 shutdown_connections 2023-08-31T02:00:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.648+0000 7fa33e670700 1 --2- 172.21.15.84:0/915485894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa320004850 0x7fa320004cd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.648+0000 7fa33e670700 1 -- 172.21.15.84:0/915485894 >> 172.21.15.84:0/915485894 conn(0x7fa3380b0c40 msgr2=0x7fa3380b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.648+0000 7fa33e670700 1 -- 172.21.15.84:0/915485894 shutdown_connections 2023-08-31T02:00:25.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.648+0000 7fa33e670700 1 -- 172.21.15.84:0/915485894 wait complete. 2023-08-31T02:00:25.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.649+0000 7fa33e670700 1 Processor -- start 2023-08-31T02:00:25.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.649+0000 7fa33e670700 1 -- start start 2023-08-31T02:00:25.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa33e670700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa320004850 0x7fa33815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa33e670700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381597a0 0x7fa338154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa33e670700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa33806c600 0x7fa3380c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa33e670700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815a840 con 0x7fa3381597a0 2023-08-31T02:00:25.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa33e670700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338159c30 con 0x7fa320004850 2023-08-31T02:00:25.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa33e670700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa338159f10 con 0x7fa33806c600 2023-08-31T02:00:25.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa3377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381597a0 0x7fa338154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa3377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381597a0 0x7fa338154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51942/0 (socket says 172.21.15.84:51942) 2023-08-31T02:00:25.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa3377fe700 1 -- 172.21.15.84:0/788655002 learned_addr learned my addr 172.21.15.84:0/788655002 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:25.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.650+0000 7fa337fff700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa320004850 0x7fa33815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa33cc0d700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa33806c600 0x7fa3380c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa3377fe700 1 -- 172.21.15.84:0/788655002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa33806c600 msgr2=0x7fa3380c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa3377fe700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa33806c600 0x7fa3380c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa3377fe700 1 -- 172.21.15.84:0/788655002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa320004850 msgr2=0x7fa33815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa3377fe700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa320004850 0x7fa33815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa3377fe700 1 -- 172.21.15.84:0/788655002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33815a1f0 con 0x7fa3381597a0 2023-08-31T02:00:25.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa3377fe700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381597a0 0x7fa338154700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c1d0 tx=0x7fa328003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:25.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa334ff9700 1 -- 172.21.15.84:0/788655002 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328015070 con 0x7fa3381597a0 2023-08-31T02:00:25.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa334ff9700 1 -- 172.21.15.84:0/788655002 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa328016040 con 0x7fa3381597a0 2023-08-31T02:00:25.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33815a4d0 con 0x7fa3381597a0 2023-08-31T02:00:25.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa334ff9700 1 -- 172.21.15.84:0/788655002 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280106e0 con 0x7fa3381597a0 2023-08-31T02:00:25.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.651+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa338154c40 con 0x7fa3381597a0 2023-08-31T02:00:25.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.652+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33815a9f0 con 0x7fa3381597a0 2023-08-31T02:00:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.652+0000 7fa334ff9700 1 -- 172.21.15.84:0/788655002 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa328010840 con 0x7fa3381597a0 2023-08-31T02:00:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.653+0000 7fa334ff9700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa32406a0e0 0x7fa32406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.653+0000 7fa334ff9700 1 -- 172.21.15.84:0/788655002 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa328089770 con 0x7fa3381597a0 2023-08-31T02:00:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.653+0000 7fa337fff700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa32406a0e0 0x7fa32406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.653+0000 7fa337fff700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa32406a0e0 0x7fa32406c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3381f5040 tx=0x7fa32c000ef0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.657+0000 7fa334ff9700 1 -- 172.21.15.84:0/788655002 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa33815a9f0 con 0x7fa3381597a0 2023-08-31T02:00:25.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.842+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa33804e7c0 con 0x7fa3381597a0 2023-08-31T02:00:25.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.843+0000 7fa334ff9700 1 -- 172.21.15.84:0/788655002 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa328054cf0 con 0x7fa3381597a0 2023-08-31T02:00:25.836 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:25.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa32406a0e0 msgr2=0x7fa32406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa32406a0e0 0x7fa32406c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3381f5040 tx=0x7fa32c000ef0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381597a0 msgr2=0x7fa338154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381597a0 0x7fa338154700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c1d0 tx=0x7fa328003930 comp rx=0 tx=0).stop 2023-08-31T02:00:25.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 shutdown_connections 2023-08-31T02:00:25.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa32406a0e0 0x7fa32406c5a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa33806c600 0x7fa3380c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa320004850 0x7fa33815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 --2- 172.21.15.84:0/788655002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381597a0 0x7fa338154700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 >> 172.21.15.84:0/788655002 conn(0x7fa3380b0c40 msgr2=0x7fa3380b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:25.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 shutdown_connections 2023-08-31T02:00:25.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.845+0000 7fa33e670700 1 -- 172.21.15.84:0/788655002 wait complete. 2023-08-31T02:00:25.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.982+0000 7fa89bf56700 1 -- 172.21.15.84:0/755288358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8940ca2d0 msgr2=0x7fa89406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.982+0000 7fa89bf56700 1 --2- 172.21.15.84:0/755288358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8940ca2d0 0x7fa89406c720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa890005fd0 tx=0x7fa890009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.982+0000 7fa89bf56700 1 -- 172.21.15.84:0/755288358 shutdown_connections 2023-08-31T02:00:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.982+0000 7fa89bf56700 1 --2- 172.21.15.84:0/755288358 >> v2:172.21.15.170:3300/0 conn(0x7fa89415bce0 0x7fa8940cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.983+0000 7fa89bf56700 1 --2- 172.21.15.84:0/755288358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8940ca2d0 0x7fa89406c720 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.983+0000 7fa89bf56700 1 -- 172.21.15.84:0/755288358 >> 172.21.15.84:0/755288358 conn(0x7fa8940afb00 msgr2=0x7fa8940aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:25.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.983+0000 7fa89bf56700 1 -- 172.21.15.84:0/755288358 shutdown_connections 2023-08-31T02:00:25.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.983+0000 7fa89bf56700 1 -- 172.21.15.84:0/755288358 wait complete. 2023-08-31T02:00:25.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.984+0000 7fa89bf56700 1 Processor -- start 2023-08-31T02:00:25.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.984+0000 7fa89bf56700 1 -- start start 2023-08-31T02:00:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.984+0000 7fa89bf56700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8940ca2d0 0x7fa894150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.984+0000 7fa89bf56700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa89415b790 0x7fa8940b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.984+0000 7fa89bf56700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa89415bce0 0x7fa8940c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa89bf56700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89413fb00 con 0x7fa89415b790 2023-08-31T02:00:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa89bf56700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89413fde0 con 0x7fa8940ca2d0 2023-08-31T02:00:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa89bf56700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941400c0 con 0x7fa89415bce0 2023-08-31T02:00:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa89415b790 0x7fa8940b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa89415b790 0x7fa8940b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51956/0 (socket says 172.21.15.84:51956) 2023-08-31T02:00:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 -- 172.21.15.84:0/3404914704 learned_addr learned my addr 172.21.15.84:0/3404914704 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa89a4f3700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa89415bce0 0x7fa8940c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa899cf2700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8940ca2d0 0x7fa894150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 -- 172.21.15.84:0/3404914704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa89415bce0 msgr2=0x7fa8940c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa89415bce0 0x7fa8940c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 -- 172.21.15.84:0/3404914704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8940ca2d0 msgr2=0x7fa894150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:25.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8940ca2d0 0x7fa894150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:25.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 -- 172.21.15.84:0/3404914704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c009c40 con 0x7fa89415b790 2023-08-31T02:00:25.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa8994f1700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa89415b790 0x7fa8940b2600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa89406d420 tx=0x7fa890003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:25.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa88a7fc700 1 -- 172.21.15.84:0/3404914704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89001d070 con 0x7fa89415b790 2023-08-31T02:00:25.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa88a7fc700 1 -- 172.21.15.84:0/3404914704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa89000b820 con 0x7fa89415b790 2023-08-31T02:00:25.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900095f0 con 0x7fa89415b790 2023-08-31T02:00:25.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa88a7fc700 1 -- 172.21.15.84:0/3404914704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900045f0 con 0x7fa89415b790 2023-08-31T02:00:25.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.985+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa894140680 con 0x7fa89415b790 2023-08-31T02:00:25.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.986+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89404e7c0 con 0x7fa89415b790 2023-08-31T02:00:25.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.987+0000 7fa88a7fc700 1 -- 172.21.15.84:0/3404914704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa89000bc30 con 0x7fa89415b790 2023-08-31T02:00:25.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.987+0000 7fa88a7fc700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87806a0e0 0x7fa87806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:25.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.987+0000 7fa88a7fc700 1 -- 172.21.15.84:0/3404914704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa890089c90 con 0x7fa89415b790 2023-08-31T02:00:25.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.987+0000 7fa899cf2700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87806a0e0 0x7fa87806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:25.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.988+0000 7fa899cf2700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87806a0e0 0x7fa87806c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8940b3e00 tx=0x7fa88400b040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:25.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:25.991+0000 7fa88a7fc700 1 -- 172.21.15.84:0/3404914704 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa8900553e0 con 0x7fa89415b790 2023-08-31T02:00:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.179+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8940718b0 con 0x7fa89415b790 2023-08-31T02:00:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.179+0000 7fa88a7fc700 1 -- 172.21.15.84:0/3404914704 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8900270a0 con 0x7fa89415b790 2023-08-31T02:00:26.173 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87806a0e0 msgr2=0x7fa87806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87806a0e0 0x7fa87806c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8940b3e00 tx=0x7fa88400b040 comp rx=0 tx=0).stop 2023-08-31T02:00:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa89415b790 msgr2=0x7fa8940b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa89415b790 0x7fa8940b2600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa89406d420 tx=0x7fa890003ca0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 shutdown_connections 2023-08-31T02:00:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87806a0e0 0x7fa87806c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa89415bce0 0x7fa8940c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8940ca2d0 0x7fa894150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 --2- 172.21.15.84:0/3404914704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa89415b790 0x7fa8940b2600 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 >> 172.21.15.84:0/3404914704 conn(0x7fa8940afb00 msgr2=0x7fa894150490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 shutdown_connections 2023-08-31T02:00:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.181+0000 7fa89bf56700 1 -- 172.21.15.84:0/3404914704 wait complete. 2023-08-31T02:00:26.186 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:26.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.320+0000 7f4e4b491700 1 -- 172.21.15.84:0/4264840219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44159320 msgr2=0x7f4e440b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.320+0000 7f4e4b491700 1 --2- 172.21.15.84:0/4264840219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44159320 0x7f4e440b0020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4e340098c0 tx=0x7f4e34009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.320+0000 7f4e4b491700 1 -- 172.21.15.84:0/4264840219 shutdown_connections 2023-08-31T02:00:26.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.320+0000 7f4e4b491700 1 --2- 172.21.15.84:0/4264840219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44159320 0x7f4e440b0020 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.320+0000 7f4e4b491700 1 --2- 172.21.15.84:0/4264840219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e4415d750 0x7f4e440ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.320+0000 7f4e4b491700 1 -- 172.21.15.84:0/4264840219 >> 172.21.15.84:0/4264840219 conn(0x7f4e440b0c40 msgr2=0x7f4e440b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:26.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.320+0000 7f4e4b491700 1 -- 172.21.15.84:0/4264840219 shutdown_connections 2023-08-31T02:00:26.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.320+0000 7f4e4b491700 1 -- 172.21.15.84:0/4264840219 wait complete. 2023-08-31T02:00:26.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.321+0000 7f4e4b491700 1 Processor -- start 2023-08-31T02:00:26.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.321+0000 7f4e4b491700 1 -- start start 2023-08-31T02:00:26.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e4b491700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440cd220 0x7f4e441e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e4b491700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44159320 0x7f4e441e2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e4b491700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e4415d750 0x7f4e440b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e4b491700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441e5080 con 0x7f4e4415d750 2023-08-31T02:00:26.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e4b491700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441568f0 con 0x7f4e44159320 2023-08-31T02:00:26.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e4b491700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441e59e0 con 0x7f4e440cd220 2023-08-31T02:00:26.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e49a2e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e4415d750 0x7f4e440b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e49a2e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e4415d750 0x7f4e440b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51972/0 (socket says 172.21.15.84:51972) 2023-08-31T02:00:26.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e49a2e700 1 -- 172.21.15.84:0/3694889943 learned_addr learned my addr 172.21.15.84:0/3694889943 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:26.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e48a2c700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44159320 0x7f4e441e2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.322+0000 7f4e4922d700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440cd220 0x7f4e441e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e49a2e700 1 -- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440cd220 msgr2=0x7f4e441e54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e49a2e700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440cd220 0x7f4e441e54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e49a2e700 1 -- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44159320 msgr2=0x7f4e441e2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e49a2e700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44159320 0x7f4e441e2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e49a2e700 1 -- 172.21.15.84:0/3694889943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e400095f0 con 0x7f4e4415d750 2023-08-31T02:00:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e4922d700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440cd220 0x7f4e441e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e49a2e700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e4415d750 0x7f4e440b3a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00cc80 tx=0x7f4e3c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e39ffb700 1 -- 172.21.15.84:0/3694889943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c003c00 con 0x7f4e4415d750 2023-08-31T02:00:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e39ffb700 1 -- 172.21.15.84:0/3694889943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4e3c003d60 con 0x7f4e4415d750 2023-08-31T02:00:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e34009520 con 0x7f4e4415d750 2023-08-31T02:00:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e39ffb700 1 -- 172.21.15.84:0/3694889943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00ab70 con 0x7f4e4415d750 2023-08-31T02:00:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.323+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e441e4ca0 con 0x7f4e4415d750 2023-08-31T02:00:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.324+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e441e51c0 con 0x7f4e4415d750 2023-08-31T02:00:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.324+0000 7f4e39ffb700 1 -- 172.21.15.84:0/3694889943 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4e3c00acd0 con 0x7f4e4415d750 2023-08-31T02:00:26.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.325+0000 7f4e39ffb700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4e2806a0e0 0x7f4e2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.325+0000 7f4e4922d700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4e2806a0e0 0x7f4e2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.325+0000 7f4e39ffb700 1 -- 172.21.15.84:0/3694889943 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e3c088890 con 0x7f4e4415d750 2023-08-31T02:00:26.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.325+0000 7f4e4922d700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4e2806a0e0 0x7f4e2806c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e34000c00 tx=0x7f4e34019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:26.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.329+0000 7f4e39ffb700 1 -- 172.21.15.84:0/3694889943 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4e441e51c0 con 0x7f4e4415d750 2023-08-31T02:00:26.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.519+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e441e51c0 con 0x7f4e4415d750 2023-08-31T02:00:26.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.519+0000 7f4e39ffb700 1 -- 172.21.15.84:0/3694889943 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e441e51c0 con 0x7f4e4415d750 2023-08-31T02:00:26.512 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:26.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4e2806a0e0 msgr2=0x7f4e2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4e2806a0e0 0x7f4e2806c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e34000c00 tx=0x7f4e34019040 comp rx=0 tx=0).stop 2023-08-31T02:00:26.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e4415d750 msgr2=0x7f4e440b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e4415d750 0x7f4e440b3a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00cc80 tx=0x7f4e3c00cf90 comp rx=0 tx=0).stop 2023-08-31T02:00:26.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 shutdown_connections 2023-08-31T02:00:26.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4e2806a0e0 0x7f4e2806c5a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e4415d750 0x7f4e440b3a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440cd220 0x7f4e441e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 --2- 172.21.15.84:0/3694889943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44159320 0x7f4e441e2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 >> 172.21.15.84:0/3694889943 conn(0x7f4e440b0c40 msgr2=0x7f4e44158430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:26.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 shutdown_connections 2023-08-31T02:00:26.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.521+0000 7f4e4b491700 1 -- 172.21.15.84:0/3694889943 wait complete. 2023-08-31T02:00:26.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:26.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.658+0000 7fefe2687700 1 -- 172.21.15.84:0/3658409160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 msgr2=0x7fefdc0cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.658+0000 7fefe2687700 1 --2- 172.21.15.84:0/3658409160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 0x7fefdc0cbad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009f60 tx=0x7fefd4009f90 comp rx=0 tx=0).stop 2023-08-31T02:00:26.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.658+0000 7fefe2687700 1 -- 172.21.15.84:0/3658409160 shutdown_connections 2023-08-31T02:00:26.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.658+0000 7fefe2687700 1 --2- 172.21.15.84:0/3658409160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 0x7fefdc0cbad0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.658+0000 7fefe2687700 1 --2- 172.21.15.84:0/3658409160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc15b790 0x7fefdc06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.658+0000 7fefe2687700 1 -- 172.21.15.84:0/3658409160 >> 172.21.15.84:0/3658409160 conn(0x7fefdc0afb00 msgr2=0x7fefdc0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:26.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.658+0000 7fefe2687700 1 -- 172.21.15.84:0/3658409160 shutdown_connections 2023-08-31T02:00:26.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.658+0000 7fefe2687700 1 -- 172.21.15.84:0/3658409160 wait complete. 2023-08-31T02:00:26.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.660+0000 7fefe2687700 1 Processor -- start 2023-08-31T02:00:26.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.660+0000 7fefe2687700 1 -- start start 2023-08-31T02:00:26.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.660+0000 7fefe2687700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 0x7fefdc1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.660+0000 7fefe2687700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc15b790 0x7fefdc0c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.660+0000 7fefe2687700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc15bce0 0x7fefdc0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.660+0000 7fefe2687700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c1bb0 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.660+0000 7fefe2687700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c1e90 con 0x7fefdc15bce0 2023-08-31T02:00:26.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.660+0000 7fefe2687700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c2170 con 0x7fefdc15b790 2023-08-31T02:00:26.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 0x7fefdc1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 0x7fefdc1538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51982/0 (socket says 172.21.15.84:51982) 2023-08-31T02:00:26.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 -- 172.21.15.84:0/1565474854 learned_addr learned my addr 172.21.15.84:0/1565474854 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:26.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefe0c24700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc15bce0 0x7fefdc0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdb7fe700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc15b790 0x7fefdc0c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 -- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc15b790 msgr2=0x7fefdc0c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc15b790 0x7fefdc0c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 -- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc15bce0 msgr2=0x7fefdc0b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc15bce0 0x7fefdc0b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 -- 172.21.15.84:0/1565474854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4009c40 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdb7fe700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc15b790 0x7fefdc0c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:26.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefe0c24700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc15bce0 0x7fefdc0b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:26.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefdbfff700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 0x7fefdc1538a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fefd000e9a0 tx=0x7fefd000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:26.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefd8ff9700 1 -- 172.21.15.84:0/1565474854 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0009790 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefd8ff9700 1 -- 172.21.15.84:0/1565474854 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fefd000ccc0 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc0c2450 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefd8ff9700 1 -- 172.21.15.84:0/1565474854 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0010690 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.661+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc153de0 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.662+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc0c2970 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.663+0000 7fefd8ff9700 1 -- 172.21.15.84:0/1565474854 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fefd00107f0 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.663+0000 7fefd8ff9700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fefc806a0e0 0x7fefc806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.663+0000 7fefd8ff9700 1 -- 172.21.15.84:0/1565474854 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fefd0014070 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.663+0000 7fefdb7fe700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fefc806a0e0 0x7fefc806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.663+0000 7fefdb7fe700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fefc806a0e0 0x7fefc806c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0ca780 tx=0x7fefcc009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:26.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.667+0000 7fefd8ff9700 1 -- 172.21.15.84:0/1565474854 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fefd0051990 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.856+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fefdc04e7c0 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.857+0000 7fefd8ff9700 1 -- 172.21.15.84:0/1565474854 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fefdc0c2970 con 0x7fefdc0ca2d0 2023-08-31T02:00:26.850 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:26.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fefc806a0e0 msgr2=0x7fefc806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fefc806a0e0 0x7fefc806c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0ca780 tx=0x7fefcc009040 comp rx=0 tx=0).stop 2023-08-31T02:00:26.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 msgr2=0x7fefdc1538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 0x7fefdc1538a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fefd000e9a0 tx=0x7fefd000ed60 comp rx=0 tx=0).stop 2023-08-31T02:00:26.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 shutdown_connections 2023-08-31T02:00:26.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fefc806a0e0 0x7fefc806c5a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc15bce0 0x7fefdc0b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc0ca2d0 0x7fefdc1538a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 --2- 172.21.15.84:0/1565474854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc15b790 0x7fefdc0c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 >> 172.21.15.84:0/1565474854 conn(0x7fefdc0afb00 msgr2=0x7fefdc0cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:26.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 shutdown_connections 2023-08-31T02:00:26.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.859+0000 7fefe2687700 1 -- 172.21.15.84:0/1565474854 wait complete. 2023-08-31T02:00:26.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:00:26.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.992+0000 7fb92a715700 1 -- 172.21.15.84:0/1125902916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 msgr2=0x7fb9240b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.992+0000 7fb92a715700 1 --2- 172.21.15.84:0/1125902916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 0x7fb9240b0bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb9180098c0 tx=0x7fb918009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.993+0000 7fb92a715700 1 -- 172.21.15.84:0/1125902916 shutdown_connections 2023-08-31T02:00:26.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.993+0000 7fb92a715700 1 --2- 172.21.15.84:0/1125902916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9240af3d0 0x7fb92415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.993+0000 7fb92a715700 1 --2- 172.21.15.84:0/1125902916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 0x7fb9240b0bb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.993+0000 7fb92a715700 1 -- 172.21.15.84:0/1125902916 >> 172.21.15.84:0/1125902916 conn(0x7fb92406fca0 msgr2=0x7fb9240cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:26.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.993+0000 7fb92a715700 1 -- 172.21.15.84:0/1125902916 shutdown_connections 2023-08-31T02:00:26.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.993+0000 7fb92a715700 1 -- 172.21.15.84:0/1125902916 wait complete. 2023-08-31T02:00:26.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.994+0000 7fb92a715700 1 Processor -- start 2023-08-31T02:00:26.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.994+0000 7fb92a715700 1 -- start start 2023-08-31T02:00:26.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb92a715700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9240af3d0 0x7fb9240b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb92a715700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9240af7b0 0x7fb9241584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb92a715700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 0x7fb924158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb92a715700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9241f1240 con 0x7fb9240ce570 2023-08-31T02:00:26.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb92a715700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9241f1500 con 0x7fb9240af7b0 2023-08-31T02:00:26.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb92a715700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9241f17e0 con 0x7fb9240af3d0 2023-08-31T02:00:26.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 0x7fb924158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 0x7fb924158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52000/0 (socket says 172.21.15.84:52000) 2023-08-31T02:00:26.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 -- 172.21.15.84:0/3922337709 learned_addr learned my addr 172.21.15.84:0/3922337709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:26.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb9237fe700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9240af7b0 0x7fb9241584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb923fff700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9240af3d0 0x7fb9240b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 -- 172.21.15.84:0/3922337709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9240af3d0 msgr2=0x7fb9240b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9240af3d0 0x7fb9240b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 -- 172.21.15.84:0/3922337709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9240af7b0 msgr2=0x7fb9241584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:26.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9240af7b0 0x7fb9241584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:26.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 -- 172.21.15.84:0/3922337709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009520 con 0x7fb9240ce570 2023-08-31T02:00:26.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb928cb2700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 0x7fb924158a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c780 tx=0x7fb91c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:26.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.995+0000 7fb920ff9700 1 -- 172.21.15.84:0/3922337709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c003e30 con 0x7fb9240ce570 2023-08-31T02:00:26.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.996+0000 7fb920ff9700 1 -- 172.21.15.84:0/3922337709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb91c005160 con 0x7fb9240ce570 2023-08-31T02:00:26.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.996+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9241f1ac0 con 0x7fb9240ce570 2023-08-31T02:00:26.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.996+0000 7fb920ff9700 1 -- 172.21.15.84:0/3922337709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c005570 con 0x7fb9240ce570 2023-08-31T02:00:26.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.996+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb924144770 con 0x7fb9240ce570 2023-08-31T02:00:26.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.996+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9241f1fe0 con 0x7fb9240ce570 2023-08-31T02:00:26.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.997+0000 7fb920ff9700 1 -- 172.21.15.84:0/3922337709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb91c0056d0 con 0x7fb9240ce570 2023-08-31T02:00:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.998+0000 7fb920ff9700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb91006a0e0 0x7fb91006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.998+0000 7fb920ff9700 1 -- 172.21.15.84:0/3922337709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb91c0881a0 con 0x7fb9240ce570 2023-08-31T02:00:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.998+0000 7fb923fff700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb91006a0e0 0x7fb91006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:26.998+0000 7fb923fff700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb91006a0e0 0x7fb91006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb92406ef10 tx=0x7fb91400b390 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.001+0000 7fb920ff9700 1 -- 172.21.15.84:0/3922337709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb91c053690 con 0x7fb9240ce570 2023-08-31T02:00:27.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.238+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9241f1fe0 con 0x7fb9240ce570 2023-08-31T02:00:27.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.239+0000 7fb920ff9700 1 -- 172.21.15.84:0/3922337709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fb9241f1fe0 con 0x7fb9240ce570 2023-08-31T02:00:27.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:27.232 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:16.191493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T02:00:27.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb91006a0e0 msgr2=0x7fb91006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb91006a0e0 0x7fb91006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb92406ef10 tx=0x7fb91400b390 comp rx=0 tx=0).stop 2023-08-31T02:00:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 msgr2=0x7fb924158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 0x7fb924158a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c780 tx=0x7fb91c00ca90 comp rx=0 tx=0).stop 2023-08-31T02:00:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 shutdown_connections 2023-08-31T02:00:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb91006a0e0 0x7fb91006c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9240ce570 0x7fb924158a10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9240af3d0 0x7fb9240b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 --2- 172.21.15.84:0/3922337709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9240af7b0 0x7fb9241584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 >> 172.21.15.84:0/3922337709 conn(0x7fb92406fca0 msgr2=0x7fb924153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 shutdown_connections 2023-08-31T02:00:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.241+0000 7fb92a715700 1 -- 172.21.15.84:0/3922337709 wait complete. 2023-08-31T02:00:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-08-31T02:00:27.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:27.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.377+0000 7fa3ebfea700 1 -- 172.21.15.84:0/623477686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e40707c0 msgr2=0x7fa3e4070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.377+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/623477686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e40707c0 0x7fa3e4070c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009fd0 tx=0x7fa3dc00b380 comp rx=0 tx=0).stop 2023-08-31T02:00:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.377+0000 7fa3ebfea700 1 -- 172.21.15.84:0/623477686 shutdown_connections 2023-08-31T02:00:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.377+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/623477686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e40707c0 0x7fa3e4070c10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.377+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/623477686 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e40cc920 0x7fa3e40c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.377+0000 7fa3ebfea700 1 -- 172.21.15.84:0/623477686 >> 172.21.15.84:0/623477686 conn(0x7fa3e40caa20 msgr2=0x7fa3e40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.377+0000 7fa3ebfea700 1 -- 172.21.15.84:0/623477686 shutdown_connections 2023-08-31T02:00:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.377+0000 7fa3ebfea700 1 -- 172.21.15.84:0/623477686 wait complete. 2023-08-31T02:00:27.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ebfea700 1 Processor -- start 2023-08-31T02:00:27.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ebfea700 1 -- start start 2023-08-31T02:00:27.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ebfea700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e40707c0 0x7fa3e41f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:27.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ebfea700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e40cc920 0x7fa3e4146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:27.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ebfea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e4158220 0x7fa3e4158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:27.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ebfea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e41f5440 con 0x7fa3e4158220 2023-08-31T02:00:27.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ebfea700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e414a450 con 0x7fa3e40cc920 2023-08-31T02:00:27.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ebfea700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e414a170 con 0x7fa3e40707c0 2023-08-31T02:00:27.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ea587700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e4158220 0x7fa3e4158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ea587700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e4158220 0x7fa3e4158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52012/0 (socket says 172.21.15.84:52012) 2023-08-31T02:00:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.379+0000 7fa3ea587700 1 -- 172.21.15.84:0/2744080003 learned_addr learned my addr 172.21.15.84:0/2744080003 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3e9d86700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e40707c0 0x7fa3e41f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3e9585700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e40cc920 0x7fa3e4146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:27.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3ea587700 1 -- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e40707c0 msgr2=0x7fa3e41f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3ea587700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e40707c0 0x7fa3e41f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3ea587700 1 -- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e40cc920 msgr2=0x7fa3e4146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3ea587700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e40cc920 0x7fa3e4146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3ea587700 1 -- 172.21.15.84:0/2744080003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009d00 con 0x7fa3e4158220 2023-08-31T02:00:27.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3e9585700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e40cc920 0x7fa3e4146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3e9d86700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e40707c0 0x7fa3e41f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3ea587700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e4158220 0x7fa3e4158930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40cb860 tx=0x7fa3dc009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3da7fc700 1 -- 172.21.15.84:0/2744080003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00e040 con 0x7fa3e4158220 2023-08-31T02:00:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3da7fc700 1 -- 172.21.15.84:0/2744080003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa3dc007bc0 con 0x7fa3e4158220 2023-08-31T02:00:27.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e41f4d80 con 0x7fa3e4158220 2023-08-31T02:00:27.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3da7fc700 1 -- 172.21.15.84:0/2744080003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc004030 con 0x7fa3e4158220 2023-08-31T02:00:27.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.380+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e4147020 con 0x7fa3e4158220 2023-08-31T02:00:27.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.381+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e41f5580 con 0x7fa3e4158220 2023-08-31T02:00:27.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.381+0000 7fa3da7fc700 1 -- 172.21.15.84:0/2744080003 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa3dc004190 con 0x7fa3e4158220 2023-08-31T02:00:27.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.382+0000 7fa3da7fc700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa3c806a0e0 0x7fa3c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:27.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.382+0000 7fa3da7fc700 1 -- 172.21.15.84:0/2744080003 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3dc089a20 con 0x7fa3e4158220 2023-08-31T02:00:27.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.382+0000 7fa3e9d86700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa3c806a0e0 0x7fa3c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:27.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.382+0000 7fa3e9d86700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa3c806a0e0 0x7fa3c806c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006fd0 tx=0x7fa3d4008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:27.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.386+0000 7fa3da7fc700 1 -- 172.21.15.84:0/2744080003 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa3e41f5580 con 0x7fa3e4158220 2023-08-31T02:00:27.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.577+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3e4071150 con 0x7fa3e4158220 2023-08-31T02:00:27.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.578+0000 7fa3da7fc700 1 -- 172.21.15.84:0/2744080003 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fa3e4071150 con 0x7fa3e4158220 2023-08-31T02:00:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:27.571 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:27.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa3c806a0e0 msgr2=0x7fa3c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa3c806a0e0 0x7fa3c806c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006fd0 tx=0x7fa3d4008040 comp rx=0 tx=0).stop 2023-08-31T02:00:27.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e4158220 msgr2=0x7fa3e4158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e4158220 0x7fa3e4158930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40cb860 tx=0x7fa3dc009450 comp rx=0 tx=0).stop 2023-08-31T02:00:27.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 shutdown_connections 2023-08-31T02:00:27.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa3c806a0e0 0x7fa3c806c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e4158220 0x7fa3e4158930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e40707c0 0x7fa3e41f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 --2- 172.21.15.84:0/2744080003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e40cc920 0x7fa3e4146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 >> 172.21.15.84:0/2744080003 conn(0x7fa3e40caa20 msgr2=0x7fa3e415a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 shutdown_connections 2023-08-31T02:00:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.580+0000 7fa3ebfea700 1 -- 172.21.15.84:0/2744080003 wait complete. 2023-08-31T02:00:27.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:00:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.714+0000 7f48264fa700 1 -- 172.21.15.84:0/2658832525 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4820158220 msgr2=0x7f48200cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.714+0000 7f48264fa700 1 --2- 172.21.15.84:0/2658832525 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4820158220 0x7f48200cc920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4810005fd0 tx=0x7f4810009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.715+0000 7f48264fa700 1 -- 172.21.15.84:0/2658832525 shutdown_connections 2023-08-31T02:00:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.715+0000 7f48264fa700 1 --2- 172.21.15.84:0/2658832525 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4820158220 0x7f48200cc920 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.715+0000 7f48264fa700 1 --2- 172.21.15.84:0/2658832525 >> v2:172.21.15.170:3300/0 conn(0x7f48200707c0 0x7f4820070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.715+0000 7f48264fa700 1 -- 172.21.15.84:0/2658832525 >> 172.21.15.84:0/2658832525 conn(0x7f48200caa20 msgr2=0x7f48200cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:27.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.715+0000 7f48264fa700 1 -- 172.21.15.84:0/2658832525 shutdown_connections 2023-08-31T02:00:27.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.715+0000 7f48264fa700 1 -- 172.21.15.84:0/2658832525 wait complete. 2023-08-31T02:00:27.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.716+0000 7f48264fa700 1 Processor -- start 2023-08-31T02:00:27.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.716+0000 7f48264fa700 1 -- start start 2023-08-31T02:00:27.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f48264fa700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48200707c0 0x7f48201e3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:27.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f48264fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48200b0df0 0x7f48201e0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:27.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f48264fa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4820158220 0x7f4820147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:27.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f48264fa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48201e14c0 con 0x7f48200b0df0 2023-08-31T02:00:27.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f48264fa700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48201e17a0 con 0x7f4820158220 2023-08-31T02:00:27.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f48264fa700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48201e1a80 con 0x7f48200707c0 2023-08-31T02:00:27.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48200b0df0 0x7f48201e0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:27.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48200b0df0 0x7f48201e0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52024/0 (socket says 172.21.15.84:52024) 2023-08-31T02:00:27.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 -- 172.21.15.84:0/438189953 learned_addr learned my addr 172.21.15.84:0/438189953 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:27.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481ffff700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48200707c0 0x7f48201e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:27.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f4824a97700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4820158220 0x7f4820147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:27.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 -- 172.21.15.84:0/438189953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48200707c0 msgr2=0x7f48201e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48200707c0 0x7f48201e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 -- 172.21.15.84:0/438189953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4820158220 msgr2=0x7f4820147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4820158220 0x7f4820147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 -- 172.21.15.84:0/438189953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818009c40 con 0x7f48200b0df0 2023-08-31T02:00:27.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481f7fe700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48200b0df0 0x7f48201e0b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f480800c490 tx=0x7f480800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:27.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481cff9700 1 -- 172.21.15.84:0/438189953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48080052d0 con 0x7f48200b0df0 2023-08-31T02:00:27.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481cff9700 1 -- 172.21.15.84:0/438189953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f480800ce90 con 0x7f48200b0df0 2023-08-31T02:00:27.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f481cff9700 1 -- 172.21.15.84:0/438189953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808005580 con 0x7f48200b0df0 2023-08-31T02:00:27.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48100095f0 con 0x7f48200b0df0 2023-08-31T02:00:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.717+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48201e2040 con 0x7f48200b0df0 2023-08-31T02:00:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.718+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482004e7c0 con 0x7f48200b0df0 2023-08-31T02:00:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.719+0000 7f481cff9700 1 -- 172.21.15.84:0/438189953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4808003680 con 0x7f48200b0df0 2023-08-31T02:00:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.719+0000 7f481cff9700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f480006a0e0 0x7f480006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.719+0000 7f481cff9700 1 -- 172.21.15.84:0/438189953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4808087ae0 con 0x7f48200b0df0 2023-08-31T02:00:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.719+0000 7f481ffff700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f480006a0e0 0x7f480006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:27.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.720+0000 7f481ffff700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f480006a0e0 0x7f480006c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f48100098e0 tx=0x7f4810019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:27.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.724+0000 7f481cff9700 1 -- 172.21.15.84:0/438189953 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4808052fd0 con 0x7f48200b0df0 2023-08-31T02:00:27.909 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:00:27.912 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:00:27.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.958+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48200b3530 con 0x7f48200b0df0 2023-08-31T02:00:27.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.958+0000 7f481cff9700 1 -- 172.21.15.84:0/438189953 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f48080565f0 con 0x7f48200b0df0 2023-08-31T02:00:27.951 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:27.952 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:16.191493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T02:00:27.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.960+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f480006a0e0 msgr2=0x7f480006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.960+0000 7f48264fa700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f480006a0e0 0x7f480006c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f48100098e0 tx=0x7f4810019040 comp rx=0 tx=0).stop 2023-08-31T02:00:27.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.960+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48200b0df0 msgr2=0x7f48201e0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:27.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.960+0000 7f48264fa700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48200b0df0 0x7f48201e0b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f480800c490 tx=0x7f480800c7a0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.960+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 shutdown_connections 2023-08-31T02:00:27.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.960+0000 7f48264fa700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f480006a0e0 0x7f480006c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.960+0000 7f48264fa700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4820158220 0x7f4820147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.961+0000 7f48264fa700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48200707c0 0x7f48201e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.961+0000 7f48264fa700 1 --2- 172.21.15.84:0/438189953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48200b0df0 0x7f48201e0b50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:27.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.961+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 >> 172.21.15.84:0/438189953 conn(0x7f48200caa20 msgr2=0x7f48200afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:27.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.961+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 shutdown_connections 2023-08-31T02:00:27.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:27.961+0000 7f48264fa700 1 -- 172.21.15.84:0/438189953 wait complete. 2023-08-31T02:00:27.956 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-08-31T02:00:28.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T01:59:58.513035+0000', 'modified': '2023-08-31T02:00:16.191493+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4362}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4362': {'gid': 4362, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6835/2233754260', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6833', 'nonce': 2233754260}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 2233754260}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-31T02:00:28.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T02:00:28.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-31T02:00:28.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.501+0000 7f335a8c9700 1 -- 172.21.15.84:0/317272389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3354070630 msgr2=0x7f33540b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.501+0000 7f335a8c9700 1 --2- 172.21.15.84:0/317272389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3354070630 0x7f33540b2510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f334c009fd0 tx=0x7f334c00b380 comp rx=0 tx=0).stop 2023-08-31T02:00:28.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.501+0000 7f335a8c9700 1 -- 172.21.15.84:0/317272389 shutdown_connections 2023-08-31T02:00:28.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.501+0000 7f335a8c9700 1 --2- 172.21.15.84:0/317272389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3354070630 0x7f33540b2510 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.501+0000 7f335a8c9700 1 --2- 172.21.15.84:0/317272389 >> v2:172.21.15.170:3300/0 conn(0x7f33541578b0 0x7f33540cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.501+0000 7f335a8c9700 1 -- 172.21.15.84:0/317272389 >> 172.21.15.84:0/317272389 conn(0x7f33540ca090 msgr2=0x7f33540ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:28.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.502+0000 7f335a8c9700 1 -- 172.21.15.84:0/317272389 shutdown_connections 2023-08-31T02:00:28.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.502+0000 7f335a8c9700 1 -- 172.21.15.84:0/317272389 wait complete. 2023-08-31T02:00:28.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.503+0000 7f335a8c9700 1 Processor -- start 2023-08-31T02:00:28.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.503+0000 7f335a8c9700 1 -- start start 2023-08-31T02:00:28.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.503+0000 7f335a8c9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3354070630 0x7f3354156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.503+0000 7f335a8c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33540b0460 0x7f335413b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.503+0000 7f335a8c9700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33541578b0 0x7f33540af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f335a8c9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335413be40 con 0x7f33540b0460 2023-08-31T02:00:28.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f335a8c9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540ae3a0 con 0x7f3354070630 2023-08-31T02:00:28.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f335a8c9700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540ae680 con 0x7f33541578b0 2023-08-31T02:00:28.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33540b0460 0x7f335413b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33540b0460 0x7f335413b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52038/0 (socket says 172.21.15.84:52038) 2023-08-31T02:00:28.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 -- 172.21.15.84:0/387193414 learned_addr learned my addr 172.21.15.84:0/387193414 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:28.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f3358e66700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33541578b0 0x7f33540af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f3353fff700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3354070630 0x7f3354156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 -- 172.21.15.84:0/387193414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33541578b0 msgr2=0x7f33540af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33541578b0 0x7f33540af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 -- 172.21.15.84:0/387193414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3354070630 msgr2=0x7f3354156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3354070630 0x7f3354156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 -- 172.21.15.84:0/387193414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c009d00 con 0x7f33540b0460 2023-08-31T02:00:28.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f33537fe700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33540b0460 0x7f335413b900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f334400c4d0 tx=0x7f334400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:28.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f3350ff9700 1 -- 172.21.15.84:0/387193414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344011790 con 0x7f33540b0460 2023-08-31T02:00:28.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f3350ff9700 1 -- 172.21.15.84:0/387193414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f33440119e0 con 0x7f33540b0460 2023-08-31T02:00:28.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f335a8c9700 1 -- 172.21.15.84:0/387193414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33540ae960 con 0x7f33540b0460 2023-08-31T02:00:28.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f3350ff9700 1 -- 172.21.15.84:0/387193414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344011df0 con 0x7f33540b0460 2023-08-31T02:00:28.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.504+0000 7f335a8c9700 1 -- 172.21.15.84:0/387193414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33540aef20 con 0x7f33540b0460 2023-08-31T02:00:28.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.505+0000 7f3350ff9700 1 -- 172.21.15.84:0/387193414 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f334401c460 con 0x7f33540b0460 2023-08-31T02:00:28.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.506+0000 7f3350ff9700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f334006a0e0 0x7f334006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.506+0000 7f3350ff9700 1 -- 172.21.15.84:0/387193414 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3344088770 con 0x7f33540b0460 2023-08-31T02:00:28.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.506+0000 7f3353fff700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f334006a0e0 0x7f334006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.506+0000 7f3353fff700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f334006a0e0 0x7f334006c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33480058f0 tx=0x7f334800c4a0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:28.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.508+0000 7f3366a6cb80 1 Processor -- start 2023-08-31T02:00:28.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.508+0000 7f3366a6cb80 1 -- start start 2023-08-31T02:00:28.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d1978137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d1977ef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d19781b4a0 0x55d1977f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19774c730 con 0x55d1978133e0 2023-08-31T02:00:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19774a050 con 0x55d1977f18a0 2023-08-31T02:00:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d197745940 con 0x55d19781b4a0 2023-08-31T02:00:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3353fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d1978137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3353fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d1978137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52044/0 (socket says 172.21.15.84:52044) 2023-08-31T02:00:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3353fff700 1 -- 172.21.15.84:0/383563331 learned_addr learned my addr 172.21.15.84:0/383563331 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3358e66700 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d19781b4a0 0x55d1977f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f33537fe700 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d1977ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3353fff700 1 -- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d19781b4a0 msgr2=0x55d1977f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:28.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3353fff700 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d19781b4a0 0x55d1977f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3353fff700 1 -- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 msgr2=0x55d1977ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:28.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3353fff700 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d1977ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.509+0000 7f3353fff700 1 -- 172.21.15.84:0/383563331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1975c55e0 con 0x55d1978133e0 2023-08-31T02:00:28.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f33537fe700 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d1977ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:28.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3353fff700 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d1978137c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f334800ec10 tx=0x7f3348011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b6704d383630ee server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:28.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3339ffb700 1 -- 172.21.15.84:0/383563331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348010cd0 con 0x55d1978133e0 2023-08-31T02:00:28.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3339ffb700 1 -- 172.21.15.84:0/383563331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f334801d450 con 0x55d1978133e0 2023-08-31T02:00:28.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3339ffb700 1 -- 172.21.15.84:0/383563331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334801d820 con 0x55d1978133e0 2023-08-31T02:00:28.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3366a6cb80 1 -- 172.21.15.84:0/383563331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 msgr2=0x55d1978137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d1978137c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f334800ec10 tx=0x7f3348011000 comp rx=0 tx=0).stop 2023-08-31T02:00:28.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3366a6cb80 1 -- 172.21.15.84:0/383563331 shutdown_connections 2023-08-31T02:00:28.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d19781b4a0 0x55d1977f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d1978137c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/383563331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d1977ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.510+0000 7f3366a6cb80 1 -- 172.21.15.84:0/383563331 >> 172.21.15.84:0/383563331 conn(0x55d197768090 msgr2=0x55d1978391c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:28.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.511+0000 7f3366a6cb80 1 -- 172.21.15.84:0/383563331 shutdown_connections 2023-08-31T02:00:28.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.511+0000 7f3366a6cb80 1 -- 172.21.15.84:0/383563331 wait complete. 2023-08-31T02:00:28.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.511+0000 7f3366a6cb80 1 -- start start 2023-08-31T02:00:28.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.511+0000 7f3366a6cb80 1 Processor -- start 2023-08-31T02:00:28.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d197831e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1978133e0 0x55d197832350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197817340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1976e3b60 con 0x55d19781b4a0 2023-08-31T02:00:28.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1976e3860 con 0x55d1977f18a0 2023-08-31T02:00:28.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1975c78d0 con 0x55d1978133e0 2023-08-31T02:00:28.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3366a6cb80 10 client.0 _ll_register_callbacks cb 0x55d19762da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T02:00:28.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3358e66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197817340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3358e66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197817340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52054/0 (socket says 172.21.15.84:52054) 2023-08-31T02:00:28.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3358e66700 1 -- 172.21.15.84:0/1651035357 learned_addr learned my addr 172.21.15.84:0/1651035357 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:28.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f33537fe700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1978133e0 0x55d197832350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.512+0000 7f3353fff700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d197831e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3358e66700 1 -- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1978133e0 msgr2=0x55d197832350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:28.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3358e66700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1978133e0 0x55d197832350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3358e66700 1 -- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 msgr2=0x55d197831e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:28.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3358e66700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d197831e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3358e66700 1 -- 172.21.15.84:0/1651035357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334800e8c0 con 0x55d19781b4a0 2023-08-31T02:00:28.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f33537fe700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1978133e0 0x55d197832350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:28.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3353fff700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d197831e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:28.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3358e66700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197817340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f334c004000 tx=0x7f334c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d1fe4f6fd6e9ef server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:28.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3332ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-08-31T02:00:28.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3332ffd700 1 -- 172.21.15.84:0/1651035357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c004240 con 0x55d19781b4a0 2023-08-31T02:00:28.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3332ffd700 1 -- 172.21.15.84:0/1651035357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f334c0043a0 con 0x55d19781b4a0 2023-08-31T02:00:28.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1651035357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1977e6970 con 0x55d19781b4a0 2023-08-31T02:00:28.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3332ffd700 1 -- 172.21.15.84:0/1651035357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f334c004560 con 0x55d19781b4a0 2023-08-31T02:00:28.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 10 client.4917 fetch_fsmap learned FSMap version 9 2023-08-31T02:00:28.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1651035357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55d197571d90 con 0x55d19781b4a0 2023-08-31T02:00:28.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3332ffd700 1 -- 172.21.15.84:0/1651035357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55d1977e6970 con 0x55d19781b4a0 2023-08-31T02:00:28.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3332ffd700 1 -- 172.21.15.84:0/1651035357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f334c0046c0 con 0x55d19781b4a0 2023-08-31T02:00:28.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 10 client.4917 fetch_fsmap finished waiting for FSMap version 9 2023-08-31T02:00:28.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 10 client.4917 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-31T02:00:28.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 20 client.4917 populate_metadata read hostname 'smithi084' 2023-08-31T02:00:28.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x55d1978179d0 0x55d197817db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 4 client.4917 mds_command: new command op to 4362 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T02:00:28.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.513+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1651035357 --> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d19773e920 con 0x55d1978179d0 2023-08-31T02:00:28.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.514+0000 7f3353fff700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x55d1978179d0 0x55d197817db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.514+0000 7f3332ffd700 10 client.4917 ms_handle_connect on v2:172.21.15.170:6833/2233754260 2023-08-31T02:00:28.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.514+0000 7f3353fff700 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x55d1978179d0 0x55d197817db0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fee0e832c3def54 server_cookie=e7989d4b8a9eda05 in_seq=0 out_seq=0 2023-08-31T02:00:28.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.514+0000 7f3332ffd700 1 -- 172.21.15.84:0/1651035357 <== mds.0 v2:172.21.15.170:6833/2233754260 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d19773e920 con 0x55d1978179d0 2023-08-31T02:00:28.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3332ffd700 10 client.4917 handle_command_reply: tid=0 2023-08-31T02:00:28.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 client.4917 shutdown 2023-08-31T02:00:28.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1651035357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 msgr2=0x55d197817340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197817340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f334c004000 tx=0x7f334c003ce0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1651035357 shutdown_connections 2023-08-31T02:00:28.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197817340 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1977f18a0 0x55d197831e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x55d1978179d0 0x55d197817db0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1651035357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1978133e0 0x55d197832350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3332ffd700 0 client.4917 ms_handle_reset on v2:172.21.15.170:6833/2233754260 2023-08-31T02:00:28.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1651035357 >> 172.21.15.84:0/1651035357 conn(0x55d197768090 msgr2=0x55d1977e8260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:28.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1651035357 shutdown_connections 2023-08-31T02:00:28.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1651035357 wait complete. 2023-08-31T02:00:28.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.515+0000 7f3366a6cb80 20 client.4917 trim_cache size 0 max 16384 2023-08-31T02:00:28.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.532+0000 7f3366a6cb80 1 Processor -- start 2023-08-31T02:00:28.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.533+0000 7f3366a6cb80 1 -- start start 2023-08-31T02:00:28.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.533+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 0x55d19781aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.533+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d197895e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.533+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d19781b4a0 0x55d197819690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.533+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1977ee390 con 0x55d1978133e0 2023-08-31T02:00:28.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.533+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d19780fe70 con 0x55d19781b4a0 2023-08-31T02:00:28.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.533+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d19781e750 con 0x55d1977f18a0 2023-08-31T02:00:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d197895e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d197895e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52060/0 (socket says 172.21.15.84:52060) 2023-08-31T02:00:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 -- 172.21.15.84:0/1175311103 learned_addr learned my addr 172.21.15.84:0/1175311103 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f3353fff700 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 0x55d19781aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f3358e66700 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d19781b4a0 0x55d197819690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 -- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 msgr2=0x55d19781aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 0x55d19781aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 -- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d19781b4a0 msgr2=0x55d197819690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d19781b4a0 0x55d197819690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 -- 172.21.15.84:0/1175311103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d19755ac10 con 0x55d1978133e0 2023-08-31T02:00:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f3358e66700 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d19781b4a0 0x55d197819690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f33537fe700 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d197895e20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f334405f200 tx=0x7f334405d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d68adec3142bc18 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f333a7fc700 1 -- 172.21.15.84:0/1175311103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33440579b0 con 0x55d1978133e0 2023-08-31T02:00:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f333a7fc700 1 -- 172.21.15.84:0/1175311103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f334405f730 con 0x55d1978133e0 2023-08-31T02:00:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.534+0000 7f333a7fc700 1 -- 172.21.15.84:0/1175311103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344057c10 con 0x55d1978133e0 2023-08-31T02:00:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1175311103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 msgr2=0x55d197895e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d197895e20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f334405f200 tx=0x7f334405d040 comp rx=0 tx=0).stop 2023-08-31T02:00:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1175311103 shutdown_connections 2023-08-31T02:00:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d19781b4a0 0x55d197819690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 0x55d19781aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/1175311103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1978133e0 0x55d197895e20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1175311103 >> 172.21.15.84:0/1175311103 conn(0x55d197768090 msgr2=0x55d1977f07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1175311103 shutdown_connections 2023-08-31T02:00:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 -- 172.21.15.84:0/1175311103 wait complete. 2023-08-31T02:00:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.535+0000 7f3366a6cb80 1 -- start start 2023-08-31T02:00:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.536+0000 7f3366a6cb80 1 Processor -- start 2023-08-31T02:00:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 0x55d197852660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1978133e0 0x55d1978923a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3366a6cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197839610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d197894ba0 con 0x55d19781b4a0 2023-08-31T02:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d197880700 con 0x55d1978133e0 2023-08-31T02:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3366a6cb80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d19787e0b0 con 0x55d1977f18a0 2023-08-31T02:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3366a6cb80 10 client.0 _ll_register_callbacks cb 0x7f334c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T02:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197839610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197839610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52068/0 (socket says 172.21.15.84:52068) 2023-08-31T02:00:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 -- 172.21.15.84:0/4265800502 learned_addr learned my addr 172.21.15.84:0/4265800502 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f33537fe700 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1978133e0 0x55d1978923a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3353fff700 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 0x55d197852660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 -- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 msgr2=0x55d197852660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 0x55d197852660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 -- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1978133e0 msgr2=0x55d1978923a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:00:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1978133e0 0x55d1978923a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 -- 172.21.15.84:0/4265800502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33540aef20 con 0x55d19781b4a0 2023-08-31T02:00:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3358e66700 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197839610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55d19781a0b0 tx=0x7f334c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddaf1ed2b17de06 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3332ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-08-31T02:00:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3332ffd700 1 -- 172.21.15.84:0/4265800502 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c004240 con 0x55d19781b4a0 2023-08-31T02:00:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3332ffd700 1 -- 172.21.15.84:0/4265800502 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f334c0043a0 con 0x55d19781b4a0 2023-08-31T02:00:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.537+0000 7f3366a6cb80 1 -- 172.21.15.84:0/4265800502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f334801d450 con 0x55d19781b4a0 2023-08-31T02:00:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3332ffd700 1 -- 172.21.15.84:0/4265800502 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f334c004560 con 0x55d19781b4a0 2023-08-31T02:00:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3366a6cb80 10 client.4923 fetch_fsmap learned FSMap version 9 2023-08-31T02:00:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3366a6cb80 1 -- 172.21.15.84:0/4265800502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55d197598200 con 0x55d19781b4a0 2023-08-31T02:00:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3332ffd700 1 -- 172.21.15.84:0/4265800502 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f334801d450 con 0x55d19781b4a0 2023-08-31T02:00:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3332ffd700 1 -- 172.21.15.84:0/4265800502 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f334c0046c0 con 0x55d19781b4a0 2023-08-31T02:00:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3366a6cb80 10 client.4923 fetch_fsmap finished waiting for FSMap version 9 2023-08-31T02:00:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3366a6cb80 10 client.4923 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-31T02:00:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3366a6cb80 20 client.4923 populate_metadata read hostname 'smithi084' 2023-08-31T02:00:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x55d1977e80c0 0x55d1977e84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3366a6cb80 4 client.4923 mds_command: new command op to 4362 tid=0[{"prefix": "status"}] 2023-08-31T02:00:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3366a6cb80 1 -- 172.21.15.84:0/4265800502 --> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d1976ff000 con 0x55d1977e80c0 2023-08-31T02:00:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3353fff700 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x55d1977e80c0 0x55d1977e84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3353fff700 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x55d1977e80c0 0x55d1977e84a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88fd3619abe307ee server_cookie=1df59094d1f86a74 in_seq=0 out_seq=0 2023-08-31T02:00:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.538+0000 7f3332ffd700 10 client.4923 ms_handle_connect on v2:172.21.15.170:6833/2233754260 2023-08-31T02:00:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3332ffd700 1 -- 172.21.15.84:0/4265800502 <== mds.0 v2:172.21.15.170:6833/2233754260 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55d1976ff000 con 0x55d1977e80c0 2023-08-31T02:00:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3332ffd700 10 client.4923 handle_command_reply: tid=0 2023-08-31T02:00:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 client.4923 shutdown 2023-08-31T02:00:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 -- 172.21.15.84:0/4265800502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 msgr2=0x55d197839610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197839610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55d19781a0b0 tx=0x7f334c00b840 comp rx=0 tx=0).stop 2023-08-31T02:00:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 -- 172.21.15.84:0/4265800502 shutdown_connections 2023-08-31T02:00:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d19781b4a0 0x55d197839610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:6833/2233754260,v1:172.21.15.170:6835/2233754260] conn(0x55d1977e80c0 0x55d1977e84a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d1977f18a0 0x55d197852660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 --2- 172.21.15.84:0/4265800502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1978133e0 0x55d1978923a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3332ffd700 0 client.4923 ms_handle_reset on v2:172.21.15.170:6833/2233754260 2023-08-31T02:00:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 -- 172.21.15.84:0/4265800502 >> 172.21.15.84:0/4265800502 conn(0x55d197768090 msgr2=0x55d1977f0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:28.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 -- 172.21.15.84:0/4265800502 shutdown_connections 2023-08-31T02:00:28.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 1 -- 172.21.15.84:0/4265800502 wait complete. 2023-08-31T02:00:28.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f3366a6cb80 20 client.4923 trim_cache size 0 max 16384 2023-08-31T02:00:28.556 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:00:28.556 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3192a6ac-325f-4185-9b3a-d848f695e6dd", 2023-08-31T02:00:28.556 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-08-31T02:00:28.556 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4362, 2023-08-31T02:00:28.556 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-08-31T02:00:28.557 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-08-31T02:00:28.557 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-08-31T02:00:28.557 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 29.403700706999999, 2023-08-31T02:00:28.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 9, 2023-08-31T02:00:28.557 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 26, 2023-08-31T02:00:28.557 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 26, 2023-08-31T02:00:28.558 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 36.847042844999997 2023-08-31T02:00:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:00:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 -- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f334006a0e0 msgr2=0x7f334006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f334006a0e0 0x7f334006c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33480058f0 tx=0x7f334800c4a0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 -- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33540b0460 msgr2=0x7f335413b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33540b0460 0x7f335413b900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f334400c4d0 tx=0x7f334400c890 comp rx=0 tx=0).stop 2023-08-31T02:00:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 -- 172.21.15.84:0/387193414 shutdown_connections 2023-08-31T02:00:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f334006a0e0 0x7f334006c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33541578b0 0x7f33540af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3354070630 0x7f3354156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 --2- 172.21.15.84:0/387193414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33540b0460 0x7f335413b900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.539+0000 7f335a8c9700 1 -- 172.21.15.84:0/387193414 >> 172.21.15.84:0/387193414 conn(0x7f33540ca090 msgr2=0x7f3354152cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.540+0000 7f335a8c9700 1 -- 172.21.15.84:0/387193414 shutdown_connections 2023-08-31T02:00:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:28.540+0000 7f335a8c9700 1 -- 172.21.15.84:0/387193414 wait complete. 2023-08-31T02:00:28.562 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-08-31T02:00:28.575 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-08-31T02:00:28.575 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-31T02:00:28.575 INFO:tasks.ceph_fuse:client.0 config is {} 2023-08-31T02:00:28.576 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T02:00:28.576 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T02:00:28.576 INFO:tasks.ceph_fuse:client.2 config is {} 2023-08-31T02:00:28.577 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T02:00:28.577 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-31T02:00:28.577 INFO:tasks.ceph_fuse:client.1 config is {} 2023-08-31T02:00:28.577 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T02:00:28.578 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T02:00:28.578 INFO:tasks.ceph_fuse:client.3 config is {} 2023-08-31T02:00:28.578 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T02:00:28.578 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-31T02:00:28.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:28.579 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-08-31T02:00:28.596 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-08-31T02:00:28.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:28.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-31T02:00:28.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:28.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-08-31T02:00:28.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:28.776 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-08-31T02:00:28.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:28.798 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2023-08-31T02:00:28.871 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2023-08-31T02:00:28.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:00:28.873 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-08-31T02:00:28.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T02:00:28.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.005+0000 7fd0de97f700 1 -- 172.21.15.84:0/46247019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c9c00 msgr2=0x7fd0d80b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:28.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.005+0000 7fd0de97f700 1 --2- 172.21.15.84:0/46247019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c9c00 0x7fd0d80b2a80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80098c0 tx=0x7fd0c8009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.005+0000 7fd0de97f700 1 -- 172.21.15.84:0/46247019 shutdown_connections 2023-08-31T02:00:28.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.005+0000 7fd0de97f700 1 --2- 172.21.15.84:0/46247019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c9c00 0x7fd0d80b2a80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:28.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.005+0000 7fd0de97f700 1 -- 172.21.15.84:0/46247019 >> 172.21.15.84:0/46247019 conn(0x7fd0d80ca930 msgr2=0x7fd0d80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:29.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.005+0000 7fd0de97f700 1 -- 172.21.15.84:0/46247019 shutdown_connections 2023-08-31T02:00:29.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.005+0000 7fd0de97f700 1 -- 172.21.15.84:0/46247019 wait complete. 2023-08-31T02:00:29.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.007+0000 7fd0de97f700 1 Processor -- start 2023-08-31T02:00:29.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.007+0000 7fd0de97f700 1 -- start start 2023-08-31T02:00:29.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0de97f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c8500 0x7fd0d8155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:29.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0de97f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0d80c9c00 0x7fd0d806a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:29.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0de97f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0d80ca030 0x7fd0d806a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:29.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0de97f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80c6550 con 0x7fd0d80c8500 2023-08-31T02:00:29.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0de97f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8155c90 con 0x7fd0d80c9c00 2023-08-31T02:00:29.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0de97f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80c5cb0 con 0x7fd0d80ca030 2023-08-31T02:00:29.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c8500 0x7fd0d8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:29.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c8500 0x7fd0d8155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52074/0 (socket says 172.21.15.84:52074) 2023-08-31T02:00:29.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 -- 172.21.15.84:0/1866561951 learned_addr learned my addr 172.21.15.84:0/1866561951 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:29.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d77fe700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0d80c9c00 0x7fd0d806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:29.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 -- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0d80ca030 msgr2=0x7fd0d806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:29.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0dcf1c700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0d80ca030 0x7fd0d806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:29.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0d80ca030 0x7fd0d806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:29.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 -- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0d80c9c00 msgr2=0x7fd0d806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:29.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0d80c9c00 0x7fd0d806a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:29.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 -- 172.21.15.84:0/1866561951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8009520 con 0x7fd0d80c8500 2023-08-31T02:00:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d77fe700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0d80c9c00 0x7fd0d806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0dcf1c700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0d80ca030 0x7fd0d806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.008+0000 7fd0d7fff700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c8500 0x7fd0d8155750 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0011e0 tx=0x7fd0cc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.009+0000 7fd0d4ff9700 1 -- 172.21.15.84:0/1866561951 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0054e0 con 0x7fd0d80c8500 2023-08-31T02:00:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.009+0000 7fd0d4ff9700 1 -- 172.21.15.84:0/1866561951 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd0cc003680 con 0x7fd0d80c8500 2023-08-31T02:00:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.009+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d80c5f90 con 0x7fd0d80c8500 2023-08-31T02:00:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.009+0000 7fd0d4ff9700 1 -- 172.21.15.84:0/1866561951 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc003a90 con 0x7fd0d80c8500 2023-08-31T02:00:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.009+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d81e2ca0 con 0x7fd0d80c8500 2023-08-31T02:00:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.010+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d81e2ec0 con 0x7fd0d80c8500 2023-08-31T02:00:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.010+0000 7fd0d4ff9700 1 -- 172.21.15.84:0/1866561951 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd0cc003bf0 con 0x7fd0d80c8500 2023-08-31T02:00:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.010+0000 7fd0d4ff9700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0c406a0e0 0x7fd0c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.010+0000 7fd0d4ff9700 1 -- 172.21.15.84:0/1866561951 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0cc087d30 con 0x7fd0d80c8500 2023-08-31T02:00:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.010+0000 7fd0d77fe700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0c406a0e0 0x7fd0c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:29.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.011+0000 7fd0d77fe700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0c406a0e0 0x7fd0c406c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80098c0 tx=0x7fd0c8019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:29.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.015+0000 7fd0d4ff9700 1 -- 172.21.15.84:0/1866561951 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd0cc0532b0 con 0x7fd0d80c8500 2023-08-31T02:00:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.251+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0d804e7c0 con 0x7fd0d80c8500 2023-08-31T02:00:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.251+0000 7fd0d4ff9700 1 -- 172.21.15.84:0/1866561951 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd0cc0568d0 con 0x7fd0d80c8500 2023-08-31T02:00:29.244 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T02:00:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0c406a0e0 msgr2=0x7fd0c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0c406a0e0 0x7fd0c406c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80098c0 tx=0x7fd0c8019040 comp rx=0 tx=0).stop 2023-08-31T02:00:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c8500 msgr2=0x7fd0d8155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c8500 0x7fd0d8155750 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0011e0 tx=0x7fd0cc00cae0 comp rx=0 tx=0).stop 2023-08-31T02:00:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 shutdown_connections 2023-08-31T02:00:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0c406a0e0 0x7fd0c406c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:29.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0d80ca030 0x7fd0d806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:29.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d80c8500 0x7fd0d8155750 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:29.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 --2- 172.21.15.84:0/1866561951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0d80c9c00 0x7fd0d806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:29.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 >> 172.21.15.84:0/1866561951 conn(0x7fd0d80ca930 msgr2=0x7fd0d81e0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:29.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 shutdown_connections 2023-08-31T02:00:29.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:29.253+0000 7fd0de97f700 1 -- 172.21.15.84:0/1866561951 wait complete. 2023-08-31T02:00:29.258 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T02:00:29.258 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T02:00:29.258 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-08-31T02:00:29.259 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T02:00:29.259 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T02:00:29.259 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T02:00:29.259 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T02:00:29.260 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T02:00:29.260 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T02:00:29.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.261 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-08-31T02:00:29.277 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:29.278 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:29.278 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:29.278 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:29.278 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:29.278 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:29.279 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:29.279 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:29.279 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:29.279 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:29.279 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:29.280 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:29.280 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T02:00:29.280 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:29.280 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T02:00:29.280 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-08-31T02:00:29.281 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ecad:a98e:85e8:7ebe/64 scope link noprefixroute 2023-08-31T02:00:29.281 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:29.281 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T02:00:29.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.282 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:29.282 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:29.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-08-31T02:00:29.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-08-31T02:00:29.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-08-31T02:00:29.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T02:00:29.283 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:29.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.394 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T02:00:29.420 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-08-31T02:00:29.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.421 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-08-31T02:00:29.481 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-08-31T02:00:29.481 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T02:00:29.481 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T02:00:29.482 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T02:00:29.482 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T02:00:29.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.483 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:29.483 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:29.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T02:00:29.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T02:00:29.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T02:00:29.484 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:29.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.587 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-08-31T02:00:29.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.607 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-08-31T02:00:29.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.664 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:29.664 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:29.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T02:00:29.665 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-31T02:00:29.665 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:29.756 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-31T02:00:29.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.757 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:29.758 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:29.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-31T02:00:29.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T02:00:29.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-31T02:00:29.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-31T02:00:29.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-31T02:00:29.759 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:29.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:29.967 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:29.968 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:29.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-08-31T02:00:29.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T02:00:29.969 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:30.079 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-31T02:00:30.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:30.080 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-31T02:00:30.098 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-31T02:00:30.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:30.099 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-31T02:00:30.155 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-08-31T02:00:30.222 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:30.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:30.288 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:30.289 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:30.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:30.290 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-08-31T02:00:30.345 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T02:00:30.346 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-31T02:00:30.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-08-31T02:00:30.413 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:30.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:30.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-08-31T02:00:30.483+0000 7f2af19ad5c0 -1 init, newargv = 0x5634b23f7110 newargc=15 2023-08-31T02:00:30.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[115245]: starting ceph client 2023-08-31T02:00:30.481 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[115245]: starting fuse 2023-08-31T02:00:30.481 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:30.483 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:30.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:30.484 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-08-31T02:00:30.541 INFO:teuthology.orchestra.run.smithi084.stdout:47 2023-08-31T02:00:30.541 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-31T02:00:30.541 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-08-31T02:00:30.542 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-08-31T02:00:30.542 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-08-31T02:00:30.542 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-08-31T02:00:30.543 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-08-31T02:00:30.543 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:30.543 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-08-31T02:00:30.544 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-31T02:00:30.544 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-08-31T02:00:30.544 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-31T02:00:30.545 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:30.545 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-08-31T02:00:30.545 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-08-31T02:00:30.545 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-08-31T02:00:30.546 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-08-31T02:00:30.546 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:30.546 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-08-31T02:00:30.547 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T02:00:30.547 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T02:00:30.547 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T02:00:30.548 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-08-31T02:00:30.548 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-08-31T02:00:30.548 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-08-31T02:00:30.548 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T02:00:30.549 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:30.549 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-08-31T02:00:30.549 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-08-31T02:00:30.663 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.115245.asok 2023-08-31T02:00:30.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T02:00:30.673 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.115245.asok 2023-08-31T02:00:30.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:30.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.115245.asok status 2023-08-31T02:00:30.829 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:00:30.829 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-08-31T02:00:30.830 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T02:00:30.830 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T02:00:30.830 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-08-31T02:00:30.830 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-08-31T02:00:30.831 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-31T02:00:30.831 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "115245", 2023-08-31T02:00:30.831 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-08-31T02:00:30.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:30.831 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-08-31T02:00:30.831 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-08-31T02:00:30.832 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4938, 2023-08-31T02:00:30.832 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-08-31T02:00:30.832 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-08-31T02:00:30.832 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-08-31T02:00:30.832 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4938 2023-08-31T02:00:30.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:30.833 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-08-31T02:00:30.833 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-08-31T02:00:30.833 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:00:30.833 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2198698559 2023-08-31T02:00:30.833 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:00:30.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:30.834 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-08-31T02:00:30.834 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-08-31T02:00:30.834 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:00:30.834 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2198698559 2023-08-31T02:00:30.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:30.835 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4938 192.168.0.1:0/2198698559", 2023-08-31T02:00:30.835 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2198698559", 2023-08-31T02:00:30.835 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-08-31T02:00:30.835 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 9, 2023-08-31T02:00:30.836 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 26, 2023-08-31T02:00:30.836 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-08-31T02:00:30.836 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-08-31T02:00:30.836 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-08-31T02:00:30.836 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:00:30.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T02:00:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.968+0000 7f79fbe42700 1 -- 172.21.15.84:0/1365565455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40b09b0 msgr2=0x7f79f40b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.968+0000 7f79fbe42700 1 --2- 172.21.15.84:0/1365565455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40b09b0 0x7f79f40b0e40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00b0a0 tx=0x7f79ec00b3b0 comp rx=0 tx=0).stop 2023-08-31T02:00:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.968+0000 7f79fbe42700 1 -- 172.21.15.84:0/1365565455 shutdown_connections 2023-08-31T02:00:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.968+0000 7f79fbe42700 1 --2- 172.21.15.84:0/1365565455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40b09b0 0x7f79f40b0e40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.968+0000 7f79fbe42700 1 --2- 172.21.15.84:0/1365565455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79f41591f0 0x7f79f40af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.968+0000 7f79fbe42700 1 -- 172.21.15.84:0/1365565455 >> 172.21.15.84:0/1365565455 conn(0x7f79f40699a0 msgr2=0x7f79f4069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:30.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.968+0000 7f79fbe42700 1 -- 172.21.15.84:0/1365565455 shutdown_connections 2023-08-31T02:00:30.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.968+0000 7f79fbe42700 1 -- 172.21.15.84:0/1365565455 wait complete. 2023-08-31T02:00:30.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.969+0000 7f79fbe42700 1 Processor -- start 2023-08-31T02:00:30.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.969+0000 7f79fbe42700 1 -- start start 2023-08-31T02:00:30.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79fbe42700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79f40b09b0 0x7f79f40c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:30.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79fbe42700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40c9780 0x7f79f406e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:30.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79fbe42700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79f41591f0 0x7f79f406e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:30.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79fbe42700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f414bfe0 con 0x7f79f40c9780 2023-08-31T02:00:30.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79fbe42700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40c69e0 con 0x7f79f40b09b0 2023-08-31T02:00:30.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79fbe42700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40c6cc0 con 0x7f79f41591f0 2023-08-31T02:00:30.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f93dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40c9780 0x7f79f406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:30.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f93dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40c9780 0x7f79f406e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52102/0 (socket says 172.21.15.84:52102) 2023-08-31T02:00:30.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f93dd700 1 -- 172.21.15.84:0/2726450212 learned_addr learned my addr 172.21.15.84:0/2726450212 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:30.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79fa3df700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79f41591f0 0x7f79f406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:30.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f9bde700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79f40b09b0 0x7f79f40c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:30.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f93dd700 1 -- 172.21.15.84:0/2726450212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79f41591f0 msgr2=0x7f79f406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:30.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f93dd700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79f41591f0 0x7f79f406e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:30.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f93dd700 1 -- 172.21.15.84:0/2726450212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79f40b09b0 msgr2=0x7f79f40c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:30.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f93dd700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79f40b09b0 0x7f79f40c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:30.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.970+0000 7f79f93dd700 1 -- 172.21.15.84:0/2726450212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec009d00 con 0x7f79f40c9780 2023-08-31T02:00:30.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.971+0000 7f79f93dd700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40c9780 0x7f79f406e120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c480 tx=0x7f79e400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:30.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.971+0000 7f79ea7fc700 1 -- 172.21.15.84:0/2726450212 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e40052d0 con 0x7f79f40c9780 2023-08-31T02:00:30.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.971+0000 7f79ea7fc700 1 -- 172.21.15.84:0/2726450212 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f79e400ce90 con 0x7f79f40c9780 2023-08-31T02:00:30.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.971+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f40c6fa0 con 0x7f79f40c9780 2023-08-31T02:00:30.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.971+0000 7f79ea7fc700 1 -- 172.21.15.84:0/2726450212 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4006b10 con 0x7f79f40c9780 2023-08-31T02:00:30.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.971+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f414d000 con 0x7f79f40c9780 2023-08-31T02:00:30.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.972+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f414ce60 con 0x7f79f40c9780 2023-08-31T02:00:30.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.972+0000 7f79ea7fc700 1 -- 172.21.15.84:0/2726450212 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79e40036d0 con 0x7f79f40c9780 2023-08-31T02:00:30.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.972+0000 7f79ea7fc700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f79d806a0e0 0x7f79d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.973+0000 7f79ea7fc700 1 -- 172.21.15.84:0/2726450212 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79e4087b20 con 0x7f79f40c9780 2023-08-31T02:00:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.973+0000 7f79f9bde700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f79d806a0e0 0x7f79d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.973+0000 7f79f9bde700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f79d806a0e0 0x7f79d806c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79f0004630 tx=0x7f79f000b390 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:30.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:30.977+0000 7f79ea7fc700 1 -- 172.21.15.84:0/2726450212 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f79f414ce60 con 0x7f79f40c9780 2023-08-31T02:00:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.216+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79f414ce60 con 0x7f79f40c9780 2023-08-31T02:00:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.216+0000 7f79ea7fc700 1 -- 172.21.15.84:0/2726450212 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f79f414ce60 con 0x7f79f40c9780 2023-08-31T02:00:31.210 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T02:00:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.218+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f79d806a0e0 msgr2=0x7f79d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.218+0000 7f79fbe42700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f79d806a0e0 0x7f79d806c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79f0004630 tx=0x7f79f000b390 comp rx=0 tx=0).stop 2023-08-31T02:00:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.218+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40c9780 msgr2=0x7f79f406e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.218+0000 7f79fbe42700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40c9780 0x7f79f406e120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c480 tx=0x7f79e400c790 comp rx=0 tx=0).stop 2023-08-31T02:00:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.219+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 shutdown_connections 2023-08-31T02:00:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.219+0000 7f79fbe42700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f79d806a0e0 0x7f79d806c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.219+0000 7f79fbe42700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79f41591f0 0x7f79f406e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.219+0000 7f79fbe42700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79f40b09b0 0x7f79f40c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.219+0000 7f79fbe42700 1 --2- 172.21.15.84:0/2726450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f40c9780 0x7f79f406e120 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.219+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 >> 172.21.15.84:0/2726450212 conn(0x7f79f40699a0 msgr2=0x7f79f4069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.219+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 shutdown_connections 2023-08-31T02:00:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:31.219+0000 7f79fbe42700 1 -- 172.21.15.84:0/2726450212 wait complete. 2023-08-31T02:00:31.223 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T02:00:31.223 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T02:00:31.224 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-08-31T02:00:31.224 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-31T02:00:31.224 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-31T02:00:31.224 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T02:00:31.225 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T02:00:31.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T02:00:31.225 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-31T02:00:31.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.226 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-08-31T02:00:31.244 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:31.245 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:31.245 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:31.246 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.246 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:31.247 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:31.247 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:31.248 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:31.249 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:31.249 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:31.250 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T02:00:31.250 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:31.251 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T02:00:31.251 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42373sec preferred_lft 42373sec 2023-08-31T02:00:31.251 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ecad:a98e:85e8:7ebe/64 scope link noprefixroute 2023-08-31T02:00:31.252 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.252 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T02:00:31.253 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether b6:b6:7b:67:62:75 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:31.253 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T02:00:31.253 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.254 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::fccd:8bff:feab:d4e0/64 scope link 2023-08-31T02:00:31.254 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.255 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T02:00:31.255 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether b6:b6:7b:67:62:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T02:00:31.255 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::b4b6:7bff:fe67:6275/64 scope link tentative 2023-08-31T02:00:31.256 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.257 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T02:00:31.310 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-08-31T02:00:31.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.311 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-08-31T02:00:31.370 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-08-31T02:00:31.371 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T02:00:31.371 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T02:00:31.371 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T02:00:31.372 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T02:00:31.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.372 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:31.373 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:31.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T02:00:31.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T02:00:31.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T02:00:31.374 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:31.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.474 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-08-31T02:00:31.491 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T02:00:31.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.492 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-08-31T02:00:31.548 INFO:teuthology.orchestra.run.smithi084.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-31T02:00:31.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.549 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:31.549 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:31.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T02:00:31.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-31T02:00:31.550 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:31.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-31T02:00:31.681 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:31.682 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:31.682 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:31.682 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.683 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:31.683 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.683 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T02:00:31.683 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 52:b0:5f:86:ea:f7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T02:00:31.683 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T02:00:31.683 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.684 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::50b0:5fff:fe86:eaf7/64 scope link tentative 2023-08-31T02:00:31.684 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-31T02:00:31.784 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:31.785 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:31.785 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:31.785 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.785 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:31.785 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.786 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T02:00:31.786 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 52:b0:5f:86:ea:f7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T02:00:31.786 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T02:00:31.786 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.786 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::50b0:5fff:fe86:eaf7/64 scope link 2023-08-31T02:00:31.787 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:31.792 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-31T02:00:31.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:31.793 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:31.794 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:31.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-31T02:00:31.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-31T02:00:31.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-31T02:00:31.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-31T02:00:31.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-31T02:00:31.795 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:32.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:32.036 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:00:32.037 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:00:32.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.1 up 2023-08-31T02:00:32.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.1 master ceph-brx 2023-08-31T02:00:32.037 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:00:32.152 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-08-31T02:00:32.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:32.152 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-31T02:00:32.175 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-31T02:00:32.175 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:32.176 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-31T02:00:32.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-08-31T02:00:32.299 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:32.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:32.366 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:32.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:32.367 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-08-31T02:00:32.424 INFO:teuthology.orchestra.run.smithi084.stdout:47 2023-08-31T02:00:32.424 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-08-31T02:00:32.425 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-08-31T02:00:32.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-08-31T02:00:32.492 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:32.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:32.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:2023-08-31T02:00:32.560+0000 7f243e3115c0 -1 init, newargv = 0x56545226b120 newargc=15 2023-08-31T02:00:32.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:ceph-fuse[115898]: starting ceph client 2023-08-31T02:00:32.558 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:ceph-fuse[115898]: starting fuse 2023-08-31T02:00:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:32.563 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:32.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:32.565 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-08-31T02:00:32.621 INFO:teuthology.orchestra.run.smithi084.stdout:47 2023-08-31T02:00:32.621 INFO:teuthology.orchestra.run.smithi084.stdout:48 2023-08-31T02:00:32.621 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-08-31T02:00:32.622 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-08-31T02:00:32.622 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-08-31T02:00:32.622 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-08-31T02:00:32.623 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-08-31T02:00:32.623 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-08-31T02:00:32.623 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:32.623 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-08-31T02:00:32.624 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-08-31T02:00:32.624 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-08-31T02:00:32.624 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-08-31T02:00:32.625 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:32.625 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-08-31T02:00:32.625 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-08-31T02:00:32.625 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-08-31T02:00:32.626 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-08-31T02:00:32.626 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:32.626 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-08-31T02:00:32.627 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T02:00:32.627 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T02:00:32.627 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T02:00:32.628 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-08-31T02:00:32.628 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-08-31T02:00:32.628 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-08-31T02:00:32.628 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T02:00:32.629 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:00:32.629 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.2")) 2023-08-31T02:00:32.629 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-08-31T02:00:32.744 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.2.115898.asok 2023-08-31T02:00:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T02:00:32.753 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.115898.asok 2023-08-31T02:00:32.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:32.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.115898.asok status 2023-08-31T02:00:32.907 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:00:32.908 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-08-31T02:00:32.908 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T02:00:32.908 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T02:00:32.908 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "2", 2023-08-31T02:00:32.908 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-08-31T02:00:32.909 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-08-31T02:00:32.909 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "115898", 2023-08-31T02:00:32.909 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-08-31T02:00:32.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:32.909 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-08-31T02:00:32.910 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-08-31T02:00:32.910 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4950, 2023-08-31T02:00:32.910 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-08-31T02:00:32.910 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-08-31T02:00:32.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-08-31T02:00:32.911 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4950 2023-08-31T02:00:32.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:32.911 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-08-31T02:00:32.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-08-31T02:00:32.912 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.2:0", 2023-08-31T02:00:32.912 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2294337854 2023-08-31T02:00:32.912 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:00:32.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:32.912 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-08-31T02:00:32.913 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-08-31T02:00:32.913 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.2:0", 2023-08-31T02:00:32.913 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2294337854 2023-08-31T02:00:32.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:00:32.913 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4950 192.168.0.2:0/2294337854", 2023-08-31T02:00:32.913 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.2:0/2294337854", 2023-08-31T02:00:32.914 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-08-31T02:00:32.914 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 9, 2023-08-31T02:00:32.914 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 26, 2023-08-31T02:00:32.914 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-08-31T02:00:32.914 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-08-31T02:00:32.915 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-08-31T02:00:32.915 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:00:32.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T02:00:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.048+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3850510271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd90005210 msgr2=0x7fbd9000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.048+0000 7fbdac5a8700 1 --2- 172.21.15.84:0/3850510271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd90005210 0x7fbd9000ba10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c001f90 tx=0x7fbd90005880 comp rx=0 tx=0).stop 2023-08-31T02:00:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.048+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3850510271 shutdown_connections 2023-08-31T02:00:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.048+0000 7fbdac5a8700 1 --2- 172.21.15.84:0/3850510271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd90005210 0x7fbd9000ba10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.048+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3850510271 >> 172.21.15.84:0/3850510271 conn(0x7fbda40caa20 msgr2=0x7fbda40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:33.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.048+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3850510271 shutdown_connections 2023-08-31T02:00:33.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.048+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3850510271 wait complete. 2023-08-31T02:00:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdac5a8700 1 Processor -- start 2023-08-31T02:00:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdac5a8700 1 -- start start 2023-08-31T02:00:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdac5a8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd90005210 0x7fbda414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdac5a8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbda414f950 0x7fbda415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdac5a8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda414fdd0 0x7fbda415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdac5a8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda414e8b0 con 0x7fbda414fdd0 2023-08-31T02:00:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdac5a8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda414eb90 con 0x7fbda414f950 2023-08-31T02:00:33.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdac5a8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda414ee70 con 0x7fbd90005210 2023-08-31T02:00:33.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdaab45700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda414fdd0 0x7fbda415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:33.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdaab45700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda414fdd0 0x7fbda415ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52144/0 (socket says 172.21.15.84:52144) 2023-08-31T02:00:33.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.050+0000 7fbdaab45700 1 -- 172.21.15.84:0/3532615879 learned_addr learned my addr 172.21.15.84:0/3532615879 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:33.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdaa344700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd90005210 0x7fbda414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:33.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbda9b43700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbda414f950 0x7fbda415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:33.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdaab45700 1 -- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd90005210 msgr2=0x7fbda414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:33.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdaab45700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd90005210 0x7fbda414d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:33.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdaab45700 1 -- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbda414f950 msgr2=0x7fbda415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:33.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdaab45700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbda414f950 0x7fbda415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:33.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdaab45700 1 -- 172.21.15.84:0/3532615879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda414f150 con 0x7fbda414fdd0 2023-08-31T02:00:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdaa344700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd90005210 0x7fbda414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbda9b43700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbda414f950 0x7fbda415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdaab45700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda414fdd0 0x7fbda415ae60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbda40ad9b0 tx=0x7fbd9c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbd9affd700 1 -- 172.21.15.84:0/3532615879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c020070 con 0x7fbda414fdd0 2023-08-31T02:00:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbd9affd700 1 -- 172.21.15.84:0/3532615879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbd9c00cab0 con 0x7fbda414fdd0 2023-08-31T02:00:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda414f430 con 0x7fbda414fdd0 2023-08-31T02:00:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbd9affd700 1 -- 172.21.15.84:0/3532615879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c006540 con 0x7fbda414fdd0 2023-08-31T02:00:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.051+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda4150970 con 0x7fbda414fdd0 2023-08-31T02:00:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.052+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda414f650 con 0x7fbda414fdd0 2023-08-31T02:00:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.052+0000 7fbd9affd700 1 -- 172.21.15.84:0/3532615879 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbd9c0066a0 con 0x7fbda414fdd0 2023-08-31T02:00:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.053+0000 7fbd9affd700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbd8806a0e0 0x7fbd8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.053+0000 7fbd9affd700 1 -- 172.21.15.84:0/3532615879 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd9c088ef0 con 0x7fbda414fdd0 2023-08-31T02:00:33.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.053+0000 7fbdaa344700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbd8806a0e0 0x7fbd8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:33.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.053+0000 7fbdaa344700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbd8806a0e0 0x7fbd8806c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbda414e030 tx=0x7fbd94009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:33.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.057+0000 7fbd9affd700 1 -- 172.21.15.84:0/3532615879 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbd9c0543f0 con 0x7fbda414fdd0 2023-08-31T02:00:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.289+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbda40cc8a0 con 0x7fbda414fdd0 2023-08-31T02:00:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.289+0000 7fbd9affd700 1 -- 172.21.15.84:0/3532615879 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbd9c015070 con 0x7fbda414fdd0 2023-08-31T02:00:33.283 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T02:00:33.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbd8806a0e0 msgr2=0x7fbd8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:33.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbd8806a0e0 0x7fbd8806c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbda414e030 tx=0x7fbd94009260 comp rx=0 tx=0).stop 2023-08-31T02:00:33.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda414fdd0 msgr2=0x7fbda415ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:33.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda414fdd0 0x7fbda415ae60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbda40ad9b0 tx=0x7fbd9c001250 comp rx=0 tx=0).stop 2023-08-31T02:00:33.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 shutdown_connections 2023-08-31T02:00:33.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fbd8806a0e0 0x7fbd8806c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbda414fdd0 0x7fbda415ae60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd90005210 0x7fbda414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 --2- 172.21.15.84:0/3532615879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbda414f950 0x7fbda415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 >> 172.21.15.84:0/3532615879 conn(0x7fbda40caa20 msgr2=0x7fbda406d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 shutdown_connections 2023-08-31T02:00:33.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:33.291+0000 7fbdac5a8700 1 -- 172.21.15.84:0/3532615879 wait complete. 2023-08-31T02:00:33.296 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T02:00:33.296 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T02:00:33.296 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2023-08-31T02:00:33.297 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-31T02:00:33.297 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T02:00:33.297 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T02:00:33.298 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T02:00:33.298 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T02:00:33.299 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-31T02:00:33.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:33.300 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2023-08-31T02:00:33.321 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:33.321 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:33.321 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:33.322 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:33.322 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:33.322 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:33.322 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:33.323 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:33.323 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:33.323 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:33.323 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:33.324 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:33.324 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T02:00:33.324 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:33.324 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T02:00:33.325 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-08-31T02:00:33.325 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c8f4:6f89:3509:f73e/64 scope link noprefixroute 2023-08-31T02:00:33.325 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:33.325 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T02:00:33.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:33.326 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:33.326 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:33.327 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add name ceph-brx type bridge 2023-08-31T02:00:33.327 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr flush dev ceph-brx 2023-08-31T02:00:33.327 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set ceph-brx up 2023-08-31T02:00:33.327 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T02:00:33.328 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:33.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:33.542 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T02:00:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:1 2023-08-31T02:00:33.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:33.573 DEBUG:teuthology.orchestra.run.smithi170:> route 2023-08-31T02:00:33.642 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2023-08-31T02:00:33.642 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T02:00:33.642 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T02:00:33.643 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T02:00:33.643 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T02:00:33.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:33.644 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:33.644 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:33.644 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T02:00:33.645 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T02:00:33.645 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T02:00:33.645 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:33.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:33.927 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-08-31T02:00:33.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:33.944 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2023-08-31T02:00:34.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:34.000 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:34.001 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:34.001 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T02:00:34.001 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-31T02:00:34.002 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:34.094 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-31T02:00:34.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:34.095 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:34.095 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:34.095 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-31T02:00:34.096 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T02:00:34.096 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-31T02:00:34.096 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-31T02:00:34.097 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-31T02:00:34.097 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:34.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:34.286 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:34.286 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:34.286 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2023-08-31T02:00:34.287 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T02:00:34.287 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:34.393 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-08-31T02:00:34.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:34.394 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-31T02:00:34.415 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-31T02:00:34.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:34.416 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-31T02:00:34.472 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-08-31T02:00:34.540 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:34.541 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:34.608 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:34.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:34.609 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-08-31T02:00:34.666 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T02:00:34.666 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-08-31T02:00:34.709 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-08-31T02:00:34.735 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:34.739 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:34.798 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2023-08-31T02:00:34.806+0000 7f6de85a35c0 -1 init, newargv = 0x557c48aba0a0 newargc=15 2023-08-31T02:00:34.798 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[109493]: starting ceph client 2023-08-31T02:00:34.802 INFO:teuthology.orchestra.run.smithi170.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:34.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[109493]: starting fuse 2023-08-31T02:00:34.804 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:34.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:34.805 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-08-31T02:00:34.861 INFO:teuthology.orchestra.run.smithi170.stdout:47 2023-08-31T02:00:34.862 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-31T02:00:34.862 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2023-08-31T02:00:34.863 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2023-08-31T02:00:34.863 DEBUG:teuthology.orchestra.run.smithi170:> import re 2023-08-31T02:00:34.863 DEBUG:teuthology.orchestra.run.smithi170:> import os 2023-08-31T02:00:34.863 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2023-08-31T02:00:34.864 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:00:34.864 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2023-08-31T02:00:34.865 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-08-31T02:00:34.865 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2023-08-31T02:00:34.865 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-08-31T02:00:34.866 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:00:34.866 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2023-08-31T02:00:34.867 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2023-08-31T02:00:34.867 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2023-08-31T02:00:34.867 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2023-08-31T02:00:34.868 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:00:34.868 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2023-08-31T02:00:34.868 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T02:00:34.869 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T02:00:34.869 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T02:00:34.869 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2023-08-31T02:00:34.870 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2023-08-31T02:00:34.870 DEBUG:teuthology.orchestra.run.smithi170:> return f 2023-08-31T02:00:34.870 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T02:00:34.871 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:00:34.871 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.1")) 2023-08-31T02:00:34.871 DEBUG:teuthology.orchestra.run.smithi170:> ' 2023-08-31T02:00:34.984 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.1.109493.asok 2023-08-31T02:00:34.987 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T02:00:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T02:00:34.994 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.109493.asok 2023-08-31T02:00:34.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:34.995 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.109493.asok status 2023-08-31T02:00:35.150 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2023-08-31T02:00:35.150 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2023-08-31T02:00:35.150 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T02:00:35.151 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T02:00:35.151 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "1", 2023-08-31T02:00:35.151 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2023-08-31T02:00:35.151 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-08-31T02:00:35.152 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "109493", 2023-08-31T02:00:35.152 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2023-08-31T02:00:35.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:00:35.152 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2023-08-31T02:00:35.152 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2023-08-31T02:00:35.153 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4798, 2023-08-31T02:00:35.153 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2023-08-31T02:00:35.153 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2023-08-31T02:00:35.153 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2023-08-31T02:00:35.154 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 4798 2023-08-31T02:00:35.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:00:35.154 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-08-31T02:00:35.154 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-08-31T02:00:35.154 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:00:35.155 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 4068581803 2023-08-31T02:00:35.155 INFO:teuthology.orchestra.run.smithi170.stdout: } 2023-08-31T02:00:35.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:00:35.155 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-08-31T02:00:35.156 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-08-31T02:00:35.156 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:00:35.156 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 4068581803 2023-08-31T02:00:35.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:00:35.157 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.4798 192.168.0.1:0/4068581803", 2023-08-31T02:00:35.157 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.1:0/4068581803", 2023-08-31T02:00:35.157 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2023-08-31T02:00:35.157 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 9, 2023-08-31T02:00:35.158 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 26, 2023-08-31T02:00:35.158 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2023-08-31T02:00:35.158 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2023-08-31T02:00:35.158 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2023-08-31T02:00:35.158 INFO:teuthology.orchestra.run.smithi170.stdout:} 2023-08-31T02:00:35.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T02:00:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.306+0000 7f027a26d700 1 -- 172.21.15.84:0/3455543682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02740caea0 msgr2=0x7f02740cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.306+0000 7f027a26d700 1 --2- 172.21.15.84:0/3455543682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02740caea0 0x7f02740cb310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f02740ca890 tx=0x7f026c00b330 comp rx=0 tx=0).stop 2023-08-31T02:00:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.306+0000 7f027a26d700 1 -- 172.21.15.84:0/3455543682 shutdown_connections 2023-08-31T02:00:35.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.306+0000 7f027a26d700 1 --2- 172.21.15.84:0/3455543682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02740caea0 0x7f02740cb310 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.306+0000 7f027a26d700 1 --2- 172.21.15.84:0/3455543682 >> v2:172.21.15.170:3300/0 conn(0x7f027406c930 0x7f0274158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.306+0000 7f027a26d700 1 -- 172.21.15.84:0/3455543682 >> 172.21.15.84:0/3455543682 conn(0x7f02740699a0 msgr2=0x7f0274069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:35.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.306+0000 7f027a26d700 1 -- 172.21.15.84:0/3455543682 shutdown_connections 2023-08-31T02:00:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.306+0000 7f027a26d700 1 -- 172.21.15.84:0/3455543682 wait complete. 2023-08-31T02:00:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.307+0000 7f027a26d700 1 Processor -- start 2023-08-31T02:00:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.307+0000 7f027a26d700 1 -- start start 2023-08-31T02:00:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f027a26d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027406c930 0x7f0274146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f027a26d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02740b2b60 0x7f0274148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f027a26d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02740caea0 0x7f02741f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f027a26d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274147ab0 con 0x7f027406c930 2023-08-31T02:00:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f027a26d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02741467d0 con 0x7f02740b2b60 2023-08-31T02:00:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f027a26d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0274147620 con 0x7f02740caea0 2023-08-31T02:00:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027406c930 0x7f0274146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027406c930 0x7f0274146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52152/0 (socket says 172.21.15.84:52152) 2023-08-31T02:00:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 -- 172.21.15.84:0/3999777655 learned_addr learned my addr 172.21.15.84:0/3999777655 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f02737fe700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02740b2b60 0x7f0274148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f027880a700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02740caea0 0x7f02741f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 -- 172.21.15.84:0/3999777655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02740caea0 msgr2=0x7f02741f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02740caea0 0x7f02741f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 -- 172.21.15.84:0/3999777655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02740b2b60 msgr2=0x7f0274148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02740b2b60 0x7f0274148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 -- 172.21.15.84:0/3999777655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c009c40 con 0x7f027406c930 2023-08-31T02:00:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.308+0000 7f0273fff700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027406c930 0x7f0274146290 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f026400c500 tx=0x7f026400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.309+0000 7f0270ff9700 1 -- 172.21.15.84:0/3999777655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264011790 con 0x7f027406c930 2023-08-31T02:00:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.309+0000 7f0270ff9700 1 -- 172.21.15.84:0/3999777655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f02640118f0 con 0x7f027406c930 2023-08-31T02:00:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.309+0000 7f0270ff9700 1 -- 172.21.15.84:0/3999777655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264011ce0 con 0x7f027406c930 2023-08-31T02:00:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.309+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0274146a10 con 0x7f027406c930 2023-08-31T02:00:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.309+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0274146fd0 con 0x7f027406c930 2023-08-31T02:00:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.310+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027404e7c0 con 0x7f027406c930 2023-08-31T02:00:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.310+0000 7f0270ff9700 1 -- 172.21.15.84:0/3999777655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f026401c460 con 0x7f027406c930 2023-08-31T02:00:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.310+0000 7f0270ff9700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f025406a0e0 0x7f025406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.311+0000 7f0270ff9700 1 -- 172.21.15.84:0/3999777655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0264088490 con 0x7f027406c930 2023-08-31T02:00:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.311+0000 7f02737fe700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f025406a0e0 0x7f025406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:35.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.311+0000 7f02737fe700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f025406a0e0 0x7f025406c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0274152360 tx=0x7f025c009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:35.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.315+0000 7f0270ff9700 1 -- 172.21.15.84:0/3999777655 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f02640538e0 con 0x7f027406c930 2023-08-31T02:00:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.550+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f02740b2f40 con 0x7f027406c930 2023-08-31T02:00:35.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.550+0000 7f0270ff9700 1 -- 172.21.15.84:0/3999777655 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f02740b2f40 con 0x7f027406c930 2023-08-31T02:00:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T02:00:35.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f025406a0e0 msgr2=0x7f025406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f025406a0e0 0x7f025406c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0274152360 tx=0x7f025c009260 comp rx=0 tx=0).stop 2023-08-31T02:00:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027406c930 msgr2=0x7f0274146290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027406c930 0x7f0274146290 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f026400c500 tx=0x7f026400c810 comp rx=0 tx=0).stop 2023-08-31T02:00:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 shutdown_connections 2023-08-31T02:00:35.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f025406a0e0 0x7f025406c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:35.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02740caea0 0x7f02741f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:35.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027406c930 0x7f0274146290 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:35.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 --2- 172.21.15.84:0/3999777655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02740b2b60 0x7f0274148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:35.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 >> 172.21.15.84:0/3999777655 conn(0x7f02740699a0 msgr2=0x7f027414e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:35.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 shutdown_connections 2023-08-31T02:00:35.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:35.552+0000 7f027a26d700 1 -- 172.21.15.84:0/3999777655 wait complete. 2023-08-31T02:00:35.556 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T02:00:35.557 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T02:00:35.557 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2023-08-31T02:00:35.557 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-31T02:00:35.557 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-31T02:00:35.558 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T02:00:35.558 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T02:00:35.558 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T02:00:35.558 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-31T02:00:35.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:35.559 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2023-08-31T02:00:35.577 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:35.578 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:35.578 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:35.578 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:35.578 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:35.579 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:35.579 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:35.579 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:35.579 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:35.579 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:35.580 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:00:35.580 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:35.580 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T02:00:35.580 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:35.581 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T02:00:35.581 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-08-31T02:00:35.581 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c8f4:6f89:3509:f73e/64 scope link noprefixroute 2023-08-31T02:00:35.581 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:35.581 INFO:teuthology.orchestra.run.smithi170.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T02:00:35.582 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether aa:28:1b:9a:0e:9d brd ff:ff:ff:ff:ff:ff 2023-08-31T02:00:35.582 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T02:00:35.582 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:35.582 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::1cc6:a0ff:fea2:6748/64 scope link 2023-08-31T02:00:35.582 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:35.583 INFO:teuthology.orchestra.run.smithi170.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T02:00:35.583 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether aa:28:1b:9a:0e:9d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T02:00:35.583 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::a828:1bff:fe9a:e9d/64 scope link tentative 2023-08-31T02:00:35.583 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:35.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:35.584 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T02:00:35.644 INFO:teuthology.orchestra.run.smithi170.stdout:1 2023-08-31T02:00:35.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:35.646 DEBUG:teuthology.orchestra.run.smithi170:> route 2023-08-31T02:00:35.704 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2023-08-31T02:00:35.705 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T02:00:35.705 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T02:00:35.705 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T02:00:35.705 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T02:00:35.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:35.706 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:35.707 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:35.707 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T02:00:35.707 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T02:00:35.707 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T02:00:35.708 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:35.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:35.810 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-08-31T02:00:35.830 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T02:00:35.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:35.831 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2023-08-31T02:00:35.887 INFO:teuthology.orchestra.run.smithi170.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-31T02:00:35.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:35.888 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:35.888 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:35.888 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T02:00:35.889 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-31T02:00:35.889 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:35.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:35.981 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-31T02:00:36.020 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:36.020 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:36.020 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:36.021 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:36.021 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:36.021 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:36.021 INFO:teuthology.orchestra.run.smithi170.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T02:00:36.021 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 9a:16:5e:c0:a1:45 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T02:00:36.022 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T02:00:36.022 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:36.022 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::9816:5eff:fec0:a145/64 scope link tentative 2023-08-31T02:00:36.022 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:36.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:36.045 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-31T02:00:36.120 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:00:36.120 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:00:36.120 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:00:36.120 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:36.121 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-08-31T02:00:36.121 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:36.121 INFO:teuthology.orchestra.run.smithi170.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T02:00:36.121 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 9a:16:5e:c0:a1:45 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T02:00:36.121 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T02:00:36.122 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:36.122 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::9816:5eff:fec0:a145/64 scope link tentative 2023-08-31T02:00:36.122 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:00:36.134 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-31T02:00:36.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:36.135 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:36.135 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:36.136 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-31T02:00:36.136 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-31T02:00:36.136 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-31T02:00:36.136 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-31T02:00:36.137 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-31T02:00:36.137 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:36.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:36.374 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:00:36.374 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:00:36.375 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.1 up 2023-08-31T02:00:36.375 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.1 master ceph-brx 2023-08-31T02:00:36.375 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:00:36.483 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-08-31T02:00:36.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:36.484 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-31T02:00:36.503 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-31T02:00:36.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:00:36.503 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-31T02:00:36.559 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-08-31T02:00:36.625 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:36.625 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:36.690 INFO:teuthology.orchestra.run.smithi170.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:36.691 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:36.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:36.692 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-08-31T02:00:36.749 INFO:teuthology.orchestra.run.smithi170.stdout:47 2023-08-31T02:00:36.749 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-08-31T02:00:36.749 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-08-31T02:00:36.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-08-31T02:00:36.817 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:00:36.818 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:00:36.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:2023-08-31T02:00:36.886+0000 7fe6075365c0 -1 init, newargv = 0x562a8eb2bfc0 newargc=15 2023-08-31T02:00:36.879 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:ceph-fuse[110100]: starting ceph client 2023-08-31T02:00:36.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:ceph-fuse[110100]: starting fuse 2023-08-31T02:00:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:00:36.888 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:00:36.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:36.889 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-08-31T02:00:36.945 INFO:teuthology.orchestra.run.smithi170.stdout:47 2023-08-31T02:00:36.945 INFO:teuthology.orchestra.run.smithi170.stdout:48 2023-08-31T02:00:36.946 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-08-31T02:00:36.947 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2023-08-31T02:00:36.947 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2023-08-31T02:00:36.947 DEBUG:teuthology.orchestra.run.smithi170:> import re 2023-08-31T02:00:36.948 DEBUG:teuthology.orchestra.run.smithi170:> import os 2023-08-31T02:00:36.948 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2023-08-31T02:00:36.948 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:00:36.949 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2023-08-31T02:00:36.949 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-08-31T02:00:36.949 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2023-08-31T02:00:36.949 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-08-31T02:00:36.950 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:00:36.950 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2023-08-31T02:00:36.950 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2023-08-31T02:00:36.951 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2023-08-31T02:00:36.951 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2023-08-31T02:00:36.952 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:00:36.952 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2023-08-31T02:00:36.952 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T02:00:36.953 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T02:00:36.953 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T02:00:36.953 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2023-08-31T02:00:36.954 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2023-08-31T02:00:36.954 DEBUG:teuthology.orchestra.run.smithi170:> return f 2023-08-31T02:00:36.954 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T02:00:36.955 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:00:36.955 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.3")) 2023-08-31T02:00:36.955 DEBUG:teuthology.orchestra.run.smithi170:> ' 2023-08-31T02:00:37.067 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.3.110100.asok 2023-08-31T02:00:37.070 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T02:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T02:00:37.076 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.110100.asok 2023-08-31T02:00:37.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.077 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.110100.asok status 2023-08-31T02:00:37.233 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2023-08-31T02:00:37.233 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2023-08-31T02:00:37.233 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T02:00:37.234 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T02:00:37.234 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "3", 2023-08-31T02:00:37.234 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2023-08-31T02:00:37.234 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-08-31T02:00:37.235 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "110100", 2023-08-31T02:00:37.235 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2023-08-31T02:00:37.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:00:37.235 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2023-08-31T02:00:37.235 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2023-08-31T02:00:37.236 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4697, 2023-08-31T02:00:37.236 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2023-08-31T02:00:37.236 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2023-08-31T02:00:37.236 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2023-08-31T02:00:37.237 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 4697 2023-08-31T02:00:37.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:00:37.237 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-08-31T02:00:37.237 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-08-31T02:00:37.237 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.2:0", 2023-08-31T02:00:37.238 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 718860784 2023-08-31T02:00:37.238 INFO:teuthology.orchestra.run.smithi170.stdout: } 2023-08-31T02:00:37.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:00:37.239 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-08-31T02:00:37.239 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-08-31T02:00:37.239 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.2:0", 2023-08-31T02:00:37.239 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 718860784 2023-08-31T02:00:37.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:00:37.240 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.4697 192.168.0.2:0/718860784", 2023-08-31T02:00:37.240 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.2:0/718860784", 2023-08-31T02:00:37.240 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2023-08-31T02:00:37.240 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 9, 2023-08-31T02:00:37.241 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 26, 2023-08-31T02:00:37.241 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2023-08-31T02:00:37.241 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2023-08-31T02:00:37.241 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2023-08-31T02:00:37.241 INFO:teuthology.orchestra.run.smithi170.stdout:} 2023-08-31T02:00:37.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.243 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-08-31T02:00:37.243 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-31T02:00:37.265 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-08-31T02:00:37.265 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-31T02:00:37.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.266 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T02:00:37.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.338 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-08-31T02:00:37.338 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.2 2023-08-31T02:00:37.396 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-08-31T02:00:37.397 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-08-31T02:00:37.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-31T02:00:37.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.466 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2023-08-31T02:00:37.466 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.1 2023-08-31T02:00:37.484 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2023-08-31T02:00:37.485 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-08-31T02:00:37.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.485 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-31T02:00:37.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.552 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2023-08-31T02:00:37.553 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.3 2023-08-31T02:00:37.609 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2023-08-31T02:00:37.609 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-08-31T02:00:37.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:37.610 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-31T02:00:37.675 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-31T02:00:37.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:37.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.827+0000 7f80ee5a0700 1 -- 172.21.15.84:0/2379607526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4004d90 msgr2=0x7f80d4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:37.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.827+0000 7f80ee5a0700 1 --2- 172.21.15.84:0/2379607526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4004d90 0x7f80d4005210 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f80e80ad810 tx=0x7f80d4005880 comp rx=0 tx=0).stop 2023-08-31T02:00:37.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.827+0000 7f80edd9f700 1 -- 172.21.15.84:0/2379607526 reap_dead start 2023-08-31T02:00:37.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.827+0000 7f80ee5a0700 1 -- 172.21.15.84:0/2379607526 shutdown_connections 2023-08-31T02:00:37.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.827+0000 7f80ee5a0700 1 -- 172.21.15.84:0/2379607526 >> 172.21.15.84:0/2379607526 conn(0x7f80e80ca820 msgr2=0x7f80e80cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:37.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.827+0000 7f80ee5a0700 1 -- 172.21.15.84:0/2379607526 shutdown_connections 2023-08-31T02:00:37.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.827+0000 7f80ee5a0700 1 -- 172.21.15.84:0/2379607526 wait complete. 2023-08-31T02:00:37.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.828+0000 7f80ee5a0700 1 Processor -- start 2023-08-31T02:00:37.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.828+0000 7f80ee5a0700 1 -- start start 2023-08-31T02:00:37.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ee5a0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80d4004d90 0x7f80e814b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:37.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ee5a0700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e81f1bf0 0x7f80e80b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:37.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ee5a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e814c230 0x7f80e80ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:37.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ee5a0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80b19f0 con 0x7f80e814c230 2023-08-31T02:00:37.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ee5a0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80c2f20 con 0x7f80d4004d90 2023-08-31T02:00:37.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ee5a0700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80b2810 con 0x7f80e81f1bf0 2023-08-31T02:00:37.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80edd9f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e814c230 0x7f80e80ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:37.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ed59e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80d4004d90 0x7f80e814b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:37.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80edd9f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e814c230 0x7f80e80ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52176/0 (socket says 172.21.15.84:52176) 2023-08-31T02:00:37.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ecd9d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e81f1bf0 0x7f80e80b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:37.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80edd9f700 1 -- 172.21.15.84:0/245113670 learned_addr learned my addr 172.21.15.84:0/245113670 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:37.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80ed59e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80d4004d90 0x7f80e814b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.84:55820/0 (socket says 172.21.15.84:55820) 2023-08-31T02:00:37.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80edd9f700 1 -- 172.21.15.84:0/245113670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e81f1bf0 msgr2=0x7f80e80b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:37.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80edd9f700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e81f1bf0 0x7f80e80b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:37.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80edd9f700 1 -- 172.21.15.84:0/245113670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80d4004d90 msgr2=0x7f80e814b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:37.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80edd9f700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80d4004d90 0x7f80e814b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:37.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.829+0000 7f80edd9f700 1 -- 172.21.15.84:0/245113670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e81f2080 con 0x7f80e814c230 2023-08-31T02:00:37.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.830+0000 7f80edd9f700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e814c230 0x7f80e80ae890 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f80e0006040 tx=0x7f80e00011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:37.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.830+0000 7f80ddffb700 1 -- 172.21.15.84:0/245113670 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0015040 con 0x7f80e814c230 2023-08-31T02:00:37.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.830+0000 7f80ddffb700 1 -- 172.21.15.84:0/245113670 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f80e000ce70 con 0x7f80e814c230 2023-08-31T02:00:37.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.830+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e81f2360 con 0x7f80e814c230 2023-08-31T02:00:37.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.830+0000 7f80ddffb700 1 -- 172.21.15.84:0/245113670 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0006330 con 0x7f80e814c230 2023-08-31T02:00:37.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.830+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e81f2920 con 0x7f80e814c230 2023-08-31T02:00:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.831+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e814bba0 con 0x7f80e814c230 2023-08-31T02:00:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.831+0000 7f80ddffb700 1 -- 172.21.15.84:0/245113670 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80e0006490 con 0x7f80e814c230 2023-08-31T02:00:37.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.832+0000 7f80ddffb700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f80cc06a0e0 0x7f80cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:37.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.832+0000 7f80ddffb700 1 -- 172.21.15.84:0/245113670 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f80e0089b30 con 0x7f80e814c230 2023-08-31T02:00:37.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.832+0000 7f80ed59e700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f80cc06a0e0 0x7f80cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:37.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.832+0000 7f80ed59e700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f80cc06a0e0 0x7f80cc06c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009ce0 tx=0x7f80d8013040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:37.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:37.836+0000 7f80ddffb700 1 -- 172.21.15.84:0/245113670 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f80e0055160 con 0x7f80e814c230 2023-08-31T02:00:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.025+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80e8067120 con 0x7f80e814c230 2023-08-31T02:00:38.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.026+0000 7f80ddffb700 1 -- 172.21.15.84:0/245113670 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f80e0029090 con 0x7f80e814c230 2023-08-31T02:00:38.019 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:38.020 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:03.577162+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:38.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f80cc06a0e0 msgr2=0x7f80cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f80cc06a0e0 0x7f80cc06c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009ce0 tx=0x7f80d8013040 comp rx=0 tx=0).stop 2023-08-31T02:00:38.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e814c230 msgr2=0x7f80e80ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e814c230 0x7f80e80ae890 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f80e0006040 tx=0x7f80e00011c0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 shutdown_connections 2023-08-31T02:00:38.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f80cc06a0e0 0x7f80cc06c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e814c230 0x7f80e80ae890 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80d4004d90 0x7f80e814b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.028+0000 7f80ee5a0700 1 --2- 172.21.15.84:0/245113670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e81f1bf0 0x7f80e80b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.029+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 >> 172.21.15.84:0/245113670 conn(0x7f80e80ca820 msgr2=0x7f80e814cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:38.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.029+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 shutdown_connections 2023-08-31T02:00:38.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.029+0000 7f80ee5a0700 1 -- 172.21.15.84:0/245113670 wait complete. 2023-08-31T02:00:38.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:38.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:38.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.169+0000 7f2df9497700 1 -- 172.21.15.84:0/3358819221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 msgr2=0x7f2ddc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.169+0000 7f2df9497700 1 --2- 172.21.15.84:0/3358819221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 0x7f2ddc003e20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2de8001720 tx=0x7f2ddc005880 comp rx=0 tx=0).stop 2023-08-31T02:00:38.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.169+0000 7f2df9497700 1 -- 172.21.15.84:0/3358819221 shutdown_connections 2023-08-31T02:00:38.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.169+0000 7f2df9497700 1 --2- 172.21.15.84:0/3358819221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 0x7f2ddc003e20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.169+0000 7f2df9497700 1 -- 172.21.15.84:0/3358819221 >> 172.21.15.84:0/3358819221 conn(0x7f2df40afb00 msgr2=0x7f2df40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:38.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.169+0000 7f2df9497700 1 -- 172.21.15.84:0/3358819221 shutdown_connections 2023-08-31T02:00:38.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.169+0000 7f2df9497700 1 -- 172.21.15.84:0/3358819221 wait complete. 2023-08-31T02:00:38.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.170+0000 7f2df9497700 1 Processor -- start 2023-08-31T02:00:38.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.170+0000 7f2df9497700 1 -- start start 2023-08-31T02:00:38.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df9497700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 0x7f2df4152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df9497700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40b0bf0 0x7f2df40b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df9497700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df41e1c70 0x7f2df41e20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df9497700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40b15b0 con 0x7f2ddc003a00 2023-08-31T02:00:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df9497700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4152940 con 0x7f2df41e1c70 2023-08-31T02:00:38.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df9497700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df41e29e0 con 0x7f2df40b0bf0 2023-08-31T02:00:38.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 0x7f2df4152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 0x7f2df4152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52192/0 (socket says 172.21.15.84:52192) 2023-08-31T02:00:38.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df2ffd700 1 -- 172.21.15.84:0/2453416014 learned_addr learned my addr 172.21.15.84:0/2453416014 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:38.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df27fc700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40b0bf0 0x7f2df40b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df37fe700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df41e1c70 0x7f2df41e20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df2ffd700 1 -- 172.21.15.84:0/2453416014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40b0bf0 msgr2=0x7f2df40b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df2ffd700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40b0bf0 0x7f2df40b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df2ffd700 1 -- 172.21.15.84:0/2453416014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df41e1c70 msgr2=0x7f2df41e20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df2ffd700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df41e1c70 0x7f2df41e20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.171+0000 7f2df2ffd700 1 -- 172.21.15.84:0/2453416014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df41e2cc0 con 0x7f2ddc003a00 2023-08-31T02:00:38.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.172+0000 7f2df2ffd700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 0x7f2df4152400 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2de8001d10 tx=0x7f2de80038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:38.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.172+0000 7f2ddb7fe700 1 -- 172.21.15.84:0/2453416014 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8015070 con 0x7f2ddc003a00 2023-08-31T02:00:38.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.172+0000 7f2ddb7fe700 1 -- 172.21.15.84:0/2453416014 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2de8003ce0 con 0x7f2ddc003a00 2023-08-31T02:00:38.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.172+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df41e2fa0 con 0x7f2ddc003a00 2023-08-31T02:00:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.172+0000 7f2ddb7fe700 1 -- 172.21.15.84:0/2453416014 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8010480 con 0x7f2ddc003a00 2023-08-31T02:00:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.172+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df41e3560 con 0x7f2ddc003a00 2023-08-31T02:00:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.173+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4070450 con 0x7f2ddc003a00 2023-08-31T02:00:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.173+0000 7f2ddb7fe700 1 -- 172.21.15.84:0/2453416014 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2de80105e0 con 0x7f2ddc003a00 2023-08-31T02:00:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.174+0000 7f2ddb7fe700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2de006a0e0 0x7f2de006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.174+0000 7f2df27fc700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2de006a0e0 0x7f2de006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.174+0000 7f2ddb7fe700 1 -- 172.21.15.84:0/2453416014 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2de80897e0 con 0x7f2ddc003a00 2023-08-31T02:00:38.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.174+0000 7f2df27fc700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2de006a0e0 0x7f2de006c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2df40c1d10 tx=0x7f2de400b360 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.178+0000 7f2ddb7fe700 1 -- 172.21.15.84:0/2453416014 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2de8054d60 con 0x7f2ddc003a00 2023-08-31T02:00:38.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.367+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2df40ad7e0 con 0x7f2ddc003a00 2023-08-31T02:00:38.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.367+0000 7f2ddb7fe700 1 -- 172.21.15.84:0/2453416014 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2de802b2a0 con 0x7f2ddc003a00 2023-08-31T02:00:38.360 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:38.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2de006a0e0 msgr2=0x7f2de006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2de006a0e0 0x7f2de006c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2df40c1d10 tx=0x7f2de400b360 comp rx=0 tx=0).stop 2023-08-31T02:00:38.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 msgr2=0x7f2df4152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 0x7f2df4152400 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2de8001d10 tx=0x7f2de80038b0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 shutdown_connections 2023-08-31T02:00:38.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2de006a0e0 0x7f2de006c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df41e1c70 0x7f2df41e20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ddc003a00 0x7f2df4152400 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 --2- 172.21.15.84:0/2453416014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40b0bf0 0x7f2df40b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 >> 172.21.15.84:0/2453416014 conn(0x7f2df40afb00 msgr2=0x7f2df40c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:38.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 shutdown_connections 2023-08-31T02:00:38.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.369+0000 7f2df9497700 1 -- 172.21.15.84:0/2453416014 wait complete. 2023-08-31T02:00:38.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:38.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.506+0000 7ff45ff5b700 1 -- 172.21.15.84:0/796536791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580ca2d0 msgr2=0x7ff45806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.506+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/796536791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580ca2d0 0x7ff45806c720 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff4580b0760 tx=0x7ff454009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:38.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.506+0000 7ff45ff5b700 1 -- 172.21.15.84:0/796536791 shutdown_connections 2023-08-31T02:00:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.506+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/796536791 >> v2:172.21.15.170:3300/0 conn(0x7ff45815bce0 0x7ff4580cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.506+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/796536791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4580ca2d0 0x7ff45806c720 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.506+0000 7ff45ff5b700 1 -- 172.21.15.84:0/796536791 >> 172.21.15.84:0/796536791 conn(0x7ff4580afb00 msgr2=0x7ff4580aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.506+0000 7ff45ff5b700 1 -- 172.21.15.84:0/796536791 shutdown_connections 2023-08-31T02:00:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.506+0000 7ff45ff5b700 1 -- 172.21.15.84:0/796536791 wait complete. 2023-08-31T02:00:38.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.507+0000 7ff45ff5b700 1 Processor -- start 2023-08-31T02:00:38.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.507+0000 7ff45ff5b700 1 -- start start 2023-08-31T02:00:38.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45ff5b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4580ca2d0 0x7ff45814a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45ff5b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff45815b790 0x7ff4580b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45ff5b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff45815bce0 0x7ff4581e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45ff5b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580b1b30 con 0x7ff45815bce0 2023-08-31T02:00:38.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45ff5b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580b1e10 con 0x7ff4580ca2d0 2023-08-31T02:00:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45ff5b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580b20f0 con 0x7ff45815b790 2023-08-31T02:00:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff45815bce0 0x7ff4581e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff45815bce0 0x7ff4581e40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52210/0 (socket says 172.21.15.84:52210) 2023-08-31T02:00:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 -- 172.21.15.84:0/198732860 learned_addr learned my addr 172.21.15.84:0/198732860 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45dcf7700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4580ca2d0 0x7ff45814a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45d4f6700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff45815b790 0x7ff4580b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 -- 172.21.15.84:0/198732860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff45815b790 msgr2=0x7ff4580b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff45815b790 0x7ff4580b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 -- 172.21.15.84:0/198732860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4580ca2d0 msgr2=0x7ff45814a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4580ca2d0 0x7ff45814a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 -- 172.21.15.84:0/198732860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540095f0 con 0x7ff45815bce0 2023-08-31T02:00:38.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45e4f8700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff45815bce0 0x7ff4581e40f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff45000efc0 tx=0x7ff45000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:38.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff44a7fc700 1 -- 172.21.15.84:0/198732860 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450018070 con 0x7ff45815bce0 2023-08-31T02:00:38.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff44a7fc700 1 -- 172.21.15.84:0/198732860 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff45000f040 con 0x7ff45815bce0 2023-08-31T02:00:38.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4580b23d0 con 0x7ff45815bce0 2023-08-31T02:00:38.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff44a7fc700 1 -- 172.21.15.84:0/198732860 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450004bb0 con 0x7ff45815bce0 2023-08-31T02:00:38.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.508+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4580b2bd0 con 0x7ff45815bce0 2023-08-31T02:00:38.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.509+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4580b28f0 con 0x7ff45815bce0 2023-08-31T02:00:38.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.510+0000 7ff44a7fc700 1 -- 172.21.15.84:0/198732860 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff450004d10 con 0x7ff45815bce0 2023-08-31T02:00:38.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.510+0000 7ff44a7fc700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff43c06a0e0 0x7ff43c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.510+0000 7ff44a7fc700 1 -- 172.21.15.84:0/198732860 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff450088570 con 0x7ff45815bce0 2023-08-31T02:00:38.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.510+0000 7ff45dcf7700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff43c06a0e0 0x7ff43c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.511+0000 7ff45dcf7700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff43c06a0e0 0x7ff43c06c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff4580ade30 tx=0x7ff44c009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.515+0000 7ff44a7fc700 1 -- 172.21.15.84:0/198732860 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff4580b28f0 con 0x7ff45815bce0 2023-08-31T02:00:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.702+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4580b28f0 con 0x7ff45815bce0 2023-08-31T02:00:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.702+0000 7ff44a7fc700 1 -- 172.21.15.84:0/198732860 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4580b28f0 con 0x7ff45815bce0 2023-08-31T02:00:38.695 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff43c06a0e0 msgr2=0x7ff43c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff43c06a0e0 0x7ff43c06c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff4580ade30 tx=0x7ff44c009040 comp rx=0 tx=0).stop 2023-08-31T02:00:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff45815bce0 msgr2=0x7ff4581e40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff45815bce0 0x7ff4581e40f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff45000efc0 tx=0x7ff45000c3a0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 shutdown_connections 2023-08-31T02:00:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff43c06a0e0 0x7ff43c06c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff45815bce0 0x7ff4581e40f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4580ca2d0 0x7ff45814a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 --2- 172.21.15.84:0/198732860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff45815b790 0x7ff4580b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 >> 172.21.15.84:0/198732860 conn(0x7ff4580afb00 msgr2=0x7ff45815a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 shutdown_connections 2023-08-31T02:00:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.705+0000 7ff45ff5b700 1 -- 172.21.15.84:0/198732860 wait complete. 2023-08-31T02:00:38.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:38.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.842+0000 7f2f537ec700 1 -- 172.21.15.84:0/1448025634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c0ca2d0 msgr2=0x7f2f4c0cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.842+0000 7f2f537ec700 1 --2- 172.21.15.84:0/1448025634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c0ca2d0 0x7f2f4c0cbad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0661a0 tx=0x7f2f4400b380 comp rx=0 tx=0).stop 2023-08-31T02:00:38.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.842+0000 7f2f537ec700 1 -- 172.21.15.84:0/1448025634 shutdown_connections 2023-08-31T02:00:38.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.842+0000 7f2f537ec700 1 --2- 172.21.15.84:0/1448025634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c0ca2d0 0x7f2f4c0cbad0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.842+0000 7f2f537ec700 1 --2- 172.21.15.84:0/1448025634 >> v2:172.21.15.170:3300/0 conn(0x7f2f4c15b790 0x7f2f4c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.842+0000 7f2f537ec700 1 -- 172.21.15.84:0/1448025634 >> 172.21.15.84:0/1448025634 conn(0x7f2f4c0afb00 msgr2=0x7f2f4c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:38.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.842+0000 7f2f537ec700 1 -- 172.21.15.84:0/1448025634 shutdown_connections 2023-08-31T02:00:38.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.842+0000 7f2f537ec700 1 -- 172.21.15.84:0/1448025634 wait complete. 2023-08-31T02:00:38.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.843+0000 7f2f537ec700 1 Processor -- start 2023-08-31T02:00:38.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.843+0000 7f2f537ec700 1 -- start start 2023-08-31T02:00:38.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f537ec700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f4c0ca2d0 0x7f2f4c14b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f537ec700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f4c15b790 0x7f2f4c06a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f537ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c15bce0 0x7f2f4c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f537ec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c14b8b0 con 0x7f2f4c15bce0 2023-08-31T02:00:38.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f537ec700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1ef600 con 0x7f2f4c0ca2d0 2023-08-31T02:00:38.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f537ec700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b0bc0 con 0x7f2f4c15b790 2023-08-31T02:00:38.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c15bce0 0x7f2f4c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c15bce0 0x7f2f4c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52224/0 (socket says 172.21.15.84:52224) 2023-08-31T02:00:38.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 -- 172.21.15.84:0/2558952969 learned_addr learned my addr 172.21.15.84:0/2558952969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:38.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51588700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f4c0ca2d0 0x7f2f4c14b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f50d87700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f4c15b790 0x7f2f4c06a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 -- 172.21.15.84:0/2558952969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f4c15b790 msgr2=0x7f2f4c06a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f4c15b790 0x7f2f4c06a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 -- 172.21.15.84:0/2558952969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f4c0ca2d0 msgr2=0x7f2f4c14b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:38.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f4c0ca2d0 0x7f2f4c14b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:38.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 -- 172.21.15.84:0/2558952969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44009d00 con 0x7f2f4c15bce0 2023-08-31T02:00:38.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.844+0000 7f2f51d89700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c15bce0 0x7f2f4c06a770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2f44004000 tx=0x7f2f44003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:38.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.845+0000 7f2f41ffb700 1 -- 172.21.15.84:0/2558952969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400e070 con 0x7f2f4c15bce0 2023-08-31T02:00:38.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.845+0000 7f2f41ffb700 1 -- 172.21.15.84:0/2558952969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f440079d0 con 0x7f2f4c15bce0 2023-08-31T02:00:38.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.845+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c0b0ea0 con 0x7f2f4c15bce0 2023-08-31T02:00:38.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.845+0000 7f2f41ffb700 1 -- 172.21.15.84:0/2558952969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44007de0 con 0x7f2f4c15bce0 2023-08-31T02:00:38.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.845+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c0ae920 con 0x7f2f4c15bce0 2023-08-31T02:00:38.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.846+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c04e7c0 con 0x7f2f4c15bce0 2023-08-31T02:00:38.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.846+0000 7f2f41ffb700 1 -- 172.21.15.84:0/2558952969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f44019040 con 0x7f2f4c15bce0 2023-08-31T02:00:38.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.847+0000 7f2f41ffb700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f3006a0e0 0x7f2f3006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:38.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.847+0000 7f2f41ffb700 1 -- 172.21.15.84:0/2558952969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f44089960 con 0x7f2f4c15bce0 2023-08-31T02:00:38.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.847+0000 7f2f51588700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f3006a0e0 0x7f2f3006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:38.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.847+0000 7f2f51588700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f3006a0e0 0x7f2f3006c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c005950 tx=0x7f2f3c00b410 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:38.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:38.851+0000 7f2f41ffb700 1 -- 172.21.15.84:0/2558952969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2f44054ee0 con 0x7f2f4c15bce0 2023-08-31T02:00:39.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.040+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f4c06dea0 con 0x7f2f4c15bce0 2023-08-31T02:00:39.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.041+0000 7f2f41ffb700 1 -- 172.21.15.84:0/2558952969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f44058500 con 0x7f2f4c15bce0 2023-08-31T02:00:39.034 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:39.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f3006a0e0 msgr2=0x7f2f3006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f3006a0e0 0x7f2f3006c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c005950 tx=0x7f2f3c00b410 comp rx=0 tx=0).stop 2023-08-31T02:00:39.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c15bce0 msgr2=0x7f2f4c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c15bce0 0x7f2f4c06a770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2f44004000 tx=0x7f2f44003f70 comp rx=0 tx=0).stop 2023-08-31T02:00:39.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 shutdown_connections 2023-08-31T02:00:39.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2f3006a0e0 0x7f2f3006c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c15bce0 0x7f2f4c06a770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f4c0ca2d0 0x7f2f4c14b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 --2- 172.21.15.84:0/2558952969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f4c15b790 0x7f2f4c06a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 >> 172.21.15.84:0/2558952969 conn(0x7f2f4c0afb00 msgr2=0x7f2f4c15a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:39.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 shutdown_connections 2023-08-31T02:00:39.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.043+0000 7f2f537ec700 1 -- 172.21.15.84:0/2558952969 wait complete. 2023-08-31T02:00:39.047 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.183+0000 7efeb9250700 1 -- 172.21.15.84:0/2078059465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 msgr2=0x7efeb40cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.183+0000 7efeb9250700 1 --2- 172.21.15.84:0/2078059465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 0x7efeb40cbad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efeb40661a0 tx=0x7efeac00b380 comp rx=0 tx=0).stop 2023-08-31T02:00:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.183+0000 7efeb9250700 1 -- 172.21.15.84:0/2078059465 shutdown_connections 2023-08-31T02:00:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.183+0000 7efeb9250700 1 --2- 172.21.15.84:0/2078059465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 0x7efeb40cbad0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.183+0000 7efeb9250700 1 --2- 172.21.15.84:0/2078059465 >> v2:172.21.15.170:3300/0 conn(0x7efeb415b790 0x7efeb406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.183+0000 7efeb9250700 1 -- 172.21.15.84:0/2078059465 >> 172.21.15.84:0/2078059465 conn(0x7efeb40afb00 msgr2=0x7efeb40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.183+0000 7efeb9250700 1 -- 172.21.15.84:0/2078059465 shutdown_connections 2023-08-31T02:00:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.183+0000 7efeb9250700 1 -- 172.21.15.84:0/2078059465 wait complete. 2023-08-31T02:00:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb9250700 1 Processor -- start 2023-08-31T02:00:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb9250700 1 -- start start 2023-08-31T02:00:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb9250700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 0x7efeb41494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb9250700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeb415b790 0x7efeb41e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb9250700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efeb415bce0 0x7efeb40b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb9250700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41e3d30 con 0x7efeb40ca2d0 2023-08-31T02:00:39.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb9250700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41e4010 con 0x7efeb415b790 2023-08-31T02:00:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb9250700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41e42f0 con 0x7efeb415bce0 2023-08-31T02:00:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 0x7efeb41494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 0x7efeb41494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52236/0 (socket says 172.21.15.84:52236) 2023-08-31T02:00:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.185+0000 7efeb2d9d700 1 -- 172.21.15.84:0/1606228959 learned_addr learned my addr 172.21.15.84:0/1606228959 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb259c700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeb415b790 0x7efeb41e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb359e700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efeb415bce0 0x7efeb40b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb2d9d700 1 -- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efeb415bce0 msgr2=0x7efeb40b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb2d9d700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efeb415bce0 0x7efeb40b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb2d9d700 1 -- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeb415b790 msgr2=0x7efeb41e3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb2d9d700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeb415b790 0x7efeb41e3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb2d9d700 1 -- 172.21.15.84:0/1606228959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac009d00 con 0x7efeb40ca2d0 2023-08-31T02:00:39.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb359e700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efeb415bce0 0x7efeb40b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb2d9d700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 0x7efeb41494e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efea800d950 tx=0x7efea800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efe9b7fe700 1 -- 172.21.15.84:0/1606228959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8009940 con 0x7efeb40ca2d0 2023-08-31T02:00:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efe9b7fe700 1 -- 172.21.15.84:0/1606228959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efea8009b90 con 0x7efeb40ca2d0 2023-08-31T02:00:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb41e45d0 con 0x7efeb40ca2d0 2023-08-31T02:00:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efe9b7fe700 1 -- 172.21.15.84:0/1606228959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8010460 con 0x7efeb40ca2d0 2023-08-31T02:00:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.186+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb41e3960 con 0x7efeb40ca2d0 2023-08-31T02:00:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.187+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb404e7c0 con 0x7efeb40ca2d0 2023-08-31T02:00:39.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.188+0000 7efe9b7fe700 1 -- 172.21.15.84:0/1606228959 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efea80105c0 con 0x7efeb40ca2d0 2023-08-31T02:00:39.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.188+0000 7efe9b7fe700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efea006a0e0 0x7efea006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.188+0000 7efe9b7fe700 1 -- 172.21.15.84:0/1606228959 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efea8088ce0 con 0x7efeb40ca2d0 2023-08-31T02:00:39.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.188+0000 7efeb259c700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efea006a0e0 0x7efea006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.188+0000 7efeb259c700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efea006a0e0 0x7efea006c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efeb40c7e70 tx=0x7efea40090e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:39.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.192+0000 7efe9b7fe700 1 -- 172.21.15.84:0/1606228959 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efea80541e0 con 0x7efeb40ca2d0 2023-08-31T02:00:39.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.391+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efeb41e3af0 con 0x7efeb40ca2d0 2023-08-31T02:00:39.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.391+0000 7efe9b7fe700 1 -- 172.21.15.84:0/1606228959 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7efeb41e3af0 con 0x7efeb40ca2d0 2023-08-31T02:00:39.385 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:39.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efea006a0e0 msgr2=0x7efea006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efea006a0e0 0x7efea006c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efeb40c7e70 tx=0x7efea40090e0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 msgr2=0x7efeb41494e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 0x7efeb41494e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efea800d950 tx=0x7efea800dc60 comp rx=0 tx=0).stop 2023-08-31T02:00:39.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 shutdown_connections 2023-08-31T02:00:39.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efea006a0e0 0x7efea006c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efeb415bce0 0x7efeb40b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb40ca2d0 0x7efeb41494e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 --2- 172.21.15.84:0/1606228959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeb415b790 0x7efeb41e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 >> 172.21.15.84:0/1606228959 conn(0x7efeb40afb00 msgr2=0x7efeb40c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:39.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 shutdown_connections 2023-08-31T02:00:39.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.394+0000 7efeb9250700 1 -- 172.21.15.84:0/1606228959 wait complete. 2023-08-31T02:00:39.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:39.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.528+0000 7f88373f2700 1 -- 172.21.15.84:0/1841750714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300707c0 msgr2=0x7f8830070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.528+0000 7f88373f2700 1 --2- 172.21.15.84:0/1841750714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300707c0 0x7f8830070ba0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f88300c5000 tx=0x7f882800b330 comp rx=0 tx=0).stop 2023-08-31T02:00:39.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.528+0000 7f88373f2700 1 -- 172.21.15.84:0/1841750714 shutdown_connections 2023-08-31T02:00:39.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.528+0000 7f88373f2700 1 --2- 172.21.15.84:0/1841750714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300707c0 0x7f8830070ba0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.528+0000 7f88373f2700 1 --2- 172.21.15.84:0/1841750714 >> v2:172.21.15.170:3300/0 conn(0x7f88300cc920 0x7f88300c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.529+0000 7f88373f2700 1 -- 172.21.15.84:0/1841750714 >> 172.21.15.84:0/1841750714 conn(0x7f88300caa20 msgr2=0x7f88300cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:39.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.529+0000 7f88373f2700 1 -- 172.21.15.84:0/1841750714 shutdown_connections 2023-08-31T02:00:39.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.529+0000 7f88373f2700 1 -- 172.21.15.84:0/1841750714 wait complete. 2023-08-31T02:00:39.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.530+0000 7f88373f2700 1 Processor -- start 2023-08-31T02:00:39.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.530+0000 7f88373f2700 1 -- start start 2023-08-31T02:00:39.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f88373f2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88300707c0 0x7f88301e44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f88373f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300cc920 0x7f88300c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f88373f2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8830158220 0x7f88301e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f88373f2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88301e4060 con 0x7f88300cc920 2023-08-31T02:00:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f88373f2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88301e3450 con 0x7f88300707c0 2023-08-31T02:00:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f88373f2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88301e3730 con 0x7f8830158220 2023-08-31T02:00:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300cc920 0x7f88300c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300cc920 0x7f88300c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52250/0 (socket says 172.21.15.84:52250) 2023-08-31T02:00:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 -- 172.21.15.84:0/308575910 learned_addr learned my addr 172.21.15.84:0/308575910 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883598f700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8830158220 0x7f88301e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883518e700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88300707c0 0x7f88301e44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 -- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8830158220 msgr2=0x7f88301e2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8830158220 0x7f88301e2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 -- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88300707c0 msgr2=0x7f88301e44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88300707c0 0x7f88301e44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 -- 172.21.15.84:0/308575910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8828009c40 con 0x7f88300cc920 2023-08-31T02:00:39.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883518e700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88300707c0 0x7f88301e44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:39.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883598f700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8830158220 0x7f88301e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f883498d700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300cc920 0x7f88300c4780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f882c00d950 tx=0x7f882c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f8825ffb700 1 -- 172.21.15.84:0/308575910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c009b40 con 0x7f88300cc920 2023-08-31T02:00:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f8825ffb700 1 -- 172.21.15.84:0/308575910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f882c009d90 con 0x7f88300cc920 2023-08-31T02:00:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88301e3a10 con 0x7f88300cc920 2023-08-31T02:00:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.531+0000 7f8825ffb700 1 -- 172.21.15.84:0/308575910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0106c0 con 0x7f88300cc920 2023-08-31T02:00:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.532+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88301e4a30 con 0x7f88300cc920 2023-08-31T02:00:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.533+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883004e7c0 con 0x7f88300cc920 2023-08-31T02:00:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.533+0000 7f8825ffb700 1 -- 172.21.15.84:0/308575910 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f882c010820 con 0x7f88300cc920 2023-08-31T02:00:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.533+0000 7f8825ffb700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f881406a0e0 0x7f881406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.534+0000 7f883518e700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f881406a0e0 0x7f881406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.534+0000 7f8825ffb700 1 -- 172.21.15.84:0/308575910 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f882c088f10 con 0x7f88300cc920 2023-08-31T02:00:39.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.534+0000 7f883518e700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f881406a0e0 0x7f881406c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8820000f60 tx=0x7f8820009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:39.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.538+0000 7f8825ffb700 1 -- 172.21.15.84:0/308575910 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f882c0542e0 con 0x7f88300cc920 2023-08-31T02:00:39.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.730+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88300cd350 con 0x7f88300cc920 2023-08-31T02:00:39.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.731+0000 7f8825ffb700 1 -- 172.21.15.84:0/308575910 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f882c0869c0 con 0x7f88300cc920 2023-08-31T02:00:39.724 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:39.725 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:39.289278+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f881406a0e0 msgr2=0x7f881406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f881406a0e0 0x7f881406c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8820000f60 tx=0x7f8820009040 comp rx=0 tx=0).stop 2023-08-31T02:00:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300cc920 msgr2=0x7f88300c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300cc920 0x7f88300c4780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f882c00d950 tx=0x7f882c00dd10 comp rx=0 tx=0).stop 2023-08-31T02:00:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 shutdown_connections 2023-08-31T02:00:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f881406a0e0 0x7f881406c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8830158220 0x7f88301e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88300707c0 0x7f88301e44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.733+0000 7f88373f2700 1 --2- 172.21.15.84:0/308575910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88300cc920 0x7f88300c4780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.734+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 >> 172.21.15.84:0/308575910 conn(0x7f88300caa20 msgr2=0x7f883015a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.734+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 shutdown_connections 2023-08-31T02:00:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.734+0000 7f88373f2700 1 -- 172.21.15.84:0/308575910 wait complete. 2023-08-31T02:00:39.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:39.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.871+0000 7f1615162700 1 -- 172.21.15.84:0/2863038036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 msgr2=0x7f16100b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.871+0000 7f1615162700 1 --2- 172.21.15.84:0/2863038036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 0x7f16100b1c30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f161006f4f0 tx=0x7f1600009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.871+0000 7f1615162700 1 -- 172.21.15.84:0/2863038036 shutdown_connections 2023-08-31T02:00:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.871+0000 7f1615162700 1 --2- 172.21.15.84:0/2863038036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f161015bbb0 0x7f161015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.871+0000 7f1615162700 1 --2- 172.21.15.84:0/2863038036 >> v2:172.21.15.170:3300/0 conn(0x7f161014efe0 0x7f16100c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.871+0000 7f1615162700 1 --2- 172.21.15.84:0/2863038036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 0x7f16100b1c30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.871+0000 7f1615162700 1 -- 172.21.15.84:0/2863038036 >> 172.21.15.84:0/2863038036 conn(0x7f16100caa00 msgr2=0x7f16100cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:39.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.871+0000 7f1615162700 1 -- 172.21.15.84:0/2863038036 shutdown_connections 2023-08-31T02:00:39.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.872+0000 7f1615162700 1 -- 172.21.15.84:0/2863038036 wait complete. 2023-08-31T02:00:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.873+0000 7f1615162700 1 Processor -- start 2023-08-31T02:00:39.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.873+0000 7f1615162700 1 -- start start 2023-08-31T02:00:39.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f1615162700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 0x7f1610159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f1615162700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f161014efe0 0x7f1610154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f1615162700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f161015bbb0 0x7f16101538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f1615162700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161014ff80 con 0x7f16100b17a0 2023-08-31T02:00:39.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f1615162700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1610154340 con 0x7f161014efe0 2023-08-31T02:00:39.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f1615162700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161014f650 con 0x7f161015bbb0 2023-08-31T02:00:39.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 0x7f1610159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 0x7f1610159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52262/0 (socket says 172.21.15.84:52262) 2023-08-31T02:00:39.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 -- 172.21.15.84:0/3443645866 learned_addr learned my addr 172.21.15.84:0/3443645866 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160e59c700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f161014efe0 0x7f1610154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160f59e700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f161015bbb0 0x7f16101538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 -- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f161015bbb0 msgr2=0x7f16101538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f161015bbb0 0x7f16101538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 -- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f161014efe0 msgr2=0x7f1610154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f161014efe0 0x7f1610154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 -- 172.21.15.84:0/3443645866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000095f0 con 0x7f16100b17a0 2023-08-31T02:00:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160e59c700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f161014efe0 0x7f1610154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f160ed9d700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 0x7f1610159500 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f160400d980 tx=0x7f160400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f15f77fe700 1 -- 172.21.15.84:0/3443645866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604009b40 con 0x7f16100b17a0 2023-08-31T02:00:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f15f77fe700 1 -- 172.21.15.84:0/3443645866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1604009d90 con 0x7f16100b17a0 2023-08-31T02:00:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.874+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161014f930 con 0x7f16100b17a0 2023-08-31T02:00:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.875+0000 7f15f77fe700 1 -- 172.21.15.84:0/3443645866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16040106c0 con 0x7f16100b17a0 2023-08-31T02:00:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.875+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1610159a40 con 0x7f16100b17a0 2023-08-31T02:00:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.875+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161004e7c0 con 0x7f16100b17a0 2023-08-31T02:00:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.876+0000 7f15f77fe700 1 -- 172.21.15.84:0/3443645866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1604010820 con 0x7f16100b17a0 2023-08-31T02:00:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.876+0000 7f15f77fe700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f15fc06a0e0 0x7f15fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.876+0000 7f15f77fe700 1 -- 172.21.15.84:0/3443645866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1604088b10 con 0x7f16100b17a0 2023-08-31T02:00:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.876+0000 7f160e59c700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f15fc06a0e0 0x7f15fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.877+0000 7f160e59c700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f15fc06a0e0 0x7f15fc06c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f16000098e0 tx=0x7f16000047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:39.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:39.881+0000 7f15f77fe700 1 -- 172.21.15.84:0/3443645866 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1604053ee0 con 0x7f16100b17a0 2023-08-31T02:00:40.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.075+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f161014f4a0 con 0x7f16100b17a0 2023-08-31T02:00:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.075+0000 7f15f77fe700 1 -- 172.21.15.84:0/3443645866 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16040200a0 con 0x7f16100b17a0 2023-08-31T02:00:40.068 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f15fc06a0e0 msgr2=0x7f15fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f15fc06a0e0 0x7f15fc06c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f16000098e0 tx=0x7f16000047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 msgr2=0x7f1610159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 0x7f1610159500 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f160400d980 tx=0x7f160400dd40 comp rx=0 tx=0).stop 2023-08-31T02:00:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 shutdown_connections 2023-08-31T02:00:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f15fc06a0e0 0x7f15fc06c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f161015bbb0 0x7f16101538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16100b17a0 0x7f1610159500 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 --2- 172.21.15.84:0/3443645866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f161014efe0 0x7f1610154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 >> 172.21.15.84:0/3443645866 conn(0x7f16100caa00 msgr2=0x7f16100c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 shutdown_connections 2023-08-31T02:00:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.077+0000 7f1615162700 1 -- 172.21.15.84:0/3443645866 wait complete. 2023-08-31T02:00:40.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:40.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.214+0000 7f2efabb4700 1 -- 172.21.15.84:0/3522333332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef415d750 msgr2=0x7f2ef40ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.214+0000 7f2efabb4700 1 --2- 172.21.15.84:0/3522333332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef415d750 0x7f2ef40ccce0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40b1cc0 tx=0x7f2ee0009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.214+0000 7f2efabb4700 1 -- 172.21.15.84:0/3522333332 shutdown_connections 2023-08-31T02:00:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.214+0000 7f2efabb4700 1 --2- 172.21.15.84:0/3522333332 >> v2:172.21.15.170:3300/0 conn(0x7f2ef4159320 0x7f2ef40b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.214+0000 7f2efabb4700 1 --2- 172.21.15.84:0/3522333332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef415d750 0x7f2ef40ccce0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.214+0000 7f2efabb4700 1 -- 172.21.15.84:0/3522333332 >> 172.21.15.84:0/3522333332 conn(0x7f2ef40b0c40 msgr2=0x7f2ef40b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.214+0000 7f2efabb4700 1 -- 172.21.15.84:0/3522333332 shutdown_connections 2023-08-31T02:00:40.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.214+0000 7f2efabb4700 1 -- 172.21.15.84:0/3522333332 wait complete. 2023-08-31T02:00:40.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.215+0000 7f2efabb4700 1 Processor -- start 2023-08-31T02:00:40.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.215+0000 7f2efabb4700 1 -- start start 2023-08-31T02:00:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2efabb4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef40cd220 0x7f2ef4157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2efabb4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4159320 0x7f2ef40c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2efabb4700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ef415d750 0x7f2ef415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2efabb4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef415b1c0 con 0x7f2ef40cd220 2023-08-31T02:00:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2efabb4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef415a330 con 0x7f2ef4159320 2023-08-31T02:00:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2efabb4700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4158a40 con 0x7f2ef415d750 2023-08-31T02:00:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2ef8950700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef40cd220 0x7f2ef4157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2ef8950700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef40cd220 0x7f2ef4157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52274/0 (socket says 172.21.15.84:52274) 2023-08-31T02:00:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2ef8950700 1 -- 172.21.15.84:0/2537775182 learned_addr learned my addr 172.21.15.84:0/2537775182 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2ef3fff700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4159320 0x7f2ef40c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.216+0000 7f2ef9151700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ef415d750 0x7f2ef415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef8950700 1 -- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ef415d750 msgr2=0x7f2ef415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef8950700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ef415d750 0x7f2ef415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef8950700 1 -- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4159320 msgr2=0x7f2ef40c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef8950700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4159320 0x7f2ef40c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef8950700 1 -- 172.21.15.84:0/2537775182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00095f0 con 0x7f2ef40cd220 2023-08-31T02:00:40.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef9151700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ef415d750 0x7f2ef415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:40.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef8950700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef40cd220 0x7f2ef4157a50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800d980 tx=0x7f2ee800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:40.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef17fa700 1 -- 172.21.15.84:0/2537775182 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8009b40 con 0x7f2ef40cd220 2023-08-31T02:00:40.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef17fa700 1 -- 172.21.15.84:0/2537775182 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2ee8009d90 con 0x7f2ef40cd220 2023-08-31T02:00:40.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2ef17fa700 1 -- 172.21.15.84:0/2537775182 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80106c0 con 0x7f2ef40cd220 2023-08-31T02:00:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef415a540 con 0x7f2ef40cd220 2023-08-31T02:00:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.217+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef415ab00 con 0x7f2ef40cd220 2023-08-31T02:00:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.218+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef4066880 con 0x7f2ef40cd220 2023-08-31T02:00:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.218+0000 7f2ef17fa700 1 -- 172.21.15.84:0/2537775182 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ee8010820 con 0x7f2ef40cd220 2023-08-31T02:00:40.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.219+0000 7f2ef17fa700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ed806a0e0 0x7f2ed806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.219+0000 7f2ef17fa700 1 -- 172.21.15.84:0/2537775182 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2ee8088f00 con 0x7f2ef40cd220 2023-08-31T02:00:40.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.219+0000 7f2ef3fff700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ed806a0e0 0x7f2ed806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.219+0000 7f2ef3fff700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ed806a0e0 0x7f2ed806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00098e0 tx=0x7f2ee0019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:40.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.223+0000 7f2ef17fa700 1 -- 172.21.15.84:0/2537775182 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2ee8054240 con 0x7f2ef40cd220 2023-08-31T02:00:40.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.420+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ef404e7c0 con 0x7f2ef40cd220 2023-08-31T02:00:40.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.421+0000 7f2ef17fa700 1 -- 172.21.15.84:0/2537775182 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ee8057860 con 0x7f2ef40cd220 2023-08-31T02:00:40.414 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:40.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.422+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ed806a0e0 msgr2=0x7f2ed806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.422+0000 7f2efabb4700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ed806a0e0 0x7f2ed806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00098e0 tx=0x7f2ee0019040 comp rx=0 tx=0).stop 2023-08-31T02:00:40.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.422+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef40cd220 msgr2=0x7f2ef4157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.422+0000 7f2efabb4700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef40cd220 0x7f2ef4157a50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800d980 tx=0x7f2ee800dc90 comp rx=0 tx=0).stop 2023-08-31T02:00:40.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.423+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 shutdown_connections 2023-08-31T02:00:40.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.423+0000 7f2efabb4700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ed806a0e0 0x7f2ed806c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.423+0000 7f2efabb4700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ef415d750 0x7f2ef415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.423+0000 7f2efabb4700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ef40cd220 0x7f2ef4157a50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.423+0000 7f2efabb4700 1 --2- 172.21.15.84:0/2537775182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4159320 0x7f2ef40c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.423+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 >> 172.21.15.84:0/2537775182 conn(0x7f2ef40b0c40 msgr2=0x7f2ef40b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:40.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.423+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 shutdown_connections 2023-08-31T02:00:40.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.423+0000 7f2efabb4700 1 -- 172.21.15.84:0/2537775182 wait complete. 2023-08-31T02:00:40.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.560+0000 7f55fe6c7700 1 -- 172.21.15.84:0/3256315225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f80ca2d0 msgr2=0x7f55f806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.560+0000 7f55fe6c7700 1 --2- 172.21.15.84:0/3256315225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f80ca2d0 0x7f55f806c720 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f55e80098c0 tx=0x7f55e8009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.560+0000 7f55fe6c7700 1 -- 172.21.15.84:0/3256315225 shutdown_connections 2023-08-31T02:00:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.560+0000 7f55fe6c7700 1 --2- 172.21.15.84:0/3256315225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f80ca2d0 0x7f55f806c720 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.560+0000 7f55fe6c7700 1 -- 172.21.15.84:0/3256315225 >> 172.21.15.84:0/3256315225 conn(0x7f55f80afb00 msgr2=0x7f55f80aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.560+0000 7f55fe6c7700 1 -- 172.21.15.84:0/3256315225 shutdown_connections 2023-08-31T02:00:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.560+0000 7f55fe6c7700 1 -- 172.21.15.84:0/3256315225 wait complete. 2023-08-31T02:00:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.561+0000 7f55fe6c7700 1 Processor -- start 2023-08-31T02:00:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.561+0000 7f55fe6c7700 1 -- start start 2023-08-31T02:00:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fe6c7700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55f80ca2d0 0x7f55f814bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fe6c7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55f815b790 0x7f55f814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fe6c7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f815bce0 0x7f55f80c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fe6c7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81e2450 con 0x7f55f815bce0 2023-08-31T02:00:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fe6c7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81e3690 con 0x7f55f815b790 2023-08-31T02:00:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fe6c7700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81e3970 con 0x7f55f80ca2d0 2023-08-31T02:00:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f815bce0 0x7f55f80c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f815bce0 0x7f55f80c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52290/0 (socket says 172.21.15.84:52290) 2023-08-31T02:00:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 -- 172.21.15.84:0/378478129 learned_addr learned my addr 172.21.15.84:0/378478129 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55f77fe700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55f815b790 0x7f55f814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55f7fff700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55f80ca2d0 0x7f55f814bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 -- 172.21.15.84:0/378478129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55f80ca2d0 msgr2=0x7f55f814bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55f80ca2d0 0x7f55f814bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 -- 172.21.15.84:0/378478129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55f815b790 msgr2=0x7f55f814eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55f815b790 0x7f55f814eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 -- 172.21.15.84:0/378478129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8009520 con 0x7f55f815bce0 2023-08-31T02:00:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fcc64700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f815bce0 0x7f55f80c93f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f55f000cb90 tx=0x7f55f000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55f4ff9700 1 -- 172.21.15.84:0/378478129 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000aac0 con 0x7f55f815bce0 2023-08-31T02:00:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55f4ff9700 1 -- 172.21.15.84:0/378478129 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f55f000ad10 con 0x7f55f815bce0 2023-08-31T02:00:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f806df30 con 0x7f55f815bce0 2023-08-31T02:00:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55f4ff9700 1 -- 172.21.15.84:0/378478129 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0012680 con 0x7f55f815bce0 2023-08-31T02:00:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.562+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f8159060 con 0x7f55f815bce0 2023-08-31T02:00:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.563+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f804e7c0 con 0x7f55f815bce0 2023-08-31T02:00:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.564+0000 7f55f4ff9700 1 -- 172.21.15.84:0/378478129 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f55f00127e0 con 0x7f55f815bce0 2023-08-31T02:00:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.564+0000 7f55f4ff9700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f55e406a0e0 0x7f55e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.564+0000 7f55f4ff9700 1 -- 172.21.15.84:0/378478129 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f55f0088bc0 con 0x7f55f815bce0 2023-08-31T02:00:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.564+0000 7f55f7fff700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f55e406a0e0 0x7f55e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.565+0000 7f55f7fff700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f55e406a0e0 0x7f55e406c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f55ec004740 tx=0x7f55ec009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.568+0000 7f55f4ff9700 1 -- 172.21.15.84:0/378478129 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f55f0053f00 con 0x7f55f815bce0 2023-08-31T02:00:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.757+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55f8156ae0 con 0x7f55f815bce0 2023-08-31T02:00:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.757+0000 7f55f4ff9700 1 -- 172.21.15.84:0/378478129 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55f0016030 con 0x7f55f815bce0 2023-08-31T02:00:40.751 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f55e406a0e0 msgr2=0x7f55e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f55e406a0e0 0x7f55e406c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f55ec004740 tx=0x7f55ec009040 comp rx=0 tx=0).stop 2023-08-31T02:00:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f815bce0 msgr2=0x7f55f80c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f815bce0 0x7f55f80c93f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f55f000cb90 tx=0x7f55f000cea0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 shutdown_connections 2023-08-31T02:00:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f55e406a0e0 0x7f55e406c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55f815bce0 0x7f55f80c93f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55f80ca2d0 0x7f55f814bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 --2- 172.21.15.84:0/378478129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55f815b790 0x7f55f814eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.759+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 >> 172.21.15.84:0/378478129 conn(0x7f55f80afb00 msgr2=0x7f55f80adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.760+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 shutdown_connections 2023-08-31T02:00:40.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.760+0000 7f55fe6c7700 1 -- 172.21.15.84:0/378478129 wait complete. 2023-08-31T02:00:40.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:40.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 -- 172.21.15.84:0/3858630397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 msgr2=0x7f31bc0af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 --2- 172.21.15.84:0/3858630397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 0x7f31bc0af7f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f31bc06a6a0 tx=0x7f31ac009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:40.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 -- 172.21.15.84:0/3858630397 shutdown_connections 2023-08-31T02:00:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 --2- 172.21.15.84:0/3858630397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31bc0cb520 0x7f31bc0b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 --2- 172.21.15.84:0/3858630397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 0x7f31bc0af7f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 --2- 172.21.15.84:0/3858630397 >> v2:172.21.15.170:3300/0 conn(0x7f31bc0c9780 0x7f31bc0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 -- 172.21.15.84:0/3858630397 >> 172.21.15.84:0/3858630397 conn(0x7f31bc0699a0 msgr2=0x7f31bc069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 -- 172.21.15.84:0/3858630397 shutdown_connections 2023-08-31T02:00:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.896+0000 7f31c12c0700 1 -- 172.21.15.84:0/3858630397 wait complete. 2023-08-31T02:00:40.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.897+0000 7f31c12c0700 1 Processor -- start 2023-08-31T02:00:40.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.897+0000 7f31c12c0700 1 -- start start 2023-08-31T02:00:40.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31c12c0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31bc0c9780 0x7f31bc0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31c12c0700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31bc0cb520 0x7f31bc1f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31c12c0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 0x7f31bc1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31c12c0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0c3a20 con 0x7f31bc1591f0 2023-08-31T02:00:40.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31c12c0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc06ce60 con 0x7f31bc0c9780 2023-08-31T02:00:40.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31c12c0700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0c2da0 con 0x7f31bc0cb520 2023-08-31T02:00:40.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 0x7f31bc1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 0x7f31bc1f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52304/0 (socket says 172.21.15.84:52304) 2023-08-31T02:00:40.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 -- 172.21.15.84:0/1305043745 learned_addr learned my addr 172.21.15.84:0/1305043745 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:40.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31baffd700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31bc0c9780 0x7f31bc0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31ba7fc700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31bc0cb520 0x7f31bc1f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 -- 172.21.15.84:0/1305043745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31bc0cb520 msgr2=0x7f31bc1f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31bc0cb520 0x7f31bc1f2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 -- 172.21.15.84:0/1305043745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31bc0c9780 msgr2=0x7f31bc0ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:40.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31bc0c9780 0x7f31bc0ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:40.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 -- 172.21.15.84:0/1305043745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0095f0 con 0x7f31bc1591f0 2023-08-31T02:00:40.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31bb7fe700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 0x7f31bc1f3210 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b970 tx=0x7f31b400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:40.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31a37fe700 1 -- 172.21.15.84:0/1305043745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400c9b0 con 0x7f31bc1591f0 2023-08-31T02:00:40.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31a37fe700 1 -- 172.21.15.84:0/1305043745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f31b400cc20 con 0x7f31bc1591f0 2023-08-31T02:00:40.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc0c3080 con 0x7f31bc1591f0 2023-08-31T02:00:40.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31a37fe700 1 -- 172.21.15.84:0/1305043745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4014440 con 0x7f31bc1591f0 2023-08-31T02:00:40.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.898+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc0c3640 con 0x7f31bc1591f0 2023-08-31T02:00:40.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.899+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc0c3b60 con 0x7f31bc1591f0 2023-08-31T02:00:40.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.900+0000 7f31a37fe700 1 -- 172.21.15.84:0/1305043745 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31b401d3b0 con 0x7f31bc1591f0 2023-08-31T02:00:40.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.900+0000 7f31a37fe700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f31a806a0e0 0x7f31a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:40.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.900+0000 7f31a37fe700 1 -- 172.21.15.84:0/1305043745 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f31b4006e40 con 0x7f31bc1591f0 2023-08-31T02:00:40.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.900+0000 7f31baffd700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f31a806a0e0 0x7f31a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:40.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.901+0000 7f31baffd700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f31a806a0e0 0x7f31a806c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0098e0 tx=0x7f31ac011040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:40.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:40.904+0000 7f31a37fe700 1 -- 172.21.15.84:0/1305043745 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f31b4053c40 con 0x7f31bc1591f0 2023-08-31T02:00:41.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.097+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f31bc0b1200 con 0x7f31bc1591f0 2023-08-31T02:00:41.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.098+0000 7f31a37fe700 1 -- 172.21.15.84:0/1305043745 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f31b4057260 con 0x7f31bc1591f0 2023-08-31T02:00:41.091 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:41.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f31a806a0e0 msgr2=0x7f31a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f31a806a0e0 0x7f31a806c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0098e0 tx=0x7f31ac011040 comp rx=0 tx=0).stop 2023-08-31T02:00:41.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 msgr2=0x7f31bc1f3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 0x7f31bc1f3210 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b970 tx=0x7f31b400bd30 comp rx=0 tx=0).stop 2023-08-31T02:00:41.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 shutdown_connections 2023-08-31T02:00:41.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f31a806a0e0 0x7f31a806c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc1591f0 0x7f31bc1f3210 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31bc0c9780 0x7f31bc0ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 --2- 172.21.15.84:0/1305043745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31bc0cb520 0x7f31bc1f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 >> 172.21.15.84:0/1305043745 conn(0x7f31bc0699a0 msgr2=0x7f31bc15d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:41.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 shutdown_connections 2023-08-31T02:00:41.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.100+0000 7f31c12c0700 1 -- 172.21.15.84:0/1305043745 wait complete. 2023-08-31T02:00:41.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.234+0000 7ff198f73700 1 -- 172.21.15.84:0/976938040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17c004030 msgr2=0x7ff17c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.234+0000 7ff198f73700 1 --2- 172.21.15.84:0/976938040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17c004030 0x7ff17c004850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff18800bb90 tx=0x7ff17c005880 comp rx=0 tx=0).stop 2023-08-31T02:00:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.234+0000 7ff192d9d700 1 -- 172.21.15.84:0/976938040 reap_dead start 2023-08-31T02:00:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.235+0000 7ff198f73700 1 -- 172.21.15.84:0/976938040 shutdown_connections 2023-08-31T02:00:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.235+0000 7ff198f73700 1 -- 172.21.15.84:0/976938040 >> 172.21.15.84:0/976938040 conn(0x7ff1940caa20 msgr2=0x7ff1940cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.235+0000 7ff198f73700 1 -- 172.21.15.84:0/976938040 shutdown_connections 2023-08-31T02:00:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.235+0000 7ff198f73700 1 -- 172.21.15.84:0/976938040 wait complete. 2023-08-31T02:00:41.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.236+0000 7ff198f73700 1 Processor -- start 2023-08-31T02:00:41.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.236+0000 7ff198f73700 1 -- start start 2023-08-31T02:00:41.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff198f73700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff17c004030 0x7ff1940b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff198f73700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff194158930 0x7ff19415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff198f73700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff194151c60 0x7ff1941520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff198f73700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff194152620 con 0x7ff194158930 2023-08-31T02:00:41.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff198f73700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff194159180 con 0x7ff194151c60 2023-08-31T02:00:41.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff198f73700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff194159460 con 0x7ff17c004030 2023-08-31T02:00:41.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff194158930 0x7ff19415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff194158930 0x7ff19415a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52324/0 (socket says 172.21.15.84:52324) 2023-08-31T02:00:41.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 -- 172.21.15.84:0/2602682091 learned_addr learned my addr 172.21.15.84:0/2602682091 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:41.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff19259c700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff17c004030 0x7ff1940b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff192d9d700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff194151c60 0x7ff1941520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 -- 172.21.15.84:0/2602682091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff17c004030 msgr2=0x7ff1940b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff17c004030 0x7ff1940b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 -- 172.21.15.84:0/2602682091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff194151c60 msgr2=0x7ff1941520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff194151c60 0x7ff1941520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 -- 172.21.15.84:0/2602682091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194159740 con 0x7ff194158930 2023-08-31T02:00:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff191d9b700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff194158930 0x7ff19415a8a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff18800bae0 tx=0x7ff18800b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff182ffd700 1 -- 172.21.15.84:0/2602682091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188004460 con 0x7ff194158930 2023-08-31T02:00:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff182ffd700 1 -- 172.21.15.84:0/2602682091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff188003680 con 0x7ff194158930 2023-08-31T02:00:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff194159a20 con 0x7ff194158930 2023-08-31T02:00:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.237+0000 7ff182ffd700 1 -- 172.21.15.84:0/2602682091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188003a90 con 0x7ff194158930 2023-08-31T02:00:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.238+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19415ade0 con 0x7ff194158930 2023-08-31T02:00:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.238+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19404e7c0 con 0x7ff194158930 2023-08-31T02:00:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.239+0000 7ff182ffd700 1 -- 172.21.15.84:0/2602682091 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff188003bf0 con 0x7ff194158930 2023-08-31T02:00:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.239+0000 7ff182ffd700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff17406a0e0 0x7ff17406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.239+0000 7ff182ffd700 1 -- 172.21.15.84:0/2602682091 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ff18808a270 con 0x7ff194158930 2023-08-31T02:00:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.239+0000 7ff19259c700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff17406a0e0 0x7ff17406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.240+0000 7ff19259c700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff17406a0e0 0x7ff17406c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff184001d40 tx=0x7ff184001cb0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:41.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.244+0000 7ff182ffd700 1 -- 172.21.15.84:0/2602682091 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff188055630 con 0x7ff194158930 2023-08-31T02:00:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.436+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1940c9bf0 con 0x7ff194158930 2023-08-31T02:00:41.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.437+0000 7ff182ffd700 1 -- 172.21.15.84:0/2602682091 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7ff188058c50 con 0x7ff194158930 2023-08-31T02:00:41.430 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:41.431 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:41.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff17406a0e0 msgr2=0x7ff17406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff17406a0e0 0x7ff17406c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff184001d40 tx=0x7ff184001cb0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff194158930 msgr2=0x7ff19415a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff194158930 0x7ff19415a8a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff18800bae0 tx=0x7ff18800b5d0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 shutdown_connections 2023-08-31T02:00:41.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff17406a0e0 0x7ff17406c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff194151c60 0x7ff1941520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff17c004030 0x7ff1940b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 --2- 172.21.15.84:0/2602682091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff194158930 0x7ff19415a8a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 >> 172.21.15.84:0/2602682091 conn(0x7ff1940caa20 msgr2=0x7ff1941546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:41.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 shutdown_connections 2023-08-31T02:00:41.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.439+0000 7ff198f73700 1 -- 172.21.15.84:0/2602682091 wait complete. 2023-08-31T02:00:41.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:41.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:41.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.578+0000 7f5269232700 1 -- 172.21.15.84:0/3496219596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c003a00 msgr2=0x7f524c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.578+0000 7f5269232700 1 --2- 172.21.15.84:0/3496219596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c003a00 0x7f524c003e20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5258009be0 tx=0x7f524c005880 comp rx=0 tx=0).stop 2023-08-31T02:00:41.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.578+0000 7f5269232700 1 -- 172.21.15.84:0/3496219596 shutdown_connections 2023-08-31T02:00:41.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.578+0000 7f5269232700 1 --2- 172.21.15.84:0/3496219596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c003a00 0x7f524c003e20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.578+0000 7f5269232700 1 -- 172.21.15.84:0/3496219596 >> 172.21.15.84:0/3496219596 conn(0x7f52640699a0 msgr2=0x7f5264069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:41.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.578+0000 7f5269232700 1 -- 172.21.15.84:0/3496219596 shutdown_connections 2023-08-31T02:00:41.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.578+0000 7f5269232700 1 -- 172.21.15.84:0/3496219596 wait complete. 2023-08-31T02:00:41.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f5269232700 1 Processor -- start 2023-08-31T02:00:41.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f5269232700 1 -- start start 2023-08-31T02:00:41.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f5269232700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f524c003a00 0x7f526414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f5269232700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f526414d990 0x7f52640c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f5269232700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52640c8590 0x7f52640c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f5269232700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526414d7b0 con 0x7f52640c8590 2023-08-31T02:00:41.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f5269232700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640c6250 con 0x7f526414d990 2023-08-31T02:00:41.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f5269232700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52640c4cd0 con 0x7f524c003a00 2023-08-31T02:00:41.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.580+0000 7f526359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52640c8590 0x7f52640c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52640c8590 0x7f52640c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52346/0 (socket says 172.21.15.84:52346) 2023-08-31T02:00:41.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526359e700 1 -- 172.21.15.84:0/2695792758 learned_addr learned my addr 172.21.15.84:0/2695792758 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:41.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526259c700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f526414d990 0x7f52640c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f5262d9d700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f524c003a00 0x7f526414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526359e700 1 -- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f524c003a00 msgr2=0x7f526414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526359e700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f524c003a00 0x7f526414d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526359e700 1 -- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f526414d990 msgr2=0x7f52640c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526359e700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f526414d990 0x7f52640c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526359e700 1 -- 172.21.15.84:0/2695792758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640c4fb0 con 0x7f52640c8590 2023-08-31T02:00:41.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f5262d9d700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f524c003a00 0x7f526414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:41.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f526359e700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52640c8590 0x7f52640c8a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f52640b1bd0 tx=0x7f525c0018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:41.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f524b7fe700 1 -- 172.21.15.84:0/2695792758 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c011660 con 0x7f52640c8590 2023-08-31T02:00:41.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f524b7fe700 1 -- 172.21.15.84:0/2695792758 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f525c011800 con 0x7f52640c8590 2023-08-31T02:00:41.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52640c5290 con 0x7f52640c8590 2023-08-31T02:00:41.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f524b7fe700 1 -- 172.21.15.84:0/2695792758 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c011c10 con 0x7f52640c8590 2023-08-31T02:00:41.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.581+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52640c5850 con 0x7f52640c8590 2023-08-31T02:00:41.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.582+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52641e4580 con 0x7f52640c8590 2023-08-31T02:00:41.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.583+0000 7f524b7fe700 1 -- 172.21.15.84:0/2695792758 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f525c01c460 con 0x7f52640c8590 2023-08-31T02:00:41.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.583+0000 7f524b7fe700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f525006a110 0x7f525006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.583+0000 7f524b7fe700 1 -- 172.21.15.84:0/2695792758 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f525c089100 con 0x7f52640c8590 2023-08-31T02:00:41.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.583+0000 7f5262d9d700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f525006a110 0x7f525006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.583+0000 7f5262d9d700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f525006a110 0x7f525006c5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5258009be0 tx=0x7f5258004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:41.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.587+0000 7f524b7fe700 1 -- 172.21.15.84:0/2695792758 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f525c0544c0 con 0x7f52640c8590 2023-08-31T02:00:41.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.773+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52640c6420 con 0x7f52640c8590 2023-08-31T02:00:41.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.774+0000 7f524b7fe700 1 -- 172.21.15.84:0/2695792758 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52640c6420 con 0x7f52640c8590 2023-08-31T02:00:41.767 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:41.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.775+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f525006a110 msgr2=0x7f525006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.775+0000 7f5269232700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f525006a110 0x7f525006c5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5258009be0 tx=0x7f5258004750 comp rx=0 tx=0).stop 2023-08-31T02:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.775+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52640c8590 msgr2=0x7f52640c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.775+0000 7f5269232700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52640c8590 0x7f52640c8a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f52640b1bd0 tx=0x7f525c0018c0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.775+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 shutdown_connections 2023-08-31T02:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.775+0000 7f5269232700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f525006a110 0x7f525006c5d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.775+0000 7f5269232700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52640c8590 0x7f52640c8a10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.776+0000 7f5269232700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f524c003a00 0x7f526414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.776+0000 7f5269232700 1 --2- 172.21.15.84:0/2695792758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f526414d990 0x7f52640c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.776+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 >> 172.21.15.84:0/2695792758 conn(0x7f52640699a0 msgr2=0x7f526414e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.776+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 shutdown_connections 2023-08-31T02:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.776+0000 7f5269232700 1 -- 172.21.15.84:0/2695792758 wait complete. 2023-08-31T02:00:41.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:41.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.914+0000 7f3788b03700 1 -- 172.21.15.84:0/3282658373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f376c003a00 msgr2=0x7f376c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.914+0000 7f3788b03700 1 --2- 172.21.15.84:0/3282658373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f376c003a00 0x7f376c003e20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3774001720 tx=0x7f376c005880 comp rx=0 tx=0).stop 2023-08-31T02:00:41.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.914+0000 7f3788b03700 1 -- 172.21.15.84:0/3282658373 shutdown_connections 2023-08-31T02:00:41.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.914+0000 7f3788b03700 1 --2- 172.21.15.84:0/3282658373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f376c003a00 0x7f376c003e20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.914+0000 7f3788b03700 1 -- 172.21.15.84:0/3282658373 >> 172.21.15.84:0/3282658373 conn(0x7f37840afb00 msgr2=0x7f37840aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:41.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.914+0000 7f3788b03700 1 -- 172.21.15.84:0/3282658373 shutdown_connections 2023-08-31T02:00:41.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.914+0000 7f3788b03700 1 -- 172.21.15.84:0/3282658373 wait complete. 2023-08-31T02:00:41.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.915+0000 7f3788b03700 1 Processor -- start 2023-08-31T02:00:41.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.915+0000 7f3788b03700 1 -- start start 2023-08-31T02:00:41.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3788b03700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f376c003a00 0x7f378414c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3788b03700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37840c2440 0x7f37840ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3788b03700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37840ae810 0x7f37840c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3788b03700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840aec90 con 0x7f37840c2440 2023-08-31T02:00:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3788b03700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840c7290 con 0x7f37840ae810 2023-08-31T02:00:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3788b03700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840c33b0 con 0x7f376c003a00 2023-08-31T02:00:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37840c2440 0x7f37840ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37840c2440 0x7f37840ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52364/0 (socket says 172.21.15.84:52364) 2023-08-31T02:00:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 -- 172.21.15.84:0/1115885538 learned_addr learned my addr 172.21.15.84:0/1115885538 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3782d9d700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37840ae810 0x7f37840c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f378259c700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f376c003a00 0x7f378414c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 -- 172.21.15.84:0/1115885538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f376c003a00 msgr2=0x7f378414c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f376c003a00 0x7f378414c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 -- 172.21.15.84:0/1115885538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37840ae810 msgr2=0x7f37840c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:41.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37840ae810 0x7f37840c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:41.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 -- 172.21.15.84:0/1115885538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840c6680 con 0x7f37840c2440 2023-08-31T02:00:41.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3781d9b700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37840c2440 0x7f37840ae2d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3778011c20 tx=0x7f3778011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:41.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3772ffd700 1 -- 172.21.15.84:0/1115885538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778016070 con 0x7f37840c2440 2023-08-31T02:00:41.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3772ffd700 1 -- 172.21.15.84:0/1115885538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f377800eb10 con 0x7f37840c2440 2023-08-31T02:00:41.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.916+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37840c6960 con 0x7f37840c2440 2023-08-31T02:00:41.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.917+0000 7f3772ffd700 1 -- 172.21.15.84:0/1115885538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778004020 con 0x7f37840c2440 2023-08-31T02:00:41.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.917+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37840c6f20 con 0x7f37840c2440 2023-08-31T02:00:41.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.918+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378404e7c0 con 0x7f37840c2440 2023-08-31T02:00:41.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.918+0000 7f3772ffd700 1 -- 172.21.15.84:0/1115885538 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3778004180 con 0x7f37840c2440 2023-08-31T02:00:41.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.918+0000 7f3772ffd700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f376406a110 0x7f376406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:41.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.918+0000 7f3772ffd700 1 -- 172.21.15.84:0/1115885538 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f377808ad20 con 0x7f37840c2440 2023-08-31T02:00:41.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.918+0000 7f378259c700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f376406a110 0x7f376406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:41.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.919+0000 7f378259c700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f376406a110 0x7f376406c5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3774001720 tx=0x7f3774001190 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:41.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:41.923+0000 7f3772ffd700 1 -- 172.21.15.84:0/1115885538 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3778055fe0 con 0x7f37840c2440 2023-08-31T02:00:42.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.113+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37840718b0 con 0x7f37840c2440 2023-08-31T02:00:42.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.113+0000 7f3772ffd700 1 -- 172.21.15.84:0/1115885538 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3778059600 con 0x7f37840c2440 2023-08-31T02:00:42.106 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f376406a110 msgr2=0x7f376406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f376406a110 0x7f376406c5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3774001720 tx=0x7f3774001190 comp rx=0 tx=0).stop 2023-08-31T02:00:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37840c2440 msgr2=0x7f37840ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37840c2440 0x7f37840ae2d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3778011c20 tx=0x7f3778011f30 comp rx=0 tx=0).stop 2023-08-31T02:00:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 shutdown_connections 2023-08-31T02:00:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f376406a110 0x7f376406c5d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37840ae810 0x7f37840c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f376c003a00 0x7f378414c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 --2- 172.21.15.84:0/1115885538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37840c2440 0x7f37840ae2d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 >> 172.21.15.84:0/1115885538 conn(0x7f37840afb00 msgr2=0x7f378414cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 shutdown_connections 2023-08-31T02:00:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.115+0000 7f3788b03700 1 -- 172.21.15.84:0/1115885538 wait complete. 2023-08-31T02:00:42.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:42.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.252+0000 7fe6c9652700 1 -- 172.21.15.84:0/3484494306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c406cf00 msgr2=0x7fe6c40c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.252+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3484494306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c406cf00 0x7fe6c40c2220 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009f60 tx=0x7fe6bc009f90 comp rx=0 tx=0).stop 2023-08-31T02:00:42.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.252+0000 7fe6c9652700 1 -- 172.21.15.84:0/3484494306 shutdown_connections 2023-08-31T02:00:42.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.252+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3484494306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c406cf00 0x7fe6c40c2220 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.252+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3484494306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6c40c8800 0x7fe6c406c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.252+0000 7fe6c9652700 1 -- 172.21.15.84:0/3484494306 >> 172.21.15.84:0/3484494306 conn(0x7fe6c40c9860 msgr2=0x7fe6c40c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:42.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.252+0000 7fe6c9652700 1 -- 172.21.15.84:0/3484494306 shutdown_connections 2023-08-31T02:00:42.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.252+0000 7fe6c9652700 1 -- 172.21.15.84:0/3484494306 wait complete. 2023-08-31T02:00:42.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.253+0000 7fe6c9652700 1 Processor -- start 2023-08-31T02:00:42.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.253+0000 7fe6c9652700 1 -- start start 2023-08-31T02:00:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c9652700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6c406cf00 0x7fe6c414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c9652700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6c40c8800 0x7fe6c40ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c9652700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c4155c20 0x7fe6c40acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c9652700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4070260 con 0x7fe6c4155c20 2023-08-31T02:00:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c9652700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c406f690 con 0x7fe6c406cf00 2023-08-31T02:00:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c9652700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c406f930 con 0x7fe6c40c8800 2023-08-31T02:00:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c4155c20 0x7fe6c40acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c4155c20 0x7fe6c40acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52378/0 (socket says 172.21.15.84:52378) 2023-08-31T02:00:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c37fe700 1 -- 172.21.15.84:0/3612504609 learned_addr learned my addr 172.21.15.84:0/3612504609 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c27fc700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6c40c8800 0x7fe6c40ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c2ffd700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6c406cf00 0x7fe6c414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c37fe700 1 -- 172.21.15.84:0/3612504609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6c40c8800 msgr2=0x7fe6c40ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c37fe700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6c40c8800 0x7fe6c40ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c37fe700 1 -- 172.21.15.84:0/3612504609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6c406cf00 msgr2=0x7fe6c414b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c37fe700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6c406cf00 0x7fe6c414b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.254+0000 7fe6c37fe700 1 -- 172.21.15.84:0/3612504609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc009c40 con 0x7fe6c4155c20 2023-08-31T02:00:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.255+0000 7fe6c37fe700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c4155c20 0x7fe6c40acea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00b6c0 tx=0x7fe6bc007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.255+0000 7fe6ab7fe700 1 -- 172.21.15.84:0/3612504609 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00e040 con 0x7fe6c4155c20 2023-08-31T02:00:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.255+0000 7fe6ab7fe700 1 -- 172.21.15.84:0/3612504609 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe6bc01a6c0 con 0x7fe6c4155c20 2023-08-31T02:00:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.255+0000 7fe6ab7fe700 1 -- 172.21.15.84:0/3612504609 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc006000 con 0x7fe6c4155c20 2023-08-31T02:00:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.255+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c406fc10 con 0x7fe6c4155c20 2023-08-31T02:00:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.255+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c414bb70 con 0x7fe6c4155c20 2023-08-31T02:00:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.256+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c40703d0 con 0x7fe6c4155c20 2023-08-31T02:00:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.256+0000 7fe6ab7fe700 1 -- 172.21.15.84:0/3612504609 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe6bc01aad0 con 0x7fe6c4155c20 2023-08-31T02:00:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.256+0000 7fe6ab7fe700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe6b006a0e0 0x7fe6b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.257+0000 7fe6ab7fe700 1 -- 172.21.15.84:0/3612504609 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe6bc08bff0 con 0x7fe6c4155c20 2023-08-31T02:00:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.257+0000 7fe6c2ffd700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe6b006a0e0 0x7fe6b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.257+0000 7fe6c2ffd700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe6b006a0e0 0x7fe6b006c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4000f60 tx=0x7fe6b4009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.261+0000 7fe6ab7fe700 1 -- 172.21.15.84:0/3612504609 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe6bc057450 con 0x7fe6c4155c20 2023-08-31T02:00:42.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.452+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6c404e7c0 con 0x7fe6c4155c20 2023-08-31T02:00:42.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.453+0000 7fe6ab7fe700 1 -- 172.21.15.84:0/3612504609 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6bc01f1a0 con 0x7fe6c4155c20 2023-08-31T02:00:42.446 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:42.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe6b006a0e0 msgr2=0x7fe6b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe6b006a0e0 0x7fe6b006c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4000f60 tx=0x7fe6b4009040 comp rx=0 tx=0).stop 2023-08-31T02:00:42.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c4155c20 msgr2=0x7fe6c40acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c4155c20 0x7fe6c40acea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00b6c0 tx=0x7fe6bc007b20 comp rx=0 tx=0).stop 2023-08-31T02:00:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 shutdown_connections 2023-08-31T02:00:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe6b006a0e0 0x7fe6b006c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c4155c20 0x7fe6c40acea0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6c406cf00 0x7fe6c414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 --2- 172.21.15.84:0/3612504609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6c40c8800 0x7fe6c40ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 >> 172.21.15.84:0/3612504609 conn(0x7fe6c40c9860 msgr2=0x7fe6c41546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 shutdown_connections 2023-08-31T02:00:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.455+0000 7fe6c9652700 1 -- 172.21.15.84:0/3612504609 wait complete. 2023-08-31T02:00:42.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:42.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.592+0000 7f0bc1c27700 1 -- 172.21.15.84:0/3238934181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 msgr2=0x7f0bbc0c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.592+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/3238934181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 0x7f0bbc0c9a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc06e7d0 tx=0x7f0bac009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:42.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.592+0000 7f0bc1c27700 1 -- 172.21.15.84:0/3238934181 shutdown_connections 2023-08-31T02:00:42.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.592+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/3238934181 >> v2:172.21.15.170:3300/0 conn(0x7f0bbc1593b0 0x7f0bbc0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.592+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/3238934181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 0x7f0bbc0c9a40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.592+0000 7f0bc1c27700 1 -- 172.21.15.84:0/3238934181 >> 172.21.15.84:0/3238934181 conn(0x7f0bbc0afb00 msgr2=0x7f0bbc0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.592+0000 7f0bc1c27700 1 -- 172.21.15.84:0/3238934181 shutdown_connections 2023-08-31T02:00:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.593+0000 7f0bc1c27700 1 -- 172.21.15.84:0/3238934181 wait complete. 2023-08-31T02:00:42.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.594+0000 7f0bc1c27700 1 Processor -- start 2023-08-31T02:00:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.594+0000 7f0bc1c27700 1 -- start start 2023-08-31T02:00:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bc1c27700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 0x7f0bbc150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bc1c27700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0bbc0b23e0 0x7f0bbc0c2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bc1c27700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bbc1593b0 0x7f0bbc0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bc1c27700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1510b0 con 0x7f0bbc06db90 2023-08-31T02:00:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bc1c27700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc151a40 con 0x7f0bbc1593b0 2023-08-31T02:00:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bc1c27700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0c28d0 con 0x7f0bbc0b23e0 2023-08-31T02:00:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bbb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 0x7f0bbc150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bbb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 0x7f0bbc150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52388/0 (socket says 172.21.15.84:52388) 2023-08-31T02:00:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bbb7fe700 1 -- 172.21.15.84:0/671036135 learned_addr learned my addr 172.21.15.84:0/671036135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bbaffd700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0bbc0b23e0 0x7f0bbc0c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.595+0000 7f0bbbfff700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bbc1593b0 0x7f0bbc0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0bbb7fe700 1 -- 172.21.15.84:0/671036135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0bbc0b23e0 msgr2=0x7f0bbc0c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0bbb7fe700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0bbc0b23e0 0x7f0bbc0c2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0bbb7fe700 1 -- 172.21.15.84:0/671036135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bbc1593b0 msgr2=0x7f0bbc0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0bbb7fe700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bbc1593b0 0x7f0bbc0c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0bbb7fe700 1 -- 172.21.15.84:0/671036135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0095f0 con 0x7f0bbc06db90 2023-08-31T02:00:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0bbb7fe700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 0x7f0bbc150b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000e9f0 tx=0x7f0bb000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0ba3fff700 1 -- 172.21.15.84:0/671036135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0009610 con 0x7f0bbc06db90 2023-08-31T02:00:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0ba3fff700 1 -- 172.21.15.84:0/671036135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0bb000cab0 con 0x7f0bbc06db90 2023-08-31T02:00:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc0ca100 con 0x7f0bbc06db90 2023-08-31T02:00:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0ba3fff700 1 -- 172.21.15.84:0/671036135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb000cea0 con 0x7f0bbc06db90 2023-08-31T02:00:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.596+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc0c48b0 con 0x7f0bbc06db90 2023-08-31T02:00:42.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.597+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc070450 con 0x7f0bbc06db90 2023-08-31T02:00:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.598+0000 7f0ba3fff700 1 -- 172.21.15.84:0/671036135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0bb0010430 con 0x7f0bbc06db90 2023-08-31T02:00:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.598+0000 7f0ba3fff700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.598+0000 7f0ba3fff700 1 -- 172.21.15.84:0/671036135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f0bb0014070 con 0x7f0bbc06db90 2023-08-31T02:00:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.598+0000 7f0bbaffd700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.599+0000 7f0bbaffd700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0098e0 tx=0x7f0bac0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.602+0000 7f0ba3fff700 1 -- 172.21.15.84:0/671036135 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0bb0054ca0 con 0x7f0bbc06db90 2023-08-31T02:00:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.792+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0bbc04e7c0 con 0x7f0bbc06db90 2023-08-31T02:00:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.792+0000 7f0ba3fff700 1 -- 172.21.15.84:0/671036135 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0bb00260a0 con 0x7f0bbc06db90 2023-08-31T02:00:42.786 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ba806a0e0 msgr2=0x7f0ba806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0098e0 tx=0x7f0bac0047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 msgr2=0x7f0bbc150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 0x7f0bbc150b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000e9f0 tx=0x7f0bb000ed00 comp rx=0 tx=0).stop 2023-08-31T02:00:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 shutdown_connections 2023-08-31T02:00:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bbc1593b0 0x7f0bbc0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bbc06db90 0x7f0bbc150b70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 --2- 172.21.15.84:0/671036135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0bbc0b23e0 0x7f0bbc0c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 >> 172.21.15.84:0/671036135 conn(0x7f0bbc0afb00 msgr2=0x7f0bbc0ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 shutdown_connections 2023-08-31T02:00:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.794+0000 7f0bc1c27700 1 -- 172.21.15.84:0/671036135 wait complete. 2023-08-31T02:00:42.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 -- 172.21.15.84:0/3798538552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0110158220 msgr2=0x7f01100cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 --2- 172.21.15.84:0/3798538552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0110158220 0x7f01100cc920 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f01100cbb00 tx=0x7f010c009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 -- 172.21.15.84:0/3798538552 shutdown_connections 2023-08-31T02:00:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 --2- 172.21.15.84:0/3798538552 >> v2:172.21.15.170:3300/0 conn(0x7f01100707c0 0x7f0110070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 --2- 172.21.15.84:0/3798538552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0110158220 0x7f01100cc920 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 --2- 172.21.15.84:0/3798538552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01100b0df0 0x7f01100c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 -- 172.21.15.84:0/3798538552 >> 172.21.15.84:0/3798538552 conn(0x7f01100caa20 msgr2=0x7f01100cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 -- 172.21.15.84:0/3798538552 shutdown_connections 2023-08-31T02:00:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.929+0000 7f0117d01700 1 -- 172.21.15.84:0/3798538552 wait complete. 2023-08-31T02:00:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.930+0000 7f0117d01700 1 Processor -- start 2023-08-31T02:00:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0117d01700 1 -- start start 2023-08-31T02:00:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0117d01700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01100707c0 0x7f0110148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0117d01700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01100b0df0 0x7f01100acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0117d01700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0110158220 0x7f01100b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0117d01700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01101488a0 con 0x7f01100707c0 2023-08-31T02:00:42.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0117d01700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0110157a90 con 0x7f01100b0df0 2023-08-31T02:00:42.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0117d01700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01100c8e00 con 0x7f0110158220 2023-08-31T02:00:42.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0115a9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01100707c0 0x7f0110148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0115a9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01100707c0 0x7f0110148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52402/0 (socket says 172.21.15.84:52402) 2023-08-31T02:00:42.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.931+0000 7f0115a9d700 1 -- 172.21.15.84:0/2453621268 learned_addr learned my addr 172.21.15.84:0/2453621268 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:42.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f011529c700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01100b0df0 0x7f01100acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f011629e700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0110158220 0x7f01100b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f0115a9d700 1 -- 172.21.15.84:0/2453621268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0110158220 msgr2=0x7f01100b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f0115a9d700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0110158220 0x7f01100b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f0115a9d700 1 -- 172.21.15.84:0/2453621268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01100b0df0 msgr2=0x7f01100acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f0115a9d700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01100b0df0 0x7f01100acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f0115a9d700 1 -- 172.21.15.84:0/2453621268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0095f0 con 0x7f01100707c0 2023-08-31T02:00:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f0115a9d700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01100707c0 0x7f0110148cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f010c005fd0 tx=0x7f010c004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f01067fc700 1 -- 172.21.15.84:0/2453621268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c01c070 con 0x7f01100707c0 2023-08-31T02:00:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f01067fc700 1 -- 172.21.15.84:0/2453621268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f010c004830 con 0x7f01100707c0 2023-08-31T02:00:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f01067fc700 1 -- 172.21.15.84:0/2453621268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c004c40 con 0x7f01100707c0 2023-08-31T02:00:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01100c90e0 con 0x7f01100707c0 2023-08-31T02:00:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.932+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01101484c0 con 0x7f01100707c0 2023-08-31T02:00:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.933+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01100ad330 con 0x7f01100707c0 2023-08-31T02:00:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.933+0000 7f01067fc700 1 -- 172.21.15.84:0/2453621268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f010c00b7b0 con 0x7f01100707c0 2023-08-31T02:00:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.934+0000 7f01067fc700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00f406a0e0 0x7f00f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.934+0000 7f01067fc700 1 -- 172.21.15.84:0/2453621268 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f010c0899f0 con 0x7f01100707c0 2023-08-31T02:00:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.934+0000 7f011529c700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00f406a0e0 0x7f00f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.934+0000 7f011529c700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00f406a0e0 0x7f00f406c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0100005950 tx=0x7f01000058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:42.938+0000 7f01067fc700 1 -- 172.21.15.84:0/2453621268 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f010c054e50 con 0x7f01100707c0 2023-08-31T02:00:43.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.127+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f011004e7c0 con 0x7f01100707c0 2023-08-31T02:00:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.129+0000 7f01067fc700 1 -- 172.21.15.84:0/2453621268 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f010c058470 con 0x7f01100707c0 2023-08-31T02:00:43.122 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:43.122 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00f406a0e0 msgr2=0x7f00f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00f406a0e0 0x7f00f406c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0100005950 tx=0x7f01000058e0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01100707c0 msgr2=0x7f0110148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01100707c0 0x7f0110148cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f010c005fd0 tx=0x7f010c004310 comp rx=0 tx=0).stop 2023-08-31T02:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 shutdown_connections 2023-08-31T02:00:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00f406a0e0 0x7f00f406c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0110158220 0x7f01100b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01100707c0 0x7f0110148cc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 --2- 172.21.15.84:0/2453621268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01100b0df0 0x7f01100acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 >> 172.21.15.84:0/2453621268 conn(0x7f01100caa20 msgr2=0x7f01100adde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 shutdown_connections 2023-08-31T02:00:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.131+0000 7f0117d01700 1 -- 172.21.15.84:0/2453621268 wait complete. 2023-08-31T02:00:43.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:43.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.271+0000 7f5754635700 1 -- 172.21.15.84:0/1911988253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15bce0 msgr2=0x7f574c0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.271+0000 7f5754635700 1 --2- 172.21.15.84:0/1911988253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15bce0 0x7f574c0c9bc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f574c0661a0 tx=0x7f5748009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.271+0000 7f5754635700 1 -- 172.21.15.84:0/1911988253 shutdown_connections 2023-08-31T02:00:43.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.271+0000 7f5754635700 1 --2- 172.21.15.84:0/1911988253 >> v2:172.21.15.170:3300/0 conn(0x7f574c15b790 0x7f574c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.271+0000 7f5754635700 1 --2- 172.21.15.84:0/1911988253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15bce0 0x7f574c0c9bc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.271+0000 7f5754635700 1 -- 172.21.15.84:0/1911988253 >> 172.21.15.84:0/1911988253 conn(0x7f574c0afb00 msgr2=0x7f574c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.271+0000 7f5754635700 1 -- 172.21.15.84:0/1911988253 shutdown_connections 2023-08-31T02:00:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.271+0000 7f5754635700 1 -- 172.21.15.84:0/1911988253 wait complete. 2023-08-31T02:00:43.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5754635700 1 Processor -- start 2023-08-31T02:00:43.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5754635700 1 -- start start 2023-08-31T02:00:43.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5754635700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f574c0ca100 0x7f574c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5754635700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15b790 0x7f574c0c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5754635700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f574c15bce0 0x7f574c0c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5754635700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0c2af0 con 0x7f574c15b790 2023-08-31T02:00:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5754635700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0c3310 con 0x7f574c15bce0 2023-08-31T02:00:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5754635700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0c35f0 con 0x7f574c0ca100 2023-08-31T02:00:43.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5751bd0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15b790 0x7f574c0c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5751bd0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15b790 0x7f574c0c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52418/0 (socket says 172.21.15.84:52418) 2023-08-31T02:00:43.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.273+0000 7f5751bd0700 1 -- 172.21.15.84:0/1351894994 learned_addr learned my addr 172.21.15.84:0/1351894994 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:43.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5752bd2700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f574c15bce0 0x7f574c0c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f57523d1700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f574c0ca100 0x7f574c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5751bd0700 1 -- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f574c0ca100 msgr2=0x7f574c14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5751bd0700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f574c0ca100 0x7f574c14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5751bd0700 1 -- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f574c15bce0 msgr2=0x7f574c0c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5751bd0700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f574c15bce0 0x7f574c0c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5751bd0700 1 -- 172.21.15.84:0/1351894994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009520 con 0x7f574c15b790 2023-08-31T02:00:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f57523d1700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f574c0ca100 0x7f574c14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5751bd0700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15b790 0x7f574c0c40d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5748009810 tx=0x7f574800f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5742ffd700 1 -- 172.21.15.84:0/1351894994 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574801b040 con 0x7f574c15b790 2023-08-31T02:00:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5742ffd700 1 -- 172.21.15.84:0/1351894994 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f574801f420 con 0x7f574c15b790 2023-08-31T02:00:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c0c38d0 con 0x7f574c15b790 2023-08-31T02:00:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5742ffd700 1 -- 172.21.15.84:0/1351894994 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574801f830 con 0x7f574c15b790 2023-08-31T02:00:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.274+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c0c4610 con 0x7f574c15b790 2023-08-31T02:00:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.275+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574c0c3df0 con 0x7f574c15b790 2023-08-31T02:00:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.275+0000 7f5742ffd700 1 -- 172.21.15.84:0/1351894994 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f574801f990 con 0x7f574c15b790 2023-08-31T02:00:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.276+0000 7f5742ffd700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f573006a0e0 0x7f573006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.276+0000 7f5742ffd700 1 -- 172.21.15.84:0/1351894994 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f574808ac70 con 0x7f574c15b790 2023-08-31T02:00:43.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.276+0000 7f57523d1700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f573006a0e0 0x7f573006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.276+0000 7f57523d1700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f573006a0e0 0x7f573006c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f573c007900 tx=0x7f573c008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:43.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.280+0000 7f5742ffd700 1 -- 172.21.15.84:0/1351894994 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f574c0c3df0 con 0x7f574c15b790 2023-08-31T02:00:43.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.472+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f574c0c3df0 con 0x7f574c15b790 2023-08-31T02:00:43.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.472+0000 7f5742ffd700 1 -- 172.21.15.84:0/1351894994 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f574c0c3df0 con 0x7f574c15b790 2023-08-31T02:00:43.465 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:43.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f573006a0e0 msgr2=0x7f573006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f573006a0e0 0x7f573006c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f573c007900 tx=0x7f573c008040 comp rx=0 tx=0).stop 2023-08-31T02:00:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15b790 msgr2=0x7f574c0c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15b790 0x7f574c0c40d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5748009810 tx=0x7f574800f8a0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 shutdown_connections 2023-08-31T02:00:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f573006a0e0 0x7f573006c5a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f574c15bce0 0x7f574c0c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f574c0ca100 0x7f574c14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 --2- 172.21.15.84:0/1351894994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f574c15b790 0x7f574c0c40d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 >> 172.21.15.84:0/1351894994 conn(0x7f574c0afb00 msgr2=0x7f574c0ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:43.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 shutdown_connections 2023-08-31T02:00:43.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.474+0000 7f5754635700 1 -- 172.21.15.84:0/1351894994 wait complete. 2023-08-31T02:00:43.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:43.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.611+0000 7f0ee47e5700 1 -- 172.21.15.84:0/2443760249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0edc15d750 msgr2=0x7f0edc0cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.611+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/2443760249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0edc15d750 0x7f0edc0cb360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009f60 tx=0x7f0ed4009f90 comp rx=0 tx=0).stop 2023-08-31T02:00:43.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.612+0000 7f0ee47e5700 1 -- 172.21.15.84:0/2443760249 shutdown_connections 2023-08-31T02:00:43.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.612+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/2443760249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0edc15d750 0x7f0edc0cb360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.612+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/2443760249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0edc0cd3f0 0x7f0edc0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.612+0000 7f0ee47e5700 1 -- 172.21.15.84:0/2443760249 >> 172.21.15.84:0/2443760249 conn(0x7f0edc0b0c40 msgr2=0x7f0edc0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:43.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.612+0000 7f0ee47e5700 1 -- 172.21.15.84:0/2443760249 shutdown_connections 2023-08-31T02:00:43.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.612+0000 7f0ee47e5700 1 -- 172.21.15.84:0/2443760249 wait complete. 2023-08-31T02:00:43.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.613+0000 7f0ee47e5700 1 Processor -- start 2023-08-31T02:00:43.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.613+0000 7f0ee47e5700 1 -- start start 2023-08-31T02:00:43.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee47e5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0edc0cd3f0 0x7f0edc1e44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee47e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0edc159320 0x7f0edc1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee47e5700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0edc15d750 0x7f0edc06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee47e5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc1e52f0 con 0x7f0edc159320 2023-08-31T02:00:43.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee47e5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc1e4d30 con 0x7f0edc0cd3f0 2023-08-31T02:00:43.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee47e5700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc1e5010 con 0x7f0edc15d750 2023-08-31T02:00:43.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0edc159320 0x7f0edc1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0edc159320 0x7f0edc1584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52432/0 (socket says 172.21.15.84:52432) 2023-08-31T02:00:43.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 -- 172.21.15.84:0/1673808230 learned_addr learned my addr 172.21.15.84:0/1673808230 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:43.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee2581700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0edc0cd3f0 0x7f0edc1e44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee2d82700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0edc15d750 0x7f0edc06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 -- 172.21.15.84:0/1673808230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0edc15d750 msgr2=0x7f0edc06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0edc15d750 0x7f0edc06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 -- 172.21.15.84:0/1673808230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0edc0cd3f0 msgr2=0x7f0edc1e44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0edc0cd3f0 0x7f0edc1e44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 -- 172.21.15.84:0/1673808230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009520 con 0x7f0edc159320 2023-08-31T02:00:43.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee1d80700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0edc159320 0x7f0edc1584a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800eb30 tx=0x7f0ed800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:43.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ed2ffd700 1 -- 172.21.15.84:0/1673808230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8009880 con 0x7f0edc159320 2023-08-31T02:00:43.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ed2ffd700 1 -- 172.21.15.84:0/1673808230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ed800cbd0 con 0x7f0edc159320 2023-08-31T02:00:43.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4009c40 con 0x7f0edc159320 2023-08-31T02:00:43.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ed2ffd700 1 -- 172.21.15.84:0/1673808230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8004020 con 0x7f0edc159320 2023-08-31T02:00:43.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.614+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc06b7c0 con 0x7f0edc159320 2023-08-31T02:00:43.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.615+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0edc06bb30 con 0x7f0edc159320 2023-08-31T02:00:43.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.616+0000 7f0ed2ffd700 1 -- 172.21.15.84:0/1673808230 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ed8004180 con 0x7f0edc159320 2023-08-31T02:00:43.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.616+0000 7f0ed2ffd700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ec006a0e0 0x7f0ec006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.616+0000 7f0ed2ffd700 1 -- 172.21.15.84:0/1673808230 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f0ed8014070 con 0x7f0edc159320 2023-08-31T02:00:43.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.616+0000 7f0ee2581700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ec006a0e0 0x7f0ec006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.617+0000 7f0ee2581700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ec006a0e0 0x7f0ec006c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc004740 tx=0x7f0ecc007f40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:43.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.620+0000 7f0ed2ffd700 1 -- 172.21.15.84:0/1673808230 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ed8054630 con 0x7f0edc159320 2023-08-31T02:00:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.808+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0edc04e7c0 con 0x7f0edc159320 2023-08-31T02:00:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.808+0000 7f0ed2ffd700 1 -- 172.21.15.84:0/1673808230 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ed8057c50 con 0x7f0edc159320 2023-08-31T02:00:43.801 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ec006a0e0 msgr2=0x7f0ec006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ec006a0e0 0x7f0ec006c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc004740 tx=0x7f0ecc007f40 comp rx=0 tx=0).stop 2023-08-31T02:00:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0edc159320 msgr2=0x7f0edc1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0edc159320 0x7f0edc1584a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800eb30 tx=0x7f0ed800ee40 comp rx=0 tx=0).stop 2023-08-31T02:00:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 shutdown_connections 2023-08-31T02:00:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ec006a0e0 0x7f0ec006c5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0edc15d750 0x7f0edc06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0edc0cd3f0 0x7f0edc1e44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 --2- 172.21.15.84:0/1673808230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0edc159320 0x7f0edc1584a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 >> 172.21.15.84:0/1673808230 conn(0x7f0edc0b0c40 msgr2=0x7f0edc0cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:43.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 shutdown_connections 2023-08-31T02:00:43.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.810+0000 7f0ee47e5700 1 -- 172.21.15.84:0/1673808230 wait complete. 2023-08-31T02:00:43.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.947+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/419176953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 msgr2=0x7f4a640b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.947+0000 7f4a6b1c6700 1 --2- 172.21.15.84:0/419176953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 0x7f4a640b0620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4a500098c0 tx=0x7f4a50009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.947+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/419176953 shutdown_connections 2023-08-31T02:00:43.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.947+0000 7f4a6b1c6700 1 --2- 172.21.15.84:0/419176953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 0x7f4a640b0620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.947+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/419176953 >> 172.21.15.84:0/419176953 conn(0x7f4a640afb00 msgr2=0x7f4a640aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:43.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.947+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/419176953 shutdown_connections 2023-08-31T02:00:43.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.947+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/419176953 wait complete. 2023-08-31T02:00:43.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.948+0000 7f4a6b1c6700 1 Processor -- start 2023-08-31T02:00:43.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.948+0000 7f4a6b1c6700 1 -- start start 2023-08-31T02:00:43.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a6b1c6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 0x7f4a641e1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a6b1c6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a640b23e0 0x7f4a640ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a6b1c6700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a641593b0 0x7f4a641e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a6b1c6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a640cd4c0 con 0x7f4a6406db90 2023-08-31T02:00:43.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a6b1c6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a641e2ae0 con 0x7f4a640b23e0 2023-08-31T02:00:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a6b1c6700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a640ab420 con 0x7f4a641593b0 2023-08-31T02:00:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 0x7f4a641e1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 0x7f4a641e1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52444/0 (socket says 172.21.15.84:52444) 2023-08-31T02:00:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 -- 172.21.15.84:0/3659083356 learned_addr learned my addr 172.21.15.84:0/3659083356 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a63fff700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a640b23e0 0x7f4a640ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a69763700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a641593b0 0x7f4a641e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 -- 172.21.15.84:0/3659083356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a641593b0 msgr2=0x7f4a641e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a641593b0 0x7f4a641e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 -- 172.21.15.84:0/3659083356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a640b23e0 msgr2=0x7f4a640ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a640b23e0 0x7f4a640ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 -- 172.21.15.84:0/3659083356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50009520 con 0x7f4a6406db90 2023-08-31T02:00:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a68f62700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 0x7f4a641e1960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800c430 tx=0x7f4a5800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a617fa700 1 -- 172.21.15.84:0/3659083356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58004230 con 0x7f4a6406db90 2023-08-31T02:00:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a617fa700 1 -- 172.21.15.84:0/3659083356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4a580044a0 con 0x7f4a6406db90 2023-08-31T02:00:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a617fa700 1 -- 172.21.15.84:0/3659083356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a580038e0 con 0x7f4a6406db90 2023-08-31T02:00:43.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a640abc80 con 0x7f4a6406db90 2023-08-31T02:00:43.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.949+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a640ab630 con 0x7f4a6406db90 2023-08-31T02:00:43.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.950+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a64070450 con 0x7f4a6406db90 2023-08-31T02:00:43.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.951+0000 7f4a617fa700 1 -- 172.21.15.84:0/3659083356 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4a58003a40 con 0x7f4a6406db90 2023-08-31T02:00:43.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.951+0000 7f4a617fa700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4a4806a0e0 0x7f4a4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:43.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.951+0000 7f4a617fa700 1 -- 172.21.15.84:0/3659083356 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4a58087e30 con 0x7f4a6406db90 2023-08-31T02:00:43.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.951+0000 7f4a63fff700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4a4806a0e0 0x7f4a4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:43.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.952+0000 7f4a63fff700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4a4806a0e0 0x7f4a4806c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009230 tx=0x7f4a50019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:43.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:43.956+0000 7f4a617fa700 1 -- 172.21.15.84:0/3659083356 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4a58053210 con 0x7f4a6406db90 2023-08-31T02:00:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.145+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a6404e7c0 con 0x7f4a6406db90 2023-08-31T02:00:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.145+0000 7f4a617fa700 1 -- 172.21.15.84:0/3659083356 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a58056830 con 0x7f4a6406db90 2023-08-31T02:00:44.140 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4a4806a0e0 msgr2=0x7f4a4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4a4806a0e0 0x7f4a4806c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009230 tx=0x7f4a50019040 comp rx=0 tx=0).stop 2023-08-31T02:00:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 msgr2=0x7f4a641e1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 0x7f4a641e1960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800c430 tx=0x7f4a5800c7f0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 shutdown_connections 2023-08-31T02:00:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4a4806a0e0 0x7f4a4806c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a641593b0 0x7f4a641e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6406db90 0x7f4a641e1960 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 --2- 172.21.15.84:0/3659083356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a640b23e0 0x7f4a640ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 >> 172.21.15.84:0/3659083356 conn(0x7f4a640afb00 msgr2=0x7f4a641583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:44.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 shutdown_connections 2023-08-31T02:00:44.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.147+0000 7f4a6b1c6700 1 -- 172.21.15.84:0/3659083356 wait complete. 2023-08-31T02:00:44.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:44.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.284+0000 7f23cfc24700 1 -- 172.21.15.84:0/1636498817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c80cd3f0 msgr2=0x7f23c80b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.284+0000 7f23cfc24700 1 --2- 172.21.15.84:0/1636498817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c80cd3f0 0x7f23c80b0020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f23c80cdf30 tx=0x7f23b8009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.284+0000 7f23cfc24700 1 -- 172.21.15.84:0/1636498817 shutdown_connections 2023-08-31T02:00:44.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.284+0000 7f23cfc24700 1 --2- 172.21.15.84:0/1636498817 >> v2:172.21.15.170:3300/0 conn(0x7f23c815d750 0x7f23c80cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.284+0000 7f23cfc24700 1 --2- 172.21.15.84:0/1636498817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c80cd3f0 0x7f23c80b0020 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.284+0000 7f23cfc24700 1 -- 172.21.15.84:0/1636498817 >> 172.21.15.84:0/1636498817 conn(0x7f23c80b0c40 msgr2=0x7f23c80b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:44.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.284+0000 7f23cfc24700 1 -- 172.21.15.84:0/1636498817 shutdown_connections 2023-08-31T02:00:44.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.284+0000 7f23cfc24700 1 -- 172.21.15.84:0/1636498817 wait complete. 2023-08-31T02:00:44.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.285+0000 7f23cfc24700 1 Processor -- start 2023-08-31T02:00:44.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.285+0000 7f23cfc24700 1 -- start start 2023-08-31T02:00:44.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23cfc24700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c80cd3f0 0x7f23c80c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:44.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23cfc24700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c8159320 0x7f23c81e2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:44.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23cfc24700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c815d750 0x7f23c81e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:44.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23cfc24700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8159b10 con 0x7f23c815d750 2023-08-31T02:00:44.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23cfc24700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c81efdb0 con 0x7f23c8159320 2023-08-31T02:00:44.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23cfc24700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c81f0090 con 0x7f23c80cd3f0 2023-08-31T02:00:44.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23ce1c1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c815d750 0x7f23c81e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:44.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23ce1c1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c815d750 0x7f23c81e30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52462/0 (socket says 172.21.15.84:52462) 2023-08-31T02:00:44.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23ce1c1700 1 -- 172.21.15.84:0/671305997 learned_addr learned my addr 172.21.15.84:0/671305997 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:44.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23cd1bf700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c8159320 0x7f23c81e2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:44.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23ce1c1700 1 -- 172.21.15.84:0/671305997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c80cd3f0 msgr2=0x7f23c80c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23ce1c1700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c80cd3f0 0x7f23c80c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23ce1c1700 1 -- 172.21.15.84:0/671305997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c8159320 msgr2=0x7f23c81e2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23ce1c1700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c8159320 0x7f23c81e2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23ce1c1700 1 -- 172.21.15.84:0/671305997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8009520 con 0x7f23c815d750 2023-08-31T02:00:44.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.286+0000 7f23cd1bf700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c8159320 0x7f23c81e2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:44.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.287+0000 7f23ce1c1700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c815d750 0x7f23c81e30a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f23c0007c60 tx=0x7f23c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:44.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.287+0000 7f23be7fc700 1 -- 172.21.15.84:0/671305997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0017070 con 0x7f23c815d750 2023-08-31T02:00:44.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.287+0000 7f23be7fc700 1 -- 172.21.15.84:0/671305997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f23c000f040 con 0x7f23c815d750 2023-08-31T02:00:44.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.287+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c81f0370 con 0x7f23c815d750 2023-08-31T02:00:44.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.287+0000 7f23be7fc700 1 -- 172.21.15.84:0/671305997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000de30 con 0x7f23c815d750 2023-08-31T02:00:44.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.287+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c81f0930 con 0x7f23c815d750 2023-08-31T02:00:44.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.288+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c815c640 con 0x7f23c815d750 2023-08-31T02:00:44.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.288+0000 7f23be7fc700 1 -- 172.21.15.84:0/671305997 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f23c001c410 con 0x7f23c815d750 2023-08-31T02:00:44.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.289+0000 7f23be7fc700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f23ac06a0e0 0x7f23ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:44.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.289+0000 7f23cd9c0700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f23ac06a0e0 0x7f23ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:44.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.289+0000 7f23be7fc700 1 -- 172.21.15.84:0/671305997 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f23c0088570 con 0x7f23c815d750 2023-08-31T02:00:44.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.289+0000 7f23cd9c0700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f23ac06a0e0 0x7f23ac06c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23c40011e0 tx=0x7f23c4007970 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:44.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.293+0000 7f23be7fc700 1 -- 172.21.15.84:0/671305997 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f23c0057340 con 0x7f23c815d750 2023-08-31T02:00:44.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.481+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f23c804e7c0 con 0x7f23c815d750 2023-08-31T02:00:44.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.482+0000 7f23be7fc700 1 -- 172.21.15.84:0/671305997 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f23c001f110 con 0x7f23c815d750 2023-08-31T02:00:44.475 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:44.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f23ac06a0e0 msgr2=0x7f23ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f23ac06a0e0 0x7f23ac06c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23c40011e0 tx=0x7f23c4007970 comp rx=0 tx=0).stop 2023-08-31T02:00:44.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c815d750 msgr2=0x7f23c81e30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c815d750 0x7f23c81e30a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f23c0007c60 tx=0x7f23c000d3b0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 shutdown_connections 2023-08-31T02:00:44.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f23ac06a0e0 0x7f23ac06c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c815d750 0x7f23c81e30a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c80cd3f0 0x7f23c80c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 --2- 172.21.15.84:0/671305997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c8159320 0x7f23c81e2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 >> 172.21.15.84:0/671305997 conn(0x7f23c80b0c40 msgr2=0x7f23c80b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:44.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 shutdown_connections 2023-08-31T02:00:44.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.484+0000 7f23cfc24700 1 -- 172.21.15.84:0/671305997 wait complete. 2023-08-31T02:00:44.511 INFO:tasks.cephfs_test_runner:Starting test: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test: 2023-08-31T02:00:44.512 INFO:tasks.cephfs_test_runner:test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T02:00:44.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2023-08-31T02:00:44.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 -- 172.21.15.84:0/2312411264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540ce570 msgr2=0x7fd7540b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/2312411264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540ce570 0x7fd7540b0bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd7540b17e0 tx=0x7fd744009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:44.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 -- 172.21.15.84:0/2312411264 shutdown_connections 2023-08-31T02:00:44.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/2312411264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7540af7b0 0x7fd7540b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/2312411264 >> v2:172.21.15.170:3300/0 conn(0x7fd7540af3d0 0x7fd75415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/2312411264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540ce570 0x7fd7540b0bb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 -- 172.21.15.84:0/2312411264 >> 172.21.15.84:0/2312411264 conn(0x7fd75406fca0 msgr2=0x7fd7540cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:44.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 -- 172.21.15.84:0/2312411264 shutdown_connections 2023-08-31T02:00:44.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.643+0000 7fd75a8f7700 1 -- 172.21.15.84:0/2312411264 wait complete. 2023-08-31T02:00:44.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.644+0000 7fd75a8f7700 1 Processor -- start 2023-08-31T02:00:44.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.644+0000 7fd75a8f7700 1 -- start start 2023-08-31T02:00:44.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd75a8f7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7540af3d0 0x7fd7540c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:44.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd75a8f7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540af7b0 0x7fd7541f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:44.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd75a8f7700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7540ce570 0x7fd754150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:44.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd75a8f7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541f5de0 con 0x7fd7540af7b0 2023-08-31T02:00:44.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd75a8f7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd754151870 con 0x7fd7540af3d0 2023-08-31T02:00:44.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd75a8f7700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75406d240 con 0x7fd7540ce570 2023-08-31T02:00:44.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd7537fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540af7b0 0x7fd7541f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:44.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd7537fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540af7b0 0x7fd7541f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52472/0 (socket says 172.21.15.84:52472) 2023-08-31T02:00:44.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.645+0000 7fd7537fe700 1 -- 172.21.15.84:0/1917502728 learned_addr learned my addr 172.21.15.84:0/1917502728 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:44.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd753fff700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7540af3d0 0x7fd7540c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:44.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd758e94700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7540ce570 0x7fd754150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:44.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd7537fe700 1 -- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7540ce570 msgr2=0x7fd754150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd7537fe700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7540ce570 0x7fd754150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd7537fe700 1 -- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7540af3d0 msgr2=0x7fd7540c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:44.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd7537fe700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7540af3d0 0x7fd7540c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:44.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd7537fe700 1 -- 172.21.15.84:0/1917502728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7440095f0 con 0x7fd7540af7b0 2023-08-31T02:00:44.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd753fff700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7540af3d0 0x7fd7540c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:44.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd7537fe700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540af7b0 0x7fd7541f58a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd7540b1be0 tx=0x7fd744004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:44.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd750ff9700 1 -- 172.21.15.84:0/1917502728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74401d070 con 0x7fd7540af7b0 2023-08-31T02:00:44.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd750ff9700 1 -- 172.21.15.84:0/1917502728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd744003890 con 0x7fd7540af7b0 2023-08-31T02:00:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd750ff9700 1 -- 172.21.15.84:0/1917502728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744003c60 con 0x7fd7540af7b0 2023-08-31T02:00:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7540c7bc0 con 0x7fd7540af7b0 2023-08-31T02:00:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.646+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7540c8180 con 0x7fd7540af7b0 2023-08-31T02:00:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.647+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75404e7c0 con 0x7fd7540af7b0 2023-08-31T02:00:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.647+0000 7fd750ff9700 1 -- 172.21.15.84:0/1917502728 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd74400f460 con 0x7fd7540af7b0 2023-08-31T02:00:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.648+0000 7fd750ff9700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd74006a0e0 0x7fd74006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.648+0000 7fd750ff9700 1 -- 172.21.15.84:0/1917502728 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fd74408a280 con 0x7fd7540af7b0 2023-08-31T02:00:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.648+0000 7fd753fff700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd74006a0e0 0x7fd74006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.648+0000 7fd753fff700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd74006a0e0 0x7fd74006c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd74800b9e0 tx=0x7fd748005c70 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:44.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.652+0000 7fd750ff9700 1 -- 172.21.15.84:0/1917502728 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd7440555c0 con 0x7fd7540af7b0 2023-08-31T02:00:44.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:44.919+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7fd7540b00a0 con 0x7fd7540af7b0 2023-08-31T02:00:45.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.322+0000 7fd750ff9700 1 -- 172.21.15.84:0/1917502728 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v68) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd744058be0 con 0x7fd7540af7b0 2023-08-31T02:00:45.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd74006a0e0 msgr2=0x7fd74006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd74006a0e0 0x7fd74006c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd74800b9e0 tx=0x7fd748005c70 comp rx=0 tx=0).stop 2023-08-31T02:00:45.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540af7b0 msgr2=0x7fd7541f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540af7b0 0x7fd7541f58a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd7540b1be0 tx=0x7fd744004310 comp rx=0 tx=0).stop 2023-08-31T02:00:45.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 shutdown_connections 2023-08-31T02:00:45.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd74006a0e0 0x7fd74006c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7540ce570 0x7fd754150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7540af3d0 0x7fd7540c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 --2- 172.21.15.84:0/1917502728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7540af7b0 0x7fd7541f58a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.324+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 >> 172.21.15.84:0/1917502728 conn(0x7fd75406fca0 msgr2=0x7fd754153650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:45.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.325+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 shutdown_connections 2023-08-31T02:00:45.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.325+0000 7fd75a8f7700 1 -- 172.21.15.84:0/1917502728 wait complete. 2023-08-31T02:00:45.329 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-08-31T02:00:45.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 -- 172.21.15.84:0/4287932289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380707c0 msgr2=0x7fc038070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/4287932289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380707c0 0x7fc038070bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc0380cb510 tx=0x7fc03000b380 comp rx=0 tx=0).stop 2023-08-31T02:00:45.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 -- 172.21.15.84:0/4287932289 shutdown_connections 2023-08-31T02:00:45.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/4287932289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380707c0 0x7fc038070bf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/4287932289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc038158220 0x7fc0380cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/4287932289 >> v2:172.21.15.170:3300/0 conn(0x7fc0380b0df0 0x7fc0380c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 -- 172.21.15.84:0/4287932289 >> 172.21.15.84:0/4287932289 conn(0x7fc0380caa20 msgr2=0x7fc0380cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:45.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 -- 172.21.15.84:0/4287932289 shutdown_connections 2023-08-31T02:00:45.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.459+0000 7fc03fe0f700 1 -- 172.21.15.84:0/4287932289 wait complete. 2023-08-31T02:00:45.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.461+0000 7fc03fe0f700 1 Processor -- start 2023-08-31T02:00:45.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.461+0000 7fc03fe0f700 1 -- start start 2023-08-31T02:00:45.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.461+0000 7fc03fe0f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380707c0 0x7fc03806a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:45.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03fe0f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b0df0 0x7fc0380c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:45.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03fe0f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc038158220 0x7fc0380c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:45.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03fe0f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381ef860 con 0x7fc038158220 2023-08-31T02:00:45.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03fe0f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc038148ca0 con 0x7fc0380707c0 2023-08-31T02:00:45.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03fe0f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc038148f80 con 0x7fc0380b0df0 2023-08-31T02:00:45.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc038158220 0x7fc0380c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:45.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc038158220 0x7fc0380c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52488/0 (socket says 172.21.15.84:52488) 2023-08-31T02:00:45.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 -- 172.21.15.84:0/918612661 learned_addr learned my addr 172.21.15.84:0/918612661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:45.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03d3aa700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b0df0 0x7fc0380c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:45.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 -- 172.21.15.84:0/918612661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b0df0 msgr2=0x7fc0380c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b0df0 0x7fc0380c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03dbab700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380707c0 0x7fc03806a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:45.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 -- 172.21.15.84:0/918612661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380707c0 msgr2=0x7fc03806a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380707c0 0x7fc03806a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 -- 172.21.15.84:0/918612661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030009d00 con 0x7fc038158220 2023-08-31T02:00:45.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03e3ac700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc038158220 0x7fc0380c8ca0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc0380cb860 tx=0x7fc030007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:45.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc02e7fc700 1 -- 172.21.15.84:0/918612661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000e040 con 0x7fc038158220 2023-08-31T02:00:45.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc02e7fc700 1 -- 172.21.15.84:0/918612661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc03001d890 con 0x7fc038158220 2023-08-31T02:00:45.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc02e7fc700 1 -- 172.21.15.84:0/918612661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03001dce0 con 0x7fc038158220 2023-08-31T02:00:45.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc038149260 con 0x7fc038158220 2023-08-31T02:00:45.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.462+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0380c7280 con 0x7fc038158220 2023-08-31T02:00:45.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.463+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03804e090 con 0x7fc038158220 2023-08-31T02:00:45.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.464+0000 7fc02e7fc700 1 -- 172.21.15.84:0/918612661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc03001b450 con 0x7fc038158220 2023-08-31T02:00:45.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.464+0000 7fc02e7fc700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc01c06a0e0 0x7fc01c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:45.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.464+0000 7fc03dbab700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc01c06a0e0 0x7fc01c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:45.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.464+0000 7fc02e7fc700 1 -- 172.21.15.84:0/918612661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fc03008aa10 con 0x7fc038158220 2023-08-31T02:00:45.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.465+0000 7fc03dbab700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc01c06a0e0 0x7fc01c06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc03400a810 tx=0x7fc034008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:45.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.469+0000 7fc02e7fc700 1 -- 172.21.15.84:0/918612661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc030055e70 con 0x7fc038158220 2023-08-31T02:00:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.661+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7fc03804e7c0 con 0x7fc038158220 2023-08-31T02:00:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.661+0000 7fc02e7fc700 1 -- 172.21.15.84:0/918612661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) v1 ==== 59+0+2250 (secure 0 0 0) 0x7fc0300218e0 con 0x7fc038158220 2023-08-31T02:00:45.654 INFO:teuthology.orchestra.run.smithi084.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-08-31T02:00:45.654 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_op_complaint_time 120 2023-08-31T02:00:45.655 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_complaint_time 180.000000 2023-08-31T02:00:45.655 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8251.217968 2023-08-31T02:00:45.655 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5010.418957 2023-08-31T02:00:45.655 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6240.387580 2023-08-31T02:00:45.656 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 6262.375406 2023-08-31T02:00:45.656 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7200.658284 2023-08-31T02:00:45.656 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 10666.382912 2023-08-31T02:00:45.656 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7445.907123 2023-08-31T02:00:45.656 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 7426.485554 2023-08-31T02:00:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds 20/20 2023-08-31T02:00:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds_balancer 20/20 2023-08-31T02:00:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_ms 1/1 2023-08-31T02:00:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_fragment_size_max 10000 2023-08-31T02:00:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_merge_size 5 2023-08-31T02:00:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_bits 3 2023-08-31T02:00:45.658 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_size 100 2023-08-31T02:00:45.658 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_frag true 2023-08-31T02:00:45.658 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_scatterstat true 2023-08-31T02:00:45.658 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_op_complaint_time 180.000000 2023-08-31T02:00:45.658 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_verify_scatter true 2023-08-31T02:00:45.659 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced osd_op_complaint_time 180.000000 2023-08-31T02:00:45.659 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_mon_op_timeout 900 2023-08-31T02:00:45.659 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_osd_op_timeout 900 2023-08-31T02:00:45.659 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced client_mount_timeout 600 2023-08-31T02:00:45.659 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_client 20/20 2023-08-31T02:00:45.660 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_ms 1/1 2023-08-31T02:00:45.660 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_mon_op_timeout 900 2023-08-31T02:00:45.660 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_osd_op_timeout 900 2023-08-31T02:00:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc01c06a0e0 msgr2=0x7fc01c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc01c06a0e0 0x7fc01c06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc03400a810 tx=0x7fc034008040 comp rx=0 tx=0).stop 2023-08-31T02:00:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc038158220 msgr2=0x7fc0380c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc038158220 0x7fc0380c8ca0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc0380cb860 tx=0x7fc030007c10 comp rx=0 tx=0).stop 2023-08-31T02:00:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 shutdown_connections 2023-08-31T02:00:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc01c06a0e0 0x7fc01c06c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc038158220 0x7fc0380c8ca0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380707c0 0x7fc03806a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 --2- 172.21.15.84:0/918612661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b0df0 0x7fc0380c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 >> 172.21.15.84:0/918612661 conn(0x7fc0380caa20 msgr2=0x7fc0380b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 shutdown_connections 2023-08-31T02:00:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.663+0000 7fc03fe0f700 1 -- 172.21.15.84:0/918612661 wait complete. 2023-08-31T02:00:45.668 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:45.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.797+0000 7f3d929b5700 1 -- 172.21.15.84:0/3420035941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c157d20 msgr2=0x7f3d8c0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.797+0000 7f3d929b5700 1 --2- 172.21.15.84:0/3420035941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c157d20 0x7f3d8c0b0d90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c005fd0 tx=0x7f3d7c009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.797+0000 7f3d929b5700 1 -- 172.21.15.84:0/3420035941 shutdown_connections 2023-08-31T02:00:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.797+0000 7f3d929b5700 1 --2- 172.21.15.84:0/3420035941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c157d20 0x7f3d8c0b0d90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.797+0000 7f3d929b5700 1 --2- 172.21.15.84:0/3420035941 >> v2:172.21.15.170:3300/0 conn(0x7f3d8c15c270 0x7f3d8c158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.797+0000 7f3d929b5700 1 -- 172.21.15.84:0/3420035941 >> 172.21.15.84:0/3420035941 conn(0x7f3d8c0ca920 msgr2=0x7f3d8c0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.797+0000 7f3d929b5700 1 -- 172.21.15.84:0/3420035941 shutdown_connections 2023-08-31T02:00:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.797+0000 7f3d929b5700 1 -- 172.21.15.84:0/3420035941 wait complete. 2023-08-31T02:00:45.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.798+0000 7f3d929b5700 1 Processor -- start 2023-08-31T02:00:45.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.799+0000 7f3d929b5700 1 -- start start 2023-08-31T02:00:45.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.799+0000 7f3d929b5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d8c157d20 0x7f3d8c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:45.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.799+0000 7f3d929b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c15c270 0x7f3d8c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:45.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.799+0000 7f3d929b5700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d8c0abee0 0x7f3d8c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:45.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.799+0000 7f3d929b5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0aba50 con 0x7f3d8c15c270 2023-08-31T02:00:45.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.799+0000 7f3d929b5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c155a80 con 0x7f3d8c157d20 2023-08-31T02:00:45.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.799+0000 7f3d929b5700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0aae40 con 0x7f3d8c0abee0 2023-08-31T02:00:45.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.799+0000 7f3d8b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c15c270 0x7f3d8c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:45.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c15c270 0x7f3d8c0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52500/0 (socket says 172.21.15.84:52500) 2023-08-31T02:00:45.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8b7fe700 1 -- 172.21.15.84:0/1779536793 learned_addr learned my addr 172.21.15.84:0/1779536793 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:45.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d90f52700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d8c0abee0 0x7f3d8c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:45.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8bfff700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d8c157d20 0x7f3d8c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:45.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8b7fe700 1 -- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d8c0abee0 msgr2=0x7f3d8c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8b7fe700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d8c0abee0 0x7f3d8c0712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8b7fe700 1 -- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d8c157d20 msgr2=0x7f3d8c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8b7fe700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d8c157d20 0x7f3d8c155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8b7fe700 1 -- 172.21.15.84:0/1779536793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c0095f0 con 0x7f3d8c15c270 2023-08-31T02:00:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8bfff700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d8c157d20 0x7f3d8c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d90f52700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d8c0abee0 0x7f3d8c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:45.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d8b7fe700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c15c270 0x7f3d8c0c4760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000b4a0 tx=0x7f3d8000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:45.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d88ff9700 1 -- 172.21.15.84:0/1779536793 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80011830 con 0x7f3d8c15c270 2023-08-31T02:00:45.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d88ff9700 1 -- 172.21.15.84:0/1779536793 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3d80011a80 con 0x7f3d8c15c270 2023-08-31T02:00:45.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0ab120 con 0x7f3d8c15c270 2023-08-31T02:00:45.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d88ff9700 1 -- 172.21.15.84:0/1779536793 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80011e90 con 0x7f3d8c15c270 2023-08-31T02:00:45.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.800+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c0ab6e0 con 0x7f3d8c15c270 2023-08-31T02:00:45.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.801+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c04e7c0 con 0x7f3d8c15c270 2023-08-31T02:00:45.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.802+0000 7f3d88ff9700 1 -- 172.21.15.84:0/1779536793 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d8001a400 con 0x7f3d8c15c270 2023-08-31T02:00:45.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.802+0000 7f3d88ff9700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:45.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.802+0000 7f3d88ff9700 1 -- 172.21.15.84:0/1779536793 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f3d800887c0 con 0x7f3d8c15c270 2023-08-31T02:00:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.802+0000 7f3d8bfff700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.802+0000 7f3d8bfff700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c06c7e0 tx=0x7f3d7c0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.806+0000 7f3d88ff9700 1 -- 172.21.15.84:0/1779536793 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3d80053c20 con 0x7f3d8c15c270 2023-08-31T02:00:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.998+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d8c0ade40 con 0x7f3d8c15c270 2023-08-31T02:00:45.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:45.999+0000 7f3d88ff9700 1 -- 172.21.15.84:0/1779536793 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f3d80057240 con 0x7f3d8c15c270 2023-08-31T02:00:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:45.992 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:45.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3d7806a0e0 msgr2=0x7f3d7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c06c7e0 tx=0x7f3d7c0047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c15c270 msgr2=0x7f3d8c0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:45.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c15c270 0x7f3d8c0c4760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000b4a0 tx=0x7f3d8000b860 comp rx=0 tx=0).stop 2023-08-31T02:00:45.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 shutdown_connections 2023-08-31T02:00:45.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3d7806a0e0 0x7f3d7806c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d8c0abee0 0x7f3d8c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d8c157d20 0x7f3d8c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 --2- 172.21.15.84:0/1779536793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d8c15c270 0x7f3d8c0c4760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:45.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 >> 172.21.15.84:0/1779536793 conn(0x7f3d8c0ca920 msgr2=0x7f3d8c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:45.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 shutdown_connections 2023-08-31T02:00:45.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.001+0000 7f3d929b5700 1 -- 172.21.15.84:0/1779536793 wait complete. 2023-08-31T02:00:46.006 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:46.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.140+0000 7fd0f779c700 1 -- 172.21.15.84:0/2306327509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 msgr2=0x7fd0f00b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.140+0000 7fd0f779c700 1 --2- 172.21.15.84:0/2306327509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 0x7fd0f00b0020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00b1c90 tx=0x7fd0ec009ba0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.140+0000 7fd0f779c700 1 -- 172.21.15.84:0/2306327509 shutdown_connections 2023-08-31T02:00:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.140+0000 7fd0f779c700 1 --2- 172.21.15.84:0/2306327509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 0x7fd0f00b0020 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.140+0000 7fd0f779c700 1 --2- 172.21.15.84:0/2306327509 >> v2:172.21.15.170:3300/0 conn(0x7fd0f015d750 0x7fd0f00ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.140+0000 7fd0f779c700 1 -- 172.21.15.84:0/2306327509 >> 172.21.15.84:0/2306327509 conn(0x7fd0f00b0c40 msgr2=0x7fd0f00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.140+0000 7fd0f779c700 1 -- 172.21.15.84:0/2306327509 shutdown_connections 2023-08-31T02:00:46.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.140+0000 7fd0f779c700 1 -- 172.21.15.84:0/2306327509 wait complete. 2023-08-31T02:00:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.141+0000 7fd0f779c700 1 Processor -- start 2023-08-31T02:00:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.141+0000 7fd0f779c700 1 -- start start 2023-08-31T02:00:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f779c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0f00cd220 0x7fd0f006b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f779c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 0x7fd0f006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f779c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0f015d750 0x7fd0f0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f779c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f0159af0 con 0x7fd0f0159320 2023-08-31T02:00:46.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f779c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f006cb00 con 0x7fd0f015d750 2023-08-31T02:00:46.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f779c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f006bef0 con 0x7fd0f00cd220 2023-08-31T02:00:46.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f4d37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 0x7fd0f006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f4d37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 0x7fd0f006cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52514/0 (socket says 172.21.15.84:52514) 2023-08-31T02:00:46.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f4d37700 1 -- 172.21.15.84:0/410456213 learned_addr learned my addr 172.21.15.84:0/410456213 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f5538700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0f00cd220 0x7fd0f006b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f5d39700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0f015d750 0x7fd0f0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f4d37700 1 -- 172.21.15.84:0/410456213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0f00cd220 msgr2=0x7fd0f006b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.142+0000 7fd0f4d37700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0f00cd220 0x7fd0f006b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0f4d37700 1 -- 172.21.15.84:0/410456213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0f015d750 msgr2=0x7fd0f0159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0f4d37700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0f015d750 0x7fd0f0159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0f4d37700 1 -- 172.21.15.84:0/410456213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec009520 con 0x7fd0f0159320 2023-08-31T02:00:46.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0f4d37700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 0x7fd0f006cf90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000e9f0 tx=0x7fd0e000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:46.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0e5ffb700 1 -- 172.21.15.84:0/410456213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0009610 con 0x7fd0f0159320 2023-08-31T02:00:46.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0e5ffb700 1 -- 172.21.15.84:0/410456213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd0e000cab0 con 0x7fd0f0159320 2023-08-31T02:00:46.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f006c1d0 con 0x7fd0f0159320 2023-08-31T02:00:46.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0e5ffb700 1 -- 172.21.15.84:0/410456213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000cea0 con 0x7fd0f0159320 2023-08-31T02:00:46.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.143+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f006c790 con 0x7fd0f0159320 2023-08-31T02:00:46.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.144+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f006ccb0 con 0x7fd0f0159320 2023-08-31T02:00:46.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.144+0000 7fd0e5ffb700 1 -- 172.21.15.84:0/410456213 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd0e0010430 con 0x7fd0f0159320 2023-08-31T02:00:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.145+0000 7fd0e5ffb700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0d406a0e0 0x7fd0d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.145+0000 7fd0e5ffb700 1 -- 172.21.15.84:0/410456213 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fd0e0014070 con 0x7fd0f0159320 2023-08-31T02:00:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.145+0000 7fd0f5538700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0d406a0e0 0x7fd0d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.145+0000 7fd0f5538700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0d406a0e0 0x7fd0d406c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec000c00 tx=0x7fd0ec019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:46.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.149+0000 7fd0e5ffb700 1 -- 172.21.15.84:0/410456213 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd0e0051990 con 0x7fd0f0159320 2023-08-31T02:00:46.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.337+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0f004e7c0 con 0x7fd0f0159320 2023-08-31T02:00:46.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.338+0000 7fd0e5ffb700 1 -- 172.21.15.84:0/410456213 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0f006ccb0 con 0x7fd0f0159320 2023-08-31T02:00:46.331 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:46.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0d406a0e0 msgr2=0x7fd0d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0d406a0e0 0x7fd0d406c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec000c00 tx=0x7fd0ec019040 comp rx=0 tx=0).stop 2023-08-31T02:00:46.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 msgr2=0x7fd0f006cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 0x7fd0f006cf90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000e9f0 tx=0x7fd0e000ed00 comp rx=0 tx=0).stop 2023-08-31T02:00:46.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 shutdown_connections 2023-08-31T02:00:46.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd0d406a0e0 0x7fd0d406c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0f015d750 0x7fd0f0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0f00cd220 0x7fd0f006b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 --2- 172.21.15.84:0/410456213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f0159320 0x7fd0f006cf90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 >> 172.21.15.84:0/410456213 conn(0x7fd0f00b0c40 msgr2=0x7fd0f00b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:46.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 shutdown_connections 2023-08-31T02:00:46.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.340+0000 7fd0f779c700 1 -- 172.21.15.84:0/410456213 wait complete. 2023-08-31T02:00:46.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:46.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.477+0000 7f20e774f700 1 -- 172.21.15.84:0/974892102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20cc003a30 msgr2=0x7f20cc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.477+0000 7f20e774f700 1 --2- 172.21.15.84:0/974892102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20cc003a30 0x7f20cc003e50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00bbc0 tx=0x7f20cc005880 comp rx=0 tx=0).stop 2023-08-31T02:00:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.477+0000 7f20e5cec700 1 -- 172.21.15.84:0/974892102 reap_dead start 2023-08-31T02:00:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.477+0000 7f20e774f700 1 -- 172.21.15.84:0/974892102 shutdown_connections 2023-08-31T02:00:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.477+0000 7f20e774f700 1 -- 172.21.15.84:0/974892102 >> 172.21.15.84:0/974892102 conn(0x7f20e00afb00 msgr2=0x7f20e00aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.477+0000 7f20e774f700 1 -- 172.21.15.84:0/974892102 shutdown_connections 2023-08-31T02:00:46.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.477+0000 7f20e774f700 1 -- 172.21.15.84:0/974892102 wait complete. 2023-08-31T02:00:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e774f700 1 Processor -- start 2023-08-31T02:00:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e774f700 1 -- start start 2023-08-31T02:00:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e774f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20cc003a30 0x7f20e01e4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e774f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20e00c7ae0 0x7f20e00c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e774f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20e01e3730 0x7f20e01e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e774f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e01e40f0 con 0x7f20e01e3730 2023-08-31T02:00:46.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e774f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00c2db0 con 0x7f20cc003a30 2023-08-31T02:00:46.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e774f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00c21a0 con 0x7f20e00c7ae0 2023-08-31T02:00:46.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e5cec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20e01e3730 0x7f20e01e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e5cec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20e01e3730 0x7f20e01e3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52536/0 (socket says 172.21.15.84:52536) 2023-08-31T02:00:46.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.479+0000 7f20e5cec700 1 -- 172.21.15.84:0/2799183225 learned_addr learned my addr 172.21.15.84:0/2799183225 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e4cea700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20e00c7ae0 0x7f20e00c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e5cec700 1 -- 172.21.15.84:0/2799183225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20e00c7ae0 msgr2=0x7f20e00c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e54eb700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20cc003a30 0x7f20e01e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e5cec700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20e00c7ae0 0x7f20e00c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e5cec700 1 -- 172.21.15.84:0/2799183225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20cc003a30 msgr2=0x7f20e01e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e5cec700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20cc003a30 0x7f20e01e4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e5cec700 1 -- 172.21.15.84:0/2799183225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00c2480 con 0x7f20e01e3730 2023-08-31T02:00:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e5cec700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20e01e3730 0x7f20e01e3bb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f20d8000f80 tx=0x7f20d80018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20d5ffb700 1 -- 172.21.15.84:0/2799183225 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8011660 con 0x7f20e01e3730 2023-08-31T02:00:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20d5ffb700 1 -- 172.21.15.84:0/2799183225 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f20d80118b0 con 0x7f20e01e3730 2023-08-31T02:00:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20d5ffb700 1 -- 172.21.15.84:0/2799183225 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8011cc0 con 0x7f20e01e3730 2023-08-31T02:00:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e00c2760 con 0x7f20e01e3730 2023-08-31T02:00:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.480+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e00c7f60 con 0x7f20e01e3730 2023-08-31T02:00:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.481+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e00c2f60 con 0x7f20e01e3730 2023-08-31T02:00:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.481+0000 7f20d5ffb700 1 -- 172.21.15.84:0/2799183225 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f20d801c460 con 0x7f20e01e3730 2023-08-31T02:00:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.482+0000 7f20d5ffb700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f20c406a0e0 0x7f20c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.482+0000 7f20d5ffb700 1 -- 172.21.15.84:0/2799183225 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f20d8089120 con 0x7f20e01e3730 2023-08-31T02:00:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.482+0000 7f20e54eb700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f20c406a0e0 0x7f20c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.482+0000 7f20e54eb700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f20c406a0e0 0x7f20c406c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f20dc012040 tx=0x7f20dc004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.486+0000 7f20d5ffb700 1 -- 172.21.15.84:0/2799183225 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f20e00c2f60 con 0x7f20e01e3730 2023-08-31T02:00:46.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.672+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20e00c2f20 con 0x7f20e01e3730 2023-08-31T02:00:46.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.673+0000 7f20d5ffb700 1 -- 172.21.15.84:0/2799183225 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20d8054460 con 0x7f20e01e3730 2023-08-31T02:00:46.666 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f20c406a0e0 msgr2=0x7f20c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f20c406a0e0 0x7f20c406c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f20dc012040 tx=0x7f20dc004750 comp rx=0 tx=0).stop 2023-08-31T02:00:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20e01e3730 msgr2=0x7f20e01e3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20e01e3730 0x7f20e01e3bb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f20d8000f80 tx=0x7f20d80018c0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 shutdown_connections 2023-08-31T02:00:46.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f20c406a0e0 0x7f20c406c5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20e01e3730 0x7f20e01e3bb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20cc003a30 0x7f20e01e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 --2- 172.21.15.84:0/2799183225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20e00c7ae0 0x7f20e00c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 >> 172.21.15.84:0/2799183225 conn(0x7f20e00afb00 msgr2=0x7f20e006a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:46.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 shutdown_connections 2023-08-31T02:00:46.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.675+0000 7f20e774f700 1 -- 172.21.15.84:0/2799183225 wait complete. 2023-08-31T02:00:46.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:46.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.811+0000 7f151f145700 1 -- 172.21.15.84:0/3474703777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815b790 msgr2=0x7f151806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.812+0000 7f151f145700 1 --2- 172.21.15.84:0/3474703777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815b790 0x7f151806c720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f150c005fd0 tx=0x7f150c009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:46.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.812+0000 7f151f145700 1 -- 172.21.15.84:0/3474703777 shutdown_connections 2023-08-31T02:00:46.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.812+0000 7f151f145700 1 --2- 172.21.15.84:0/3474703777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815b790 0x7f151806c720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.812+0000 7f151f145700 1 --2- 172.21.15.84:0/3474703777 >> v2:172.21.15.170:3300/0 conn(0x7f15180ca2d0 0x7f15180cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.812+0000 7f151f145700 1 -- 172.21.15.84:0/3474703777 >> 172.21.15.84:0/3474703777 conn(0x7f15180afb00 msgr2=0x7f15180aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.812+0000 7f151f145700 1 -- 172.21.15.84:0/3474703777 shutdown_connections 2023-08-31T02:00:46.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.812+0000 7f151f145700 1 -- 172.21.15.84:0/3474703777 wait complete. 2023-08-31T02:00:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.813+0000 7f151f145700 1 Processor -- start 2023-08-31T02:00:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.813+0000 7f151f145700 1 -- start start 2023-08-31T02:00:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151f145700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15180ca2d0 0x7f15180c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151f145700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151815b790 0x7f151806a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151f145700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815bce0 0x7f151806a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151f145700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180c4520 con 0x7f15180ca2d0 2023-08-31T02:00:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151f145700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180c3640 con 0x7f151815b790 2023-08-31T02:00:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151f145700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15180c3910 con 0x7f151815bce0 2023-08-31T02:00:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151cee1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15180ca2d0 0x7f15180c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151cee1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15180ca2d0 0x7f15180c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52548/0 (socket says 172.21.15.84:52548) 2023-08-31T02:00:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.814+0000 7f151cee1700 1 -- 172.21.15.84:0/3523430851 learned_addr learned my addr 172.21.15.84:0/3523430851 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f1517fff700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151815b790 0x7f151806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151d6e2700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815bce0 0x7f151806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151cee1700 1 -- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815bce0 msgr2=0x7f151806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151cee1700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815bce0 0x7f151806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151cee1700 1 -- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151815b790 msgr2=0x7f151806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151cee1700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151815b790 0x7f151806a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151cee1700 1 -- 172.21.15.84:0/3523430851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0095f0 con 0x7f15180ca2d0 2023-08-31T02:00:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f1517fff700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151815b790 0x7f151806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151d6e2700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815bce0 0x7f151806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151cee1700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15180ca2d0 0x7f15180c3100 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f150c00b5e0 tx=0x7f150c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f15157fa700 1 -- 172.21.15.84:0/3523430851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c01d070 con 0x7f15180ca2d0 2023-08-31T02:00:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f15157fa700 1 -- 172.21.15.84:0/3523430851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f150c004830 con 0x7f15180ca2d0 2023-08-31T02:00:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15180c3bf0 con 0x7f15180ca2d0 2023-08-31T02:00:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f15157fa700 1 -- 172.21.15.84:0/3523430851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c004c60 con 0x7f15180ca2d0 2023-08-31T02:00:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.815+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15180c41b0 con 0x7f15180ca2d0 2023-08-31T02:00:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.816+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151804e7c0 con 0x7f15180ca2d0 2023-08-31T02:00:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.816+0000 7f15157fa700 1 -- 172.21.15.84:0/3523430851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f150c00b820 con 0x7f15180ca2d0 2023-08-31T02:00:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.817+0000 7f15157fa700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14fc06a0e0 0x7f14fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.817+0000 7f15157fa700 1 -- 172.21.15.84:0/3523430851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f150c089e00 con 0x7f15180ca2d0 2023-08-31T02:00:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.817+0000 7f1517fff700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14fc06a0e0 0x7f14fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:46.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.817+0000 7f1517fff700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14fc06a0e0 0x7f14fc06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f15040016b0 tx=0x7f1504009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:46.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:46.821+0000 7f15157fa700 1 -- 172.21.15.84:0/3523430851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f150c055260 con 0x7f15180ca2d0 2023-08-31T02:00:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.010+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15180718b0 con 0x7f15180ca2d0 2023-08-31T02:00:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.010+0000 7f15157fa700 1 -- 172.21.15.84:0/3523430851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f150c058880 con 0x7f15180ca2d0 2023-08-31T02:00:47.003 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14fc06a0e0 msgr2=0x7f14fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14fc06a0e0 0x7f14fc06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f15040016b0 tx=0x7f1504009040 comp rx=0 tx=0).stop 2023-08-31T02:00:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15180ca2d0 msgr2=0x7f15180c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15180ca2d0 0x7f15180c3100 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f150c00b5e0 tx=0x7f150c003960 comp rx=0 tx=0).stop 2023-08-31T02:00:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 shutdown_connections 2023-08-31T02:00:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14fc06a0e0 0x7f14fc06c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151815bce0 0x7f151806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15180ca2d0 0x7f15180c3100 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 --2- 172.21.15.84:0/3523430851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151815b790 0x7f151806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.012+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 >> 172.21.15.84:0/3523430851 conn(0x7f15180afb00 msgr2=0x7f15180c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:47.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.013+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 shutdown_connections 2023-08-31T02:00:47.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.013+0000 7f151f145700 1 -- 172.21.15.84:0/3523430851 wait complete. 2023-08-31T02:00:47.017 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:47.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.152+0000 7f737c612700 1 -- 172.21.15.84:0/3121899533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737415b790 msgr2=0x7f737406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.152+0000 7f737c612700 1 --2- 172.21.15.84:0/3121899533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737415b790 0x7f737406c720 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7370005fd0 tx=0x7f7370009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:47.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.152+0000 7f737c612700 1 -- 172.21.15.84:0/3121899533 shutdown_connections 2023-08-31T02:00:47.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.152+0000 7f737c612700 1 --2- 172.21.15.84:0/3121899533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f737415b790 0x7f737406c720 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.152+0000 7f737c612700 1 --2- 172.21.15.84:0/3121899533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f737415bce0 0x7f73740c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.152+0000 7f737c612700 1 -- 172.21.15.84:0/3121899533 >> 172.21.15.84:0/3121899533 conn(0x7f73740afb00 msgr2=0x7f73740aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:47.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.152+0000 7f737c612700 1 -- 172.21.15.84:0/3121899533 shutdown_connections 2023-08-31T02:00:47.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.152+0000 7f737c612700 1 -- 172.21.15.84:0/3121899533 wait complete. 2023-08-31T02:00:47.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.153+0000 7f737c612700 1 Processor -- start 2023-08-31T02:00:47.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.153+0000 7f737c612700 1 -- start start 2023-08-31T02:00:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737c612700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740ca100 0x7f73740c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737c612700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f737415b790 0x7f73741501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737c612700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f737415bce0 0x7f7374156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737c612700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73740c6400 con 0x7f73740ca100 2023-08-31T02:00:47.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737c612700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73741506f0 con 0x7f737415b790 2023-08-31T02:00:47.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737c612700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73740c6b20 con 0x7f737415bce0 2023-08-31T02:00:47.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737a3ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740ca100 0x7f73740c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:47.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737a3ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740ca100 0x7f73740c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52560/0 (socket says 172.21.15.84:52560) 2023-08-31T02:00:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737a3ae700 1 -- 172.21.15.84:0/2488737987 learned_addr learned my addr 172.21.15.84:0/2488737987 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f7379bad700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f737415b790 0x7f73741501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737abaf700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f737415bce0 0x7f7374156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737a3ae700 1 -- 172.21.15.84:0/2488737987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f737415bce0 msgr2=0x7f7374156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737a3ae700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f737415bce0 0x7f7374156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737a3ae700 1 -- 172.21.15.84:0/2488737987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f737415b790 msgr2=0x7f73741501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737a3ae700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f737415b790 0x7f73741501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.154+0000 7f737a3ae700 1 -- 172.21.15.84:0/2488737987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700095f0 con 0x7f73740ca100 2023-08-31T02:00:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.155+0000 7f737a3ae700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740ca100 0x7f73740c5ec0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f737000b540 tx=0x7f7370004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.155+0000 7f736affd700 1 -- 172.21.15.84:0/2488737987 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370005280 con 0x7f73740ca100 2023-08-31T02:00:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.155+0000 7f736affd700 1 -- 172.21.15.84:0/2488737987 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f73700054d0 con 0x7f73740ca100 2023-08-31T02:00:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.155+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73740c6d70 con 0x7f73740ca100 2023-08-31T02:00:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.155+0000 7f736affd700 1 -- 172.21.15.84:0/2488737987 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370020480 con 0x7f73740ca100 2023-08-31T02:00:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.155+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73740c7330 con 0x7f73740ca100 2023-08-31T02:00:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.156+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737404e7c0 con 0x7f73740ca100 2023-08-31T02:00:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.156+0000 7f736affd700 1 -- 172.21.15.84:0/2488737987 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f73700205e0 con 0x7f73740ca100 2023-08-31T02:00:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.157+0000 7f736affd700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f735806a0e0 0x7f735806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.157+0000 7f7379bad700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f735806a0e0 0x7f735806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.157+0000 7f736affd700 1 -- 172.21.15.84:0/2488737987 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f737008cf00 con 0x7f73740ca100 2023-08-31T02:00:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.157+0000 7f7379bad700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f735806a0e0 0x7f735806c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f73741f1bc0 tx=0x7f7364009110 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.161+0000 7f736affd700 1 -- 172.21.15.84:0/2488737987 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7370058360 con 0x7f73740ca100 2023-08-31T02:00:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.353+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f73740718b0 con 0x7f73740ca100 2023-08-31T02:00:47.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.353+0000 7f736affd700 1 -- 172.21.15.84:0/2488737987 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7370024070 con 0x7f73740ca100 2023-08-31T02:00:47.347 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f735806a0e0 msgr2=0x7f735806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f735806a0e0 0x7f735806c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f73741f1bc0 tx=0x7f7364009110 comp rx=0 tx=0).stop 2023-08-31T02:00:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740ca100 msgr2=0x7f73740c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740ca100 0x7f73740c5ec0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f737000b540 tx=0x7f7370004ae0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 shutdown_connections 2023-08-31T02:00:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f735806a0e0 0x7f735806c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f737415bce0 0x7f7374156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740ca100 0x7f73740c5ec0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 --2- 172.21.15.84:0/2488737987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f737415b790 0x7f73741501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 >> 172.21.15.84:0/2488737987 conn(0x7f73740afb00 msgr2=0x7f73740aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 shutdown_connections 2023-08-31T02:00:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.356+0000 7f737c612700 1 -- 172.21.15.84:0/2488737987 wait complete. 2023-08-31T02:00:47.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T02:00:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.494+0000 7f48f6995700 1 -- 172.21.15.84:0/3526835330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48d80051d0 msgr2=0x7f48d800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.494+0000 7f48f6995700 1 --2- 172.21.15.84:0/3526835330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48d80051d0 0x7f48d800ba10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f48e8001e40 tx=0x7f48d8005880 comp rx=0 tx=0).stop 2023-08-31T02:00:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.494+0000 7f48f4f32700 1 -- 172.21.15.84:0/3526835330 reap_dead start 2023-08-31T02:00:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.495+0000 7f48f6995700 1 -- 172.21.15.84:0/3526835330 shutdown_connections 2023-08-31T02:00:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.495+0000 7f48f6995700 1 -- 172.21.15.84:0/3526835330 >> 172.21.15.84:0/3526835330 conn(0x7f48f00cba80 msgr2=0x7f48f00cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.495+0000 7f48f6995700 1 -- 172.21.15.84:0/3526835330 shutdown_connections 2023-08-31T02:00:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.495+0000 7f48f6995700 1 -- 172.21.15.84:0/3526835330 wait complete. 2023-08-31T02:00:47.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.496+0000 7f48f6995700 1 Processor -- start 2023-08-31T02:00:47.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.496+0000 7f48f6995700 1 -- start start 2023-08-31T02:00:47.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f6995700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d80051d0 0x7f48f00c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f6995700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48f01e2bd0 0x7f48f00cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f6995700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48f00cf540 0x7f48f00c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f6995700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00cf9d0 con 0x7f48f00cf540 2023-08-31T02:00:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f6995700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01e4130 con 0x7f48d80051d0 2023-08-31T02:00:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f6995700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01e3ca0 con 0x7f48f01e2bd0 2023-08-31T02:00:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48f00cf540 0x7f48f00c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48f00cf540 0x7f48f00c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52584/0 (socket says 172.21.15.84:52584) 2023-08-31T02:00:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 -- 172.21.15.84:0/1115395503 learned_addr learned my addr 172.21.15.84:0/1115395503 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48effff700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d80051d0 0x7f48f00c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48ef7fe700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48f01e2bd0 0x7f48f00cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 -- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48f01e2bd0 msgr2=0x7f48f00cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48f01e2bd0 0x7f48f00cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 -- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d80051d0 msgr2=0x7f48f00c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d80051d0 0x7f48f00c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 -- 172.21.15.84:0/1115395503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f01e3090 con 0x7f48f00cf540 2023-08-31T02:00:47.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48effff700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d80051d0 0x7f48f00c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:47.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f4f32700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48f00cf540 0x7f48f00c7120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f48d80057f0 tx=0x7f48e8001340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:47.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48ecff9700 1 -- 172.21.15.84:0/1115395503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8015070 con 0x7f48f00cf540 2023-08-31T02:00:47.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48ecff9700 1 -- 172.21.15.84:0/1115395503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f48e800cdc0 con 0x7f48f00cf540 2023-08-31T02:00:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f01e3370 con 0x7f48f00cf540 2023-08-31T02:00:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48ecff9700 1 -- 172.21.15.84:0/1115395503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8006330 con 0x7f48f00cf540 2023-08-31T02:00:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.497+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f01e3930 con 0x7f48f00cf540 2023-08-31T02:00:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.498+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f01e3ac0 con 0x7f48f00cf540 2023-08-31T02:00:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.499+0000 7f48ecff9700 1 -- 172.21.15.84:0/1115395503 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f48e8006490 con 0x7f48f00cf540 2023-08-31T02:00:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.500+0000 7f48ecff9700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f48dc06a0e0 0x7f48dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.500+0000 7f48ecff9700 1 -- 172.21.15.84:0/1115395503 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f48e808a620 con 0x7f48f00cf540 2023-08-31T02:00:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.500+0000 7f48effff700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f48dc06a0e0 0x7f48dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.500+0000 7f48effff700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f48dc06a0e0 0x7f48dc06c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f48e00017a0 tx=0x7f48e0001550 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.503+0000 7f48ecff9700 1 -- 172.21.15.84:0/1115395503 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f48e8055b80 con 0x7f48f00cf540 2023-08-31T02:00:47.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.696+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f48f004e7c0 con 0x7f48f00cf540 2023-08-31T02:00:47.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.699+0000 7f48ecff9700 1 -- 172.21.15.84:0/1115395503 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f48e80591a0 con 0x7f48f00cf540 2023-08-31T02:00:47.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f48dc06a0e0 msgr2=0x7f48dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f48dc06a0e0 0x7f48dc06c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f48e00017a0 tx=0x7f48e0001550 comp rx=0 tx=0).stop 2023-08-31T02:00:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48f00cf540 msgr2=0x7f48f00c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48f00cf540 0x7f48f00c7120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f48d80057f0 tx=0x7f48e8001340 comp rx=0 tx=0).stop 2023-08-31T02:00:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 shutdown_connections 2023-08-31T02:00:47.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f48dc06a0e0 0x7f48dc06c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48f00cf540 0x7f48f00c7120 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d80051d0 0x7f48f00c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 --2- 172.21.15.84:0/1115395503 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48f01e2bd0 0x7f48f00cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:47.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.701+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 >> 172.21.15.84:0/1115395503 conn(0x7f48f00cba80 msgr2=0x7f48f015b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:47.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.702+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 shutdown_connections 2023-08-31T02:00:47.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:47.702+0000 7f48f6995700 1 -- 172.21.15.84:0/1115395503 wait complete. 2023-08-31T02:00:47.706 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T02:00:47.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T02:00:47.746 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T02:00:47.792 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T02:00:47.793 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:00:47.793 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:47.811 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:00:47.812 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:47.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:48.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.037+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/3916956938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0b0df0 msgr2=0x7f5fcc0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.037+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/3916956938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0b0df0 0x7f5fcc0c9ac0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc005fd0 tx=0x7f5fbc009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:48.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.037+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/3916956938 shutdown_connections 2023-08-31T02:00:48.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.037+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/3916956938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fcc158220 0x7f5fcc0cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.037+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/3916956938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0b0df0 0x7f5fcc0c9ac0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.037+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/3916956938 >> 172.21.15.84:0/3916956938 conn(0x7f5fcc0caa20 msgr2=0x7f5fcc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:48.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.037+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/3916956938 shutdown_connections 2023-08-31T02:00:48.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.037+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/3916956938 wait complete. 2023-08-31T02:00:48.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fd0cc5700 1 Processor -- start 2023-08-31T02:00:48.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fd0cc5700 1 -- start start 2023-08-31T02:00:48.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fd0cc5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0707c0 0x7f5fcc159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fd0cc5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fcc0b0df0 0x7f5fcc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fd0cc5700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fcc158220 0x7f5fcc1f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fd0cc5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0b01d0 con 0x7f5fcc0707c0 2023-08-31T02:00:48.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fd0cc5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0af5c0 con 0x7f5fcc0b0df0 2023-08-31T02:00:48.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fd0cc5700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0af8a0 con 0x7f5fcc158220 2023-08-31T02:00:48.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.039+0000 7f5fca59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0707c0 0x7f5fcc159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fca59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0707c0 0x7f5fcc159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52594/0 (socket says 172.21.15.84:52594) 2023-08-31T02:00:48.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fca59c700 1 -- 172.21.15.84:0/2558337506 learned_addr learned my addr 172.21.15.84:0/2558337506 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:48.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fcad9d700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fcc158220 0x7f5fcc1f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fca59c700 1 -- 172.21.15.84:0/2558337506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fcc158220 msgr2=0x7f5fcc1f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fc9d9b700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fcc0b0df0 0x7f5fcc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fca59c700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fcc158220 0x7f5fcc1f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fca59c700 1 -- 172.21.15.84:0/2558337506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fcc0b0df0 msgr2=0x7f5fcc0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fca59c700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fcc0b0df0 0x7f5fcc0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fca59c700 1 -- 172.21.15.84:0/2558337506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0095f0 con 0x7f5fcc0707c0 2023-08-31T02:00:48.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fca59c700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0707c0 0x7f5fcc159ad0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000d950 tx=0x7f5fc000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:48.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fbaffd700 1 -- 172.21.15.84:0/2558337506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0009930 con 0x7f5fcc0707c0 2023-08-31T02:00:48.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fbaffd700 1 -- 172.21.15.84:0/2558337506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5fc0009b80 con 0x7f5fcc0707c0 2023-08-31T02:00:48.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc0afb80 con 0x7f5fcc0707c0 2023-08-31T02:00:48.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fbaffd700 1 -- 172.21.15.84:0/2558337506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0010460 con 0x7f5fcc0707c0 2023-08-31T02:00:48.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.040+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc0af1c0 con 0x7f5fcc0707c0 2023-08-31T02:00:48.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.041+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc0b04b0 con 0x7f5fcc0707c0 2023-08-31T02:00:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.042+0000 7f5fbaffd700 1 -- 172.21.15.84:0/2558337506 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5fc00105c0 con 0x7f5fcc0707c0 2023-08-31T02:00:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.042+0000 7f5fbaffd700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5fac06a0e0 0x7f5fac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.042+0000 7f5fbaffd700 1 -- 172.21.15.84:0/2558337506 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f5fc0088c40 con 0x7f5fcc0707c0 2023-08-31T02:00:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.042+0000 7f5fc9d9b700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5fac06a0e0 0x7f5fac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.043+0000 7f5fc9d9b700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5fac06a0e0 0x7f5fac06c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc1f2af0 tx=0x7f5fbc0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:48.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.047+0000 7f5fbaffd700 1 -- 172.21.15.84:0/2558337506 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5fc0057a20 con 0x7f5fcc0707c0 2023-08-31T02:00:48.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.235+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fcc0af350 con 0x7f5fcc0707c0 2023-08-31T02:00:48.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.237+0000 7f5fbaffd700 1 -- 172.21.15.84:0/2558337506 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f5fc00575b0 con 0x7f5fcc0707c0 2023-08-31T02:00:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:48.230 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:48.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5fac06a0e0 msgr2=0x7f5fac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5fac06a0e0 0x7f5fac06c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc1f2af0 tx=0x7f5fbc0047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0707c0 msgr2=0x7f5fcc159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0707c0 0x7f5fcc159ad0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000d950 tx=0x7f5fc000dd10 comp rx=0 tx=0).stop 2023-08-31T02:00:48.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 shutdown_connections 2023-08-31T02:00:48.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5fac06a0e0 0x7f5fac06c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fcc158220 0x7f5fcc1f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fcc0707c0 0x7f5fcc159ad0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 --2- 172.21.15.84:0/2558337506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fcc0b0df0 0x7f5fcc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 >> 172.21.15.84:0/2558337506 conn(0x7f5fcc0caa20 msgr2=0x7f5fcc158930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:48.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 shutdown_connections 2023-08-31T02:00:48.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.239+0000 7f5fd0cc5700 1 -- 172.21.15.84:0/2558337506 wait complete. 2023-08-31T02:00:48.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:48.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:48.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.378+0000 7f0aeb197700 1 -- 172.21.15.84:0/3392435652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae41593b0 msgr2=0x7f0ae40b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.378+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3392435652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae41593b0 0x7f0ae40b0620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8005fd0 tx=0x7f0ad8009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.378+0000 7f0aeb197700 1 -- 172.21.15.84:0/3392435652 shutdown_connections 2023-08-31T02:00:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.378+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3392435652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae41593b0 0x7f0ae40b0620 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.378+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3392435652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ae406db90 0x7f0ae40c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.378+0000 7f0aeb197700 1 -- 172.21.15.84:0/3392435652 >> 172.21.15.84:0/3392435652 conn(0x7f0ae40afb00 msgr2=0x7f0ae40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.378+0000 7f0aeb197700 1 -- 172.21.15.84:0/3392435652 shutdown_connections 2023-08-31T02:00:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.378+0000 7f0aeb197700 1 -- 172.21.15.84:0/3392435652 wait complete. 2023-08-31T02:00:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.380+0000 7f0aeb197700 1 Processor -- start 2023-08-31T02:00:48.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.380+0000 7f0aeb197700 1 -- start start 2023-08-31T02:00:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.380+0000 7f0aeb197700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ae406db90 0x7f0ae40ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.380+0000 7f0aeb197700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae40b23e0 0x7f0ae40cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.380+0000 7f0aeb197700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ae41593b0 0x7f0ae40cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0aeb197700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae40aa8d0 con 0x7f0ae40b23e0 2023-08-31T02:00:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0aeb197700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae414fca0 con 0x7f0ae41593b0 2023-08-31T02:00:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0aeb197700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae41e3c60 con 0x7f0ae406db90 2023-08-31T02:00:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae40b23e0 0x7f0ae40cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae40b23e0 0x7f0ae40cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52612/0 (socket says 172.21.15.84:52612) 2023-08-31T02:00:48.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 -- 172.21.15.84:0/3411410171 learned_addr learned my addr 172.21.15.84:0/3411410171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae9734700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ae41593b0 0x7f0ae40cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae8f33700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ae406db90 0x7f0ae40ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 -- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ae406db90 msgr2=0x7f0ae40ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ae406db90 0x7f0ae40ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 -- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ae41593b0 msgr2=0x7f0ae40cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ae41593b0 0x7f0ae40cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 -- 172.21.15.84:0/3411410171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80095f0 con 0x7f0ae40b23e0 2023-08-31T02:00:48.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae8f33700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ae406db90 0x7f0ae40ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:48.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae3fff700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae40b23e0 0x7f0ae40cd160 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c9b0 tx=0x7f0ad000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae17fa700 1 -- 172.21.15.84:0/3411410171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0007b00 con 0x7f0ae40b23e0 2023-08-31T02:00:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae17fa700 1 -- 172.21.15.84:0/3411410171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ad0007d50 con 0x7f0ae40b23e0 2023-08-31T02:00:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae41e3f40 con 0x7f0ae40b23e0 2023-08-31T02:00:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0ae17fa700 1 -- 172.21.15.84:0/3411410171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000f6b0 con 0x7f0ae40b23e0 2023-08-31T02:00:48.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.381+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae40cbad0 con 0x7f0ae40b23e0 2023-08-31T02:00:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.382+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae4070450 con 0x7f0ae40b23e0 2023-08-31T02:00:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.383+0000 7f0ae17fa700 1 -- 172.21.15.84:0/3411410171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ad000f810 con 0x7f0ae40b23e0 2023-08-31T02:00:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.383+0000 7f0ae17fa700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ac806a0e0 0x7f0ac806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.383+0000 7f0ae17fa700 1 -- 172.21.15.84:0/3411410171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f0ad0088f60 con 0x7f0ae40b23e0 2023-08-31T02:00:48.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.383+0000 7f0ae8f33700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ac806a0e0 0x7f0ac806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.384+0000 7f0ae8f33700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ac806a0e0 0x7f0ac806c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80098e0 tx=0x7f0ad8011040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:48.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.387+0000 7f0ae17fa700 1 -- 172.21.15.84:0/3411410171 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ad00542b0 con 0x7f0ae40b23e0 2023-08-31T02:00:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.577+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ae404e7c0 con 0x7f0ae40b23e0 2023-08-31T02:00:48.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.577+0000 7f0ae17fa700 1 -- 172.21.15.84:0/3411410171 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ad00578d0 con 0x7f0ae40b23e0 2023-08-31T02:00:48.570 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ac806a0e0 msgr2=0x7f0ac806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ac806a0e0 0x7f0ac806c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80098e0 tx=0x7f0ad8011040 comp rx=0 tx=0).stop 2023-08-31T02:00:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae40b23e0 msgr2=0x7f0ae40cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae40b23e0 0x7f0ae40cd160 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c9b0 tx=0x7f0ad000ccc0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 shutdown_connections 2023-08-31T02:00:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ac806a0e0 0x7f0ac806c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ae41593b0 0x7f0ae40cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ae406db90 0x7f0ae40ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 --2- 172.21.15.84:0/3411410171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae40b23e0 0x7f0ae40cd160 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 >> 172.21.15.84:0/3411410171 conn(0x7f0ae40afb00 msgr2=0x7f0ae40c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:48.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 shutdown_connections 2023-08-31T02:00:48.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.579+0000 7f0aeb197700 1 -- 172.21.15.84:0/3411410171 wait complete. 2023-08-31T02:00:48.584 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:48.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.717+0000 7f75481b3700 1 -- 172.21.15.84:0/1854503754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 msgr2=0x7f752c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.717+0000 7f75481b3700 1 --2- 172.21.15.84:0/1854503754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 0x7f752c00ba10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7538009db0 tx=0x7f752c005880 comp rx=0 tx=0).stop 2023-08-31T02:00:48.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.717+0000 7f75481b3700 1 -- 172.21.15.84:0/1854503754 shutdown_connections 2023-08-31T02:00:48.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.717+0000 7f75481b3700 1 --2- 172.21.15.84:0/1854503754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 0x7f752c00ba10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.717+0000 7f75481b3700 1 -- 172.21.15.84:0/1854503754 >> 172.21.15.84:0/1854503754 conn(0x7f75400b0c40 msgr2=0x7f75400b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:48.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.717+0000 7f75481b3700 1 -- 172.21.15.84:0/1854503754 shutdown_connections 2023-08-31T02:00:48.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.717+0000 7f75481b3700 1 -- 172.21.15.84:0/1854503754 wait complete. 2023-08-31T02:00:48.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.718+0000 7f75481b3700 1 Processor -- start 2023-08-31T02:00:48.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.718+0000 7f75481b3700 1 -- start start 2023-08-31T02:00:48.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f75481b3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 0x7f7540149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f75481b3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400c8520 0x7f75400c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f75481b3700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f754006bea0 0x7f754006c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f75481b3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7540149960 con 0x7f752c005410 2023-08-31T02:00:48.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f75481b3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754006cc10 con 0x7f75400c8520 2023-08-31T02:00:48.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f75481b3700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75400c2f60 con 0x7f754006bea0 2023-08-31T02:00:48.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7545f4f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 0x7f7540149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7545f4f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 0x7f7540149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52628/0 (socket says 172.21.15.84:52628) 2023-08-31T02:00:48.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7545f4f700 1 -- 172.21.15.84:0/566573597 learned_addr learned my addr 172.21.15.84:0/566573597 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:48.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f754574e700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400c8520 0x7f75400c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7546750700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f754006bea0 0x7f754006c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7545f4f700 1 -- 172.21.15.84:0/566573597 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f754006bea0 msgr2=0x7f754006c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7545f4f700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f754006bea0 0x7f754006c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7545f4f700 1 -- 172.21.15.84:0/566573597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400c8520 msgr2=0x7f75400c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7545f4f700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400c8520 0x7f75400c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.719+0000 7f7545f4f700 1 -- 172.21.15.84:0/566573597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400c3240 con 0x7f752c005410 2023-08-31T02:00:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.720+0000 7f7545f4f700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 0x7f7540149420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7530001200 tx=0x7f753000e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.720+0000 7f75367fc700 1 -- 172.21.15.84:0/566573597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530011870 con 0x7f752c005410 2023-08-31T02:00:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.720+0000 7f75367fc700 1 -- 172.21.15.84:0/566573597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f753000ee90 con 0x7f752c005410 2023-08-31T02:00:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.720+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75400c3520 con 0x7f752c005410 2023-08-31T02:00:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.720+0000 7f75367fc700 1 -- 172.21.15.84:0/566573597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530011d20 con 0x7f752c005410 2023-08-31T02:00:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.720+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75400c8ee0 con 0x7f752c005410 2023-08-31T02:00:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.721+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75400c30a0 con 0x7f752c005410 2023-08-31T02:00:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.721+0000 7f75367fc700 1 -- 172.21.15.84:0/566573597 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75300103c0 con 0x7f752c005410 2023-08-31T02:00:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.721+0000 7f75367fc700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f752406a0e0 0x7f752406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.722+0000 7f754574e700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f752406a0e0 0x7f752406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.722+0000 7f75367fc700 1 -- 172.21.15.84:0/566573597 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7530088d60 con 0x7f752c005410 2023-08-31T02:00:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.722+0000 7f754574e700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f752406a0e0 0x7f752406c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75401f4a60 tx=0x7f753c006bc0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.726+0000 7f75367fc700 1 -- 172.21.15.84:0/566573597 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75400c30a0 con 0x7f752c005410 2023-08-31T02:00:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.914+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75400c30a0 con 0x7f752c005410 2023-08-31T02:00:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.914+0000 7f75367fc700 1 -- 172.21.15.84:0/566573597 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75400c30a0 con 0x7f752c005410 2023-08-31T02:00:48.907 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:48.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f752406a0e0 msgr2=0x7f752406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f752406a0e0 0x7f752406c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75401f4a60 tx=0x7f753c006bc0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 msgr2=0x7f7540149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:48.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 0x7f7540149420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7530001200 tx=0x7f753000e870 comp rx=0 tx=0).stop 2023-08-31T02:00:48.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 shutdown_connections 2023-08-31T02:00:48.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f752406a0e0 0x7f752406c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f754006bea0 0x7f754006c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f752c005410 0x7f7540149420 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 --2- 172.21.15.84:0/566573597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400c8520 0x7f75400c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:48.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 >> 172.21.15.84:0/566573597 conn(0x7f75400b0c40 msgr2=0x7f754015ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 shutdown_connections 2023-08-31T02:00:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:48.916+0000 7f75481b3700 1 -- 172.21.15.84:0/566573597 wait complete. 2023-08-31T02:00:48.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.054+0000 7fb4e39e8700 1 -- 172.21.15.84:0/946469188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 msgr2=0x7fb4dc0cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.054+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/946469188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 0x7fb4dc0cb360 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009fd0 tx=0x7fb4d400b380 comp rx=0 tx=0).stop 2023-08-31T02:00:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.054+0000 7fb4e39e8700 1 -- 172.21.15.84:0/946469188 shutdown_connections 2023-08-31T02:00:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.054+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/946469188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 0x7fb4dc0cb360 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.054+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/946469188 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4dc0cd3f0 0x7fb4dc0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.054+0000 7fb4e39e8700 1 -- 172.21.15.84:0/946469188 >> 172.21.15.84:0/946469188 conn(0x7fb4dc0b0c40 msgr2=0x7fb4dc0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.054+0000 7fb4e39e8700 1 -- 172.21.15.84:0/946469188 shutdown_connections 2023-08-31T02:00:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.054+0000 7fb4e39e8700 1 -- 172.21.15.84:0/946469188 wait complete. 2023-08-31T02:00:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.055+0000 7fb4e39e8700 1 Processor -- start 2023-08-31T02:00:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.055+0000 7fb4e39e8700 1 -- start start 2023-08-31T02:00:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e39e8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4dc0cd3f0 0x7fb4dc15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e39e8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4dc159320 0x7fb4dc15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e39e8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 0x7fb4dc0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e39e8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc15c6b0 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e39e8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0c45a0 con 0x7fb4dc15d750 2023-08-31T02:00:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e39e8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc159d20 con 0x7fb4dc159320 2023-08-31T02:00:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e1784700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4dc0cd3f0 0x7fb4dc15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e1784700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4dc0cd3f0 0x7fb4dc15a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52642/0 (socket says 172.21.15.84:52642) 2023-08-31T02:00:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.056+0000 7fb4e1784700 1 -- 172.21.15.84:0/1418466507 learned_addr learned my addr 172.21.15.84:0/1418466507 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e0f83700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4dc159320 0x7fb4dc15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e1f85700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 0x7fb4dc0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e1784700 1 -- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4dc159320 msgr2=0x7fb4dc15b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e1784700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4dc159320 0x7fb4dc15b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e1784700 1 -- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 msgr2=0x7fb4dc0c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e1784700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 0x7fb4dc0c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e1784700 1 -- 172.21.15.84:0/1418466507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4009d00 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e1f85700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 0x7fb4dc0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:49.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e1784700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4dc0cd3f0 0x7fb4dc15a140 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0011e0 tx=0x7fb4cc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:49.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4d1ffb700 1 -- 172.21.15.84:0/1418466507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc0054e0 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4d1ffb700 1 -- 172.21.15.84:0/1418466507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb4cc003680 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc15c0f0 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4d1ffb700 1 -- 172.21.15.84:0/1418466507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc003a90 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.057+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4dc159940 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.058+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4dc1597a0 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.059+0000 7fb4d1ffb700 1 -- 172.21.15.84:0/1418466507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb4cc003bf0 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.059+0000 7fb4d1ffb700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb4c006a0e0 0x7fb4c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.059+0000 7fb4d1ffb700 1 -- 172.21.15.84:0/1418466507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb4cc087f00 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.059+0000 7fb4e0f83700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb4c006a0e0 0x7fb4c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.059+0000 7fb4e0f83700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb4c006a0e0 0x7fb4c006c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc15b940 tx=0x7fb4d8009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:49.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.063+0000 7fb4d1ffb700 1 -- 172.21.15.84:0/1418466507 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb4dc1597a0 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.251+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4dc1597a0 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.252+0000 7fb4d1ffb700 1 -- 172.21.15.84:0/1418466507 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4dc1597a0 con 0x7fb4dc0cd3f0 2023-08-31T02:00:49.245 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb4c006a0e0 msgr2=0x7fb4c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb4c006a0e0 0x7fb4c006c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc15b940 tx=0x7fb4d8009260 comp rx=0 tx=0).stop 2023-08-31T02:00:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4dc0cd3f0 msgr2=0x7fb4dc15a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4dc0cd3f0 0x7fb4dc15a140 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0011e0 tx=0x7fb4cc00cae0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 shutdown_connections 2023-08-31T02:00:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb4c006a0e0 0x7fb4c006c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4dc15d750 0x7fb4dc0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4dc0cd3f0 0x7fb4dc15a140 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 --2- 172.21.15.84:0/1418466507 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4dc159320 0x7fb4dc15b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 >> 172.21.15.84:0/1418466507 conn(0x7fb4dc0b0c40 msgr2=0x7fb4dc0b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:49.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 shutdown_connections 2023-08-31T02:00:49.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.254+0000 7fb4e39e8700 1 -- 172.21.15.84:0/1418466507 wait complete. 2023-08-31T02:00:49.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:49.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.394+0000 7f7f8b200700 1 -- 172.21.15.84:0/1064619511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840ca030 msgr2=0x7f7f840c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.394+0000 7f7f8b200700 1 --2- 172.21.15.84:0/1064619511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840ca030 0x7f7f840c8e20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009fd0 tx=0x7f7f7c00b380 comp rx=0 tx=0).stop 2023-08-31T02:00:49.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.394+0000 7f7f8b200700 1 -- 172.21.15.84:0/1064619511 shutdown_connections 2023-08-31T02:00:49.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.394+0000 7f7f8b200700 1 --2- 172.21.15.84:0/1064619511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840ca030 0x7f7f840c8e20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.394+0000 7f7f8b200700 1 --2- 172.21.15.84:0/1064619511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f840c8500 0x7f7f840c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.394+0000 7f7f8b200700 1 -- 172.21.15.84:0/1064619511 >> 172.21.15.84:0/1064619511 conn(0x7f7f840ca930 msgr2=0x7f7f840cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:49.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.394+0000 7f7f8b200700 1 -- 172.21.15.84:0/1064619511 shutdown_connections 2023-08-31T02:00:49.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.394+0000 7f7f8b200700 1 -- 172.21.15.84:0/1064619511 wait complete. 2023-08-31T02:00:49.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.396+0000 7f7f8b200700 1 Processor -- start 2023-08-31T02:00:49.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.396+0000 7f7f8b200700 1 -- start start 2023-08-31T02:00:49.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f8b200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f840c8500 0x7f7f84155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f8b200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840c9c00 0x7f7f841443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f8b200700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f840ca030 0x7f7f84144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f8b200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c6330 con 0x7f7f840c9c00 2023-08-31T02:00:49.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f8b200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c65b0 con 0x7f7f840c8500 2023-08-31T02:00:49.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f8b200700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c6890 con 0x7f7f840ca030 2023-08-31T02:00:49.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840c9c00 0x7f7f841443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840c9c00 0x7f7f841443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52658/0 (socket says 172.21.15.84:52658) 2023-08-31T02:00:49.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 -- 172.21.15.84:0/194651760 learned_addr learned my addr 172.21.15.84:0/194651760 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:49.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f88f9c700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f840c8500 0x7f7f84155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f8979d700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f840ca030 0x7f7f84144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 -- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f840ca030 msgr2=0x7f7f84144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f840ca030 0x7f7f84144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 -- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f840c8500 msgr2=0x7f7f84155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f840c8500 0x7f7f84155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 -- 172.21.15.84:0/194651760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009d00 con 0x7f7f840c9c00 2023-08-31T02:00:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f88f9c700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f840c8500 0x7f7f84155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f83fff700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840c9c00 0x7f7f841443d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000e960 tx=0x7f7f7000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.397+0000 7f7f817fa700 1 -- 172.21.15.84:0/194651760 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70005480 con 0x7f7f840c9c00 2023-08-31T02:00:49.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.398+0000 7f7f817fa700 1 -- 172.21.15.84:0/194651760 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7f7000ce10 con 0x7f7f840c9c00 2023-08-31T02:00:49.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.398+0000 7f7f817fa700 1 -- 172.21.15.84:0/194651760 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700018d0 con 0x7f7f840c9c00 2023-08-31T02:00:49.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.398+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f840c6b70 con 0x7f7f840c9c00 2023-08-31T02:00:49.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.398+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f84155c70 con 0x7f7f840c9c00 2023-08-31T02:00:49.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.399+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f840c7090 con 0x7f7f840c9c00 2023-08-31T02:00:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.399+0000 7f7f817fa700 1 -- 172.21.15.84:0/194651760 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f70001a30 con 0x7f7f840c9c00 2023-08-31T02:00:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.399+0000 7f7f817fa700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7f6806a0e0 0x7f7f6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.399+0000 7f7f817fa700 1 -- 172.21.15.84:0/194651760 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7f7008ad60 con 0x7f7f840c9c00 2023-08-31T02:00:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.399+0000 7f7f88f9c700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7f6806a0e0 0x7f7f6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.400+0000 7f7f88f9c700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7f6806a0e0 0x7f7f6806c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f780099d0 tx=0x7f7f78008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:49.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.404+0000 7f7f817fa700 1 -- 172.21.15.84:0/194651760 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7f840c7090 con 0x7f7f840c9c00 2023-08-31T02:00:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.592+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7f840c7090 con 0x7f7f840c9c00 2023-08-31T02:00:49.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.592+0000 7f7f817fa700 1 -- 172.21.15.84:0/194651760 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7f840c7090 con 0x7f7f840c9c00 2023-08-31T02:00:49.585 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7f6806a0e0 msgr2=0x7f7f6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7f6806a0e0 0x7f7f6806c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f780099d0 tx=0x7f7f78008040 comp rx=0 tx=0).stop 2023-08-31T02:00:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840c9c00 msgr2=0x7f7f841443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840c9c00 0x7f7f841443d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000e960 tx=0x7f7f7000ed20 comp rx=0 tx=0).stop 2023-08-31T02:00:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 shutdown_connections 2023-08-31T02:00:49.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7f6806a0e0 0x7f7f6806c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f840ca030 0x7f7f84144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f840c8500 0x7f7f84155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 --2- 172.21.15.84:0/194651760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f840c9c00 0x7f7f841443d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 >> 172.21.15.84:0/194651760 conn(0x7f7f840ca930 msgr2=0x7f7f840710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:49.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 shutdown_connections 2023-08-31T02:00:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.594+0000 7f7f8b200700 1 -- 172.21.15.84:0/194651760 wait complete. 2023-08-31T02:00:49.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:00:49.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.732+0000 7f5b36f39700 1 -- 172.21.15.84:0/1370456678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 msgr2=0x7f5b20003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.732+0000 7f5b36f39700 1 --2- 172.21.15.84:0/1370456678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 0x7f5b20003e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5b24001720 tx=0x7f5b20005880 comp rx=0 tx=0).stop 2023-08-31T02:00:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.732+0000 7f5b354d6700 1 -- 172.21.15.84:0/1370456678 reap_dead start 2023-08-31T02:00:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.732+0000 7f5b36f39700 1 -- 172.21.15.84:0/1370456678 shutdown_connections 2023-08-31T02:00:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.732+0000 7f5b36f39700 1 -- 172.21.15.84:0/1370456678 >> 172.21.15.84:0/1370456678 conn(0x7f5b300cdeb0 msgr2=0x7f5b300ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.732+0000 7f5b36f39700 1 -- 172.21.15.84:0/1370456678 shutdown_connections 2023-08-31T02:00:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.732+0000 7f5b36f39700 1 -- 172.21.15.84:0/1370456678 wait complete. 2023-08-31T02:00:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.733+0000 7f5b36f39700 1 Processor -- start 2023-08-31T02:00:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.734+0000 7f5b36f39700 1 -- start start 2023-08-31T02:00:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.734+0000 7f5b36f39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 0x7f5b300c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.734+0000 7f5b36f39700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b30143210 0x7f5b301e2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.734+0000 7f5b36f39700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b301e3200 0x7f5b3015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.734+0000 7f5b36f39700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300c6a40 con 0x7f5b20003a30 2023-08-31T02:00:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.734+0000 7f5b36f39700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300c6d20 con 0x7f5b30143210 2023-08-31T02:00:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.734+0000 7f5b36f39700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300c7000 con 0x7f5b301e3200 2023-08-31T02:00:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.734+0000 7f5b34cd5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 0x7f5b300c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b34cd5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 0x7f5b300c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52676/0 (socket says 172.21.15.84:52676) 2023-08-31T02:00:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b34cd5700 1 -- 172.21.15.84:0/2530748681 learned_addr learned my addr 172.21.15.84:0/2530748681 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b2ffff700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b30143210 0x7f5b301e2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b354d6700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b301e3200 0x7f5b3015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b34cd5700 1 -- 172.21.15.84:0/2530748681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b301e3200 msgr2=0x7f5b3015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b34cd5700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b301e3200 0x7f5b3015a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b34cd5700 1 -- 172.21.15.84:0/2530748681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b30143210 msgr2=0x7f5b301e2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b34cd5700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b30143210 0x7f5b301e2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b34cd5700 1 -- 172.21.15.84:0/2530748681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300c72e0 con 0x7f5b20003a30 2023-08-31T02:00:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b34cd5700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 0x7f5b300c7ae0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5b24006040 tx=0x7f5b240038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b2d7fa700 1 -- 172.21.15.84:0/2530748681 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24015040 con 0x7f5b20003a30 2023-08-31T02:00:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b2d7fa700 1 -- 172.21.15.84:0/2530748681 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b24010480 con 0x7f5b20003a30 2023-08-31T02:00:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b300c75c0 con 0x7f5b20003a30 2023-08-31T02:00:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b2d7fa700 1 -- 172.21.15.84:0/2530748681 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24010890 con 0x7f5b20003a30 2023-08-31T02:00:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.735+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b300c6660 con 0x7f5b20003a30 2023-08-31T02:00:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.736+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b300c7930 con 0x7f5b20003a30 2023-08-31T02:00:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.736+0000 7f5b2d7fa700 1 -- 172.21.15.84:0/2530748681 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b240109f0 con 0x7f5b20003a30 2023-08-31T02:00:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.737+0000 7f5b2d7fa700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b1406a0e0 0x7f5b1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.737+0000 7f5b2d7fa700 1 -- 172.21.15.84:0/2530748681 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f5b24089c70 con 0x7f5b20003a30 2023-08-31T02:00:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.737+0000 7f5b2ffff700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b1406a0e0 0x7f5b1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.737+0000 7f5b2ffff700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b1406a0e0 0x7f5b1406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5b3014a160 tx=0x7f5b1c00b2e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:49.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.741+0000 7f5b2d7fa700 1 -- 172.21.15.84:0/2530748681 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5b240550d0 con 0x7f5b20003a30 2023-08-31T02:00:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.942+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5b3004e7c0 con 0x7f5b20003a30 2023-08-31T02:00:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.942+0000 7f5b2d7fa700 1 -- 172.21.15.84:0/2530748681 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5b24029080 con 0x7f5b20003a30 2023-08-31T02:00:49.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b1406a0e0 msgr2=0x7f5b1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b1406a0e0 0x7f5b1406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5b3014a160 tx=0x7f5b1c00b2e0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 msgr2=0x7f5b300c7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:49.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 0x7f5b300c7ae0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5b24006040 tx=0x7f5b240038b0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 shutdown_connections 2023-08-31T02:00:49.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5b1406a0e0 0x7f5b1406c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b301e3200 0x7f5b3015a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b20003a30 0x7f5b300c7ae0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 --2- 172.21.15.84:0/2530748681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b30143210 0x7f5b301e2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:49.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 >> 172.21.15.84:0/2530748681 conn(0x7f5b300cdeb0 msgr2=0x7f5b301573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:49.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 shutdown_connections 2023-08-31T02:00:49.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:49.944+0000 7f5b36f39700 1 -- 172.21.15.84:0/2530748681 wait complete. 2023-08-31T02:00:49.940 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:00:49.949 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:00:49.950 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:49.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.139+0000 7f576b77a700 1 -- 172.21.15.84:0/876218027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640702b0 msgr2=0x7f57640b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.139+0000 7f576b77a700 1 --2- 172.21.15.84:0/876218027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640702b0 0x7f57640b24a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f57640c4d60 tx=0x7f5754009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.139+0000 7f576b77a700 1 -- 172.21.15.84:0/876218027 shutdown_connections 2023-08-31T02:00:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.139+0000 7f576b77a700 1 --2- 172.21.15.84:0/876218027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640702b0 0x7f57640b24a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.139+0000 7f576b77a700 1 --2- 172.21.15.84:0/876218027 >> v2:172.21.15.170:3300/0 conn(0x7f57640b29e0 0x7f57640b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.139+0000 7f576b77a700 1 -- 172.21.15.84:0/876218027 >> 172.21.15.84:0/876218027 conn(0x7f57640cd740 msgr2=0x7f57640cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.140+0000 7f576b77a700 1 -- 172.21.15.84:0/876218027 shutdown_connections 2023-08-31T02:00:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.140+0000 7f576b77a700 1 -- 172.21.15.84:0/876218027 wait complete. 2023-08-31T02:00:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.141+0000 7f576b77a700 1 Processor -- start 2023-08-31T02:00:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.141+0000 7f576b77a700 1 -- start start 2023-08-31T02:00:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.141+0000 7f576b77a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57640702b0 0x7f57641533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.141+0000 7f576b77a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57640b29e0 0x7f57641e1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.141+0000 7f576b77a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640c5500 0x7f57641e3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.141+0000 7f576b77a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57641e2290 con 0x7f57640c5500 2023-08-31T02:00:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.141+0000 7f576b77a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57641e2570 con 0x7f57640702b0 2023-08-31T02:00:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.141+0000 7f576b77a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57641e2850 con 0x7f57640b29e0 2023-08-31T02:00:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640c5500 0x7f57641e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640c5500 0x7f57641e3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52694/0 (socket says 172.21.15.84:52694) 2023-08-31T02:00:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 -- 172.21.15.84:0/103891184 learned_addr learned my addr 172.21.15.84:0/103891184 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769516700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57640702b0 0x7f57641533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5768d15700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57640b29e0 0x7f57641e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 -- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57640b29e0 msgr2=0x7f57641e1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57640b29e0 0x7f57641e1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 -- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57640702b0 msgr2=0x7f57641533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57640702b0 0x7f57641533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 -- 172.21.15.84:0/103891184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540095f0 con 0x7f57640c5500 2023-08-31T02:00:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5768d15700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57640b29e0 0x7f57641e1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5769d17700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640c5500 0x7f57641e3630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f575c00b9e0 tx=0x7f575c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5759ffb700 1 -- 172.21.15.84:0/103891184 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00c9b0 con 0x7f57640c5500 2023-08-31T02:00:50.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5759ffb700 1 -- 172.21.15.84:0/103891184 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f575c00cc40 con 0x7f57640c5500 2023-08-31T02:00:50.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5764069b40 con 0x7f57640c5500 2023-08-31T02:00:50.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f5759ffb700 1 -- 172.21.15.84:0/103891184 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c014440 con 0x7f57640c5500 2023-08-31T02:00:50.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.142+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57641e3b70 con 0x7f57640c5500 2023-08-31T02:00:50.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.143+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57640699a0 con 0x7f57640c5500 2023-08-31T02:00:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.144+0000 7f5759ffb700 1 -- 172.21.15.84:0/103891184 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f575c0145a0 con 0x7f57640c5500 2023-08-31T02:00:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.144+0000 7f5759ffb700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f574806a0e0 0x7f574806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.144+0000 7f5769516700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f574806a0e0 0x7f574806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.144+0000 7f5759ffb700 1 -- 172.21.15.84:0/103891184 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f575c0886c0 con 0x7f57640c5500 2023-08-31T02:00:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.144+0000 7f5769516700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f574806a0e0 0x7f574806c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5754000c00 tx=0x7f57540047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.148+0000 7f5759ffb700 1 -- 172.21.15.84:0/103891184 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f57640699a0 con 0x7f57640c5500 2023-08-31T02:00:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.340+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57640699a0 con 0x7f57640c5500 2023-08-31T02:00:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.341+0000 7f5759ffb700 1 -- 172.21.15.84:0/103891184 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f57640699a0 con 0x7f57640c5500 2023-08-31T02:00:50.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:50.334 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f574806a0e0 msgr2=0x7f574806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f574806a0e0 0x7f574806c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5754000c00 tx=0x7f57540047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640c5500 msgr2=0x7f57641e3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640c5500 0x7f57641e3630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f575c00b9e0 tx=0x7f575c00bda0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 shutdown_connections 2023-08-31T02:00:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f574806a0e0 0x7f574806c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57640c5500 0x7f57641e3630 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57640702b0 0x7f57641533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 --2- 172.21.15.84:0/103891184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57640b29e0 0x7f57641e1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 >> 172.21.15.84:0/103891184 conn(0x7f57640cd740 msgr2=0x7f5764158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 shutdown_connections 2023-08-31T02:00:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.343+0000 7f576b77a700 1 -- 172.21.15.84:0/103891184 wait complete. 2023-08-31T02:00:50.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:50.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.482+0000 7f68b5835700 1 -- 172.21.15.84:0/4118948094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6898005210 msgr2=0x7f689800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.482+0000 7f68b5835700 1 --2- 172.21.15.84:0/4118948094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6898005210 0x7f689800ba10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c640 tx=0x7f6898005880 comp rx=0 tx=0).stop 2023-08-31T02:00:50.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.482+0000 7f68b5835700 1 -- 172.21.15.84:0/4118948094 shutdown_connections 2023-08-31T02:00:50.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.482+0000 7f68b5835700 1 --2- 172.21.15.84:0/4118948094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6898005210 0x7f689800ba10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.482+0000 7f68b5835700 1 -- 172.21.15.84:0/4118948094 >> 172.21.15.84:0/4118948094 conn(0x7f68b00d11c0 msgr2=0x7f68b00d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:50.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.482+0000 7f68b5835700 1 -- 172.21.15.84:0/4118948094 shutdown_connections 2023-08-31T02:00:50.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.482+0000 7f68b5835700 1 -- 172.21.15.84:0/4118948094 wait complete. 2023-08-31T02:00:50.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.483+0000 7f68b5835700 1 Processor -- start 2023-08-31T02:00:50.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.483+0000 7f68b5835700 1 -- start start 2023-08-31T02:00:50.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68b5835700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898005210 0x7f68b01e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68b5835700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b01e63d0 0x7f68b0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68b5835700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68b00c6070 0x7f68b00ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68b5835700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b01e6850 con 0x7f68b00c6070 2023-08-31T02:00:50.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68b5835700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00c4cf0 con 0x7f6898005210 2023-08-31T02:00:50.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68b5835700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00c4fd0 con 0x7f68b01e63d0 2023-08-31T02:00:50.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68b00c6070 0x7f68b00ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68b00c6070 0x7f68b00ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52714/0 (socket says 172.21.15.84:52714) 2023-08-31T02:00:50.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 -- 172.21.15.84:0/1249412114 learned_addr learned my addr 172.21.15.84:0/1249412114 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:50.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68aeffd700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898005210 0x7f68b01e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68ae7fc700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b01e63d0 0x7f68b0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 -- 172.21.15.84:0/1249412114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b01e63d0 msgr2=0x7f68b0153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b01e63d0 0x7f68b0153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 -- 172.21.15.84:0/1249412114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898005210 msgr2=0x7f68b01e73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898005210 0x7f68b01e73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 -- 172.21.15.84:0/1249412114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00c52b0 con 0x7f68b00c6070 2023-08-31T02:00:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f68af7fe700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68b00c6070 0x7f68b00ca7e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f68b008a620 tx=0x7f68a8006810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.484+0000 7f6897fff700 1 -- 172.21.15.84:0/1249412114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80019b0 con 0x7f68b00c6070 2023-08-31T02:00:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.485+0000 7f6897fff700 1 -- 172.21.15.84:0/1249412114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f68a8004e80 con 0x7f68b00c6070 2023-08-31T02:00:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.485+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b00c5590 con 0x7f68b00c6070 2023-08-31T02:00:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.485+0000 7f6897fff700 1 -- 172.21.15.84:0/1249412114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8003c40 con 0x7f68b00c6070 2023-08-31T02:00:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.485+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b00c5b50 con 0x7f68b00c6070 2023-08-31T02:00:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.486+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b004e7c0 con 0x7f68b00c6070 2023-08-31T02:00:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.486+0000 7f6897fff700 1 -- 172.21.15.84:0/1249412114 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f68a8010480 con 0x7f68b00c6070 2023-08-31T02:00:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.486+0000 7f6897fff700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f689c06a0e0 0x7f689c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.487+0000 7f68aeffd700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f689c06a0e0 0x7f689c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.487+0000 7f6897fff700 1 -- 172.21.15.84:0/1249412114 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f68a8089fd0 con 0x7f68b00c6070 2023-08-31T02:00:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.487+0000 7f68aeffd700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f689c06a0e0 0x7f689c06c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009c60 tx=0x7f68a4009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.491+0000 7f6897fff700 1 -- 172.21.15.84:0/1249412114 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f68a80553b0 con 0x7f68b00c6070 2023-08-31T02:00:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.681+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68b006c720 con 0x7f68b00c6070 2023-08-31T02:00:50.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.682+0000 7f6897fff700 1 -- 172.21.15.84:0/1249412114 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68a8006a00 con 0x7f68b00c6070 2023-08-31T02:00:50.675 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f689c06a0e0 msgr2=0x7f689c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f689c06a0e0 0x7f689c06c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009c60 tx=0x7f68a4009260 comp rx=0 tx=0).stop 2023-08-31T02:00:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68b00c6070 msgr2=0x7f68b00ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68b00c6070 0x7f68b00ca7e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f68b008a620 tx=0x7f68a8006810 comp rx=0 tx=0).stop 2023-08-31T02:00:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 shutdown_connections 2023-08-31T02:00:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f689c06a0e0 0x7f689c06c5a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68b00c6070 0x7f68b00ca7e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898005210 0x7f68b01e73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 --2- 172.21.15.84:0/1249412114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b01e63d0 0x7f68b0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 >> 172.21.15.84:0/1249412114 conn(0x7f68b00d11c0 msgr2=0x7f68b015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:50.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 shutdown_connections 2023-08-31T02:00:50.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.684+0000 7f68b5835700 1 -- 172.21.15.84:0/1249412114 wait complete. 2023-08-31T02:00:50.689 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:50.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.821+0000 7f09e594c700 1 -- 172.21.15.84:0/2779351664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbb30 msgr2=0x7f09e006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.821+0000 7f09e594c700 1 --2- 172.21.15.84:0/2779351664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbb30 0x7f09e006d1c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09d00098c0 tx=0x7f09d0009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.821+0000 7f09e594c700 1 -- 172.21.15.84:0/2779351664 shutdown_connections 2023-08-31T02:00:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.821+0000 7f09e594c700 1 --2- 172.21.15.84:0/2779351664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbb30 0x7f09e006d1c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.821+0000 7f09e594c700 1 --2- 172.21.15.84:0/2779351664 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09e00cbf10 0x7f09e00b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.821+0000 7f09e594c700 1 -- 172.21.15.84:0/2779351664 >> 172.21.15.84:0/2779351664 conn(0x7f09e00ae7d0 msgr2=0x7f09e00aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.821+0000 7f09e594c700 1 -- 172.21.15.84:0/2779351664 shutdown_connections 2023-08-31T02:00:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.821+0000 7f09e594c700 1 -- 172.21.15.84:0/2779351664 wait complete. 2023-08-31T02:00:50.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.823+0000 7f09e594c700 1 Processor -- start 2023-08-31T02:00:50.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.823+0000 7f09e594c700 1 -- start start 2023-08-31T02:00:50.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09e594c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09e00cbb30 0x7f09e0159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09e594c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbf10 0x7f09e009a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09e594c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09e009a6b0 0x7f09e006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09e594c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e009ab40 con 0x7f09e00cbb30 2023-08-31T02:00:50.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09e594c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e006b6b0 con 0x7f09e00cbf10 2023-08-31T02:00:50.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09e594c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e006b990 con 0x7f09e009a6b0 2023-08-31T02:00:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09e00cbb30 0x7f09e0159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09e00cbb30 0x7f09e0159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52724/0 (socket says 172.21.15.84:52724) 2023-08-31T02:00:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 -- 172.21.15.84:0/2750463728 learned_addr learned my addr 172.21.15.84:0/2750463728 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09de7fc700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbf10 0x7f09e009a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 -- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09e009a6b0 msgr2=0x7f09e006a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09df7fe700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09e009a6b0 0x7f09e006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09e009a6b0 0x7f09e006a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 -- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbf10 msgr2=0x7f09e009a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:50.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbf10 0x7f09e009a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 -- 172.21.15.84:0/2750463728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0009520 con 0x7f09e00cbb30 2023-08-31T02:00:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09de7fc700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbf10 0x7f09e009a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09deffd700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09e00cbb30 0x7f09e0159dd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009230 tx=0x7f09d000f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09c7fff700 1 -- 172.21.15.84:0/2750463728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0025070 con 0x7f09e00cbb30 2023-08-31T02:00:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09c7fff700 1 -- 172.21.15.84:0/2750463728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f09d000fc70 con 0x7f09e00cbb30 2023-08-31T02:00:50.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e006bc70 con 0x7f09e00cbb30 2023-08-31T02:00:50.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.824+0000 7f09c7fff700 1 -- 172.21.15.84:0/2750463728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d001b040 con 0x7f09e00cbb30 2023-08-31T02:00:50.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.825+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e006c230 con 0x7f09e00cbb30 2023-08-31T02:00:50.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.825+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e00af9c0 con 0x7f09e00cbb30 2023-08-31T02:00:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.826+0000 7f09c7fff700 1 -- 172.21.15.84:0/2750463728 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f09d0004a90 con 0x7f09e00cbb30 2023-08-31T02:00:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.826+0000 7f09c7fff700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09cc06a0e0 0x7f09cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.826+0000 7f09c7fff700 1 -- 172.21.15.84:0/2750463728 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f09d008a8a0 con 0x7f09e00cbb30 2023-08-31T02:00:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.826+0000 7f09de7fc700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09cc06a0e0 0x7f09cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:50.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.826+0000 7f09de7fc700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09cc06a0e0 0x7f09cc06c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f09e015d420 tx=0x7f09d4009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:50.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:50.830+0000 7f09c7fff700 1 -- 172.21.15.84:0/2750463728 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f09d0055e20 con 0x7f09e00cbb30 2023-08-31T02:00:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.017+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09e0097a50 con 0x7f09e00cbb30 2023-08-31T02:00:51.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.017+0000 7f09c7fff700 1 -- 172.21.15.84:0/2750463728 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f09d0004d40 con 0x7f09e00cbb30 2023-08-31T02:00:51.010 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09cc06a0e0 msgr2=0x7f09cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09cc06a0e0 0x7f09cc06c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f09e015d420 tx=0x7f09d4009260 comp rx=0 tx=0).stop 2023-08-31T02:00:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09e00cbb30 msgr2=0x7f09e0159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09e00cbb30 0x7f09e0159dd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009230 tx=0x7f09d000f7c0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 shutdown_connections 2023-08-31T02:00:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09cc06a0e0 0x7f09cc06c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09e009a6b0 0x7f09e006a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09e00cbb30 0x7f09e0159dd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 --2- 172.21.15.84:0/2750463728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09e00cbf10 0x7f09e009a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 >> 172.21.15.84:0/2750463728 conn(0x7f09e00ae7d0 msgr2=0x7f09e00c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 shutdown_connections 2023-08-31T02:00:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.019+0000 7f09e594c700 1 -- 172.21.15.84:0/2750463728 wait complete. 2023-08-31T02:00:51.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:51.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.157+0000 7fc557028700 1 -- 172.21.15.84:0/314323861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 msgr2=0x7fc540003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.157+0000 7fc557028700 1 --2- 172.21.15.84:0/314323861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 0x7fc540003e20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc54400c2e0 tx=0x7fc540005880 comp rx=0 tx=0).stop 2023-08-31T02:00:51.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.157+0000 7fc5555c5700 1 -- 172.21.15.84:0/314323861 reap_dead start 2023-08-31T02:00:51.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.157+0000 7fc557028700 1 -- 172.21.15.84:0/314323861 shutdown_connections 2023-08-31T02:00:51.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.157+0000 7fc557028700 1 -- 172.21.15.84:0/314323861 >> 172.21.15.84:0/314323861 conn(0x7fc5500afb00 msgr2=0x7fc5500aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:51.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.157+0000 7fc557028700 1 -- 172.21.15.84:0/314323861 shutdown_connections 2023-08-31T02:00:51.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.157+0000 7fc557028700 1 -- 172.21.15.84:0/314323861 wait complete. 2023-08-31T02:00:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.159+0000 7fc557028700 1 Processor -- start 2023-08-31T02:00:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.159+0000 7fc557028700 1 -- start start 2023-08-31T02:00:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.159+0000 7fc557028700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 0x7fc55014fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.159+0000 7fc557028700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5501508d0 0x7fc5500ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.159+0000 7fc557028700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc550150260 0x7fc5500aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.159+0000 7fc557028700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500ac5e0 con 0x7fc540003a00 2023-08-31T02:00:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.159+0000 7fc557028700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500ab7b0 con 0x7fc550150260 2023-08-31T02:00:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.159+0000 7fc557028700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5501589f0 con 0x7fc5501508d0 2023-08-31T02:00:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 0x7fc55014fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 0x7fc55014fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52744/0 (socket says 172.21.15.84:52744) 2023-08-31T02:00:51.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 -- 172.21.15.84:0/3192159773 learned_addr learned my addr 172.21.15.84:0/3192159773 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:51.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc54ffff700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5501508d0 0x7fc5500ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc5555c5700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc550150260 0x7fc5500aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 -- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5501508d0 msgr2=0x7fc5500ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5501508d0 0x7fc5500ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 -- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc550150260 msgr2=0x7fc5500aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc550150260 0x7fc5500aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 -- 172.21.15.84:0/3192159773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500aaa70 con 0x7fc540003a00 2023-08-31T02:00:51.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc5555c5700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc550150260 0x7fc5500aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:51.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc554dc4700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 0x7fc55014fc20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc544011000 tx=0x7fc54400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:51.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc54d7fa700 1 -- 172.21.15.84:0/3192159773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544003680 con 0x7fc540003a00 2023-08-31T02:00:51.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc54d7fa700 1 -- 172.21.15.84:0/3192159773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc544003820 con 0x7fc540003a00 2023-08-31T02:00:51.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5500aad50 con 0x7fc540003a00 2023-08-31T02:00:51.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc54d7fa700 1 -- 172.21.15.84:0/3192159773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544003c30 con 0x7fc540003a00 2023-08-31T02:00:51.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.160+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5500c3ae0 con 0x7fc540003a00 2023-08-31T02:00:51.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.161+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5500aa8d0 con 0x7fc540003a00 2023-08-31T02:00:51.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.162+0000 7fc54d7fa700 1 -- 172.21.15.84:0/3192159773 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc544022070 con 0x7fc540003a00 2023-08-31T02:00:51.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.162+0000 7fc54d7fa700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc53406a0e0 0x7fc53406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.162+0000 7fc54d7fa700 1 -- 172.21.15.84:0/3192159773 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fc54408a920 con 0x7fc540003a00 2023-08-31T02:00:51.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.162+0000 7fc54ffff700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc53406a0e0 0x7fc53406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.162+0000 7fc54ffff700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc53406a0e0 0x7fc53406c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc550150cb0 tx=0x7fc53c009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:51.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.166+0000 7fc54d7fa700 1 -- 172.21.15.84:0/3192159773 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc5500aa8d0 con 0x7fc540003a00 2023-08-31T02:00:51.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.359+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5500aa8d0 con 0x7fc540003a00 2023-08-31T02:00:51.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.359+0000 7fc54d7fa700 1 -- 172.21.15.84:0/3192159773 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5500aa8d0 con 0x7fc540003a00 2023-08-31T02:00:51.352 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc53406a0e0 msgr2=0x7fc53406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc53406a0e0 0x7fc53406c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc550150cb0 tx=0x7fc53c009260 comp rx=0 tx=0).stop 2023-08-31T02:00:51.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 msgr2=0x7fc55014fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 0x7fc55014fc20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc544011000 tx=0x7fc54400cf20 comp rx=0 tx=0).stop 2023-08-31T02:00:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 shutdown_connections 2023-08-31T02:00:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc53406a0e0 0x7fc53406c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc550150260 0x7fc5500aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc540003a00 0x7fc55014fc20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 --2- 172.21.15.84:0/3192159773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5501508d0 0x7fc5500ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 >> 172.21.15.84:0/3192159773 conn(0x7fc5500afb00 msgr2=0x7fc55015c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 shutdown_connections 2023-08-31T02:00:51.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.361+0000 7fc557028700 1 -- 172.21.15.84:0/3192159773 wait complete. 2023-08-31T02:00:51.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:51.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.498+0000 7f6e56f1d700 1 -- 172.21.15.84:0/3250839065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 msgr2=0x7f6e500cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.498+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/3250839065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 0x7f6e500cb360 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6e500b1c90 tx=0x7f6e4800b380 comp rx=0 tx=0).stop 2023-08-31T02:00:51.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.498+0000 7f6e56f1d700 1 -- 172.21.15.84:0/3250839065 shutdown_connections 2023-08-31T02:00:51.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.498+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/3250839065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 0x7f6e500cb360 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.498+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/3250839065 >> v2:172.21.15.170:3300/0 conn(0x7f6e500cd3f0 0x7f6e500b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.498+0000 7f6e56f1d700 1 -- 172.21.15.84:0/3250839065 >> 172.21.15.84:0/3250839065 conn(0x7f6e500b0c40 msgr2=0x7f6e500b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.499+0000 7f6e56f1d700 1 -- 172.21.15.84:0/3250839065 shutdown_connections 2023-08-31T02:00:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.499+0000 7f6e56f1d700 1 -- 172.21.15.84:0/3250839065 wait complete. 2023-08-31T02:00:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.500+0000 7f6e56f1d700 1 Processor -- start 2023-08-31T02:00:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.500+0000 7f6e56f1d700 1 -- start start 2023-08-31T02:00:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e56f1d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e500cd3f0 0x7f6e500c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e56f1d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50159320 0x7f6e501474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e56f1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 0x7f6e501f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e56f1d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501f5880 con 0x7f6e5015d750 2023-08-31T02:00:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e56f1d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500c7850 con 0x7f6e50159320 2023-08-31T02:00:51.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e56f1d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501e53e0 con 0x7f6e500cd3f0 2023-08-31T02:00:51.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 0x7f6e501f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 0x7f6e501f48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52762/0 (socket says 172.21.15.84:52762) 2023-08-31T02:00:51.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 -- 172.21.15.84:0/1770145666 learned_addr learned my addr 172.21.15.84:0/1770145666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:51.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e4ffff700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50159320 0x7f6e501474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e54cb9700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e500cd3f0 0x7f6e500c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 -- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e500cd3f0 msgr2=0x7f6e500c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e500cd3f0 0x7f6e500c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 -- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50159320 msgr2=0x7f6e501474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50159320 0x7f6e501474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 -- 172.21.15.84:0/1770145666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009d00 con 0x7f6e5015d750 2023-08-31T02:00:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e4ffff700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50159320 0x7f6e501474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e554ba700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 0x7f6e501f48d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6e48003fa0 tx=0x7f6e48009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e4d7fa700 1 -- 172.21.15.84:0/1770145666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800e040 con 0x7f6e5015d750 2023-08-31T02:00:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e4d7fa700 1 -- 172.21.15.84:0/1770145666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e48007be0 con 0x7f6e5015d750 2023-08-31T02:00:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e4d7fa700 1 -- 172.21.15.84:0/1770145666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48004030 con 0x7f6e5015d750 2023-08-31T02:00:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e501e5680 con 0x7f6e5015d750 2023-08-31T02:00:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.501+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e501f55a0 con 0x7f6e5015d750 2023-08-31T02:00:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.502+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5004e7c0 con 0x7f6e5015d750 2023-08-31T02:00:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.503+0000 7f6e4d7fa700 1 -- 172.21.15.84:0/1770145666 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6e480041b0 con 0x7f6e5015d750 2023-08-31T02:00:51.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.503+0000 7f6e4d7fa700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6e3406a0e0 0x7f6e3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.503+0000 7f6e4d7fa700 1 -- 172.21.15.84:0/1770145666 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6e480899c0 con 0x7f6e5015d750 2023-08-31T02:00:51.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.503+0000 7f6e54cb9700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6e3406a0e0 0x7f6e3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.503+0000 7f6e54cb9700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6e3406a0e0 0x7f6e3406c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e44003e60 tx=0x7f6e44009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:51.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.508+0000 7f6e4d7fa700 1 -- 172.21.15.84:0/1770145666 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6e48054ee0 con 0x7f6e5015d750 2023-08-31T02:00:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.699+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6e500cc4a0 con 0x7f6e5015d750 2023-08-31T02:00:51.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.699+0000 7f6e4d7fa700 1 -- 172.21.15.84:0/1770145666 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6e48017020 con 0x7f6e5015d750 2023-08-31T02:00:51.692 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.701+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6e3406a0e0 msgr2=0x7f6e3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.701+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6e3406a0e0 0x7f6e3406c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e44003e60 tx=0x7f6e44009040 comp rx=0 tx=0).stop 2023-08-31T02:00:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.701+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 msgr2=0x7f6e501f48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.701+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 0x7f6e501f48d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6e48003fa0 tx=0x7f6e48009450 comp rx=0 tx=0).stop 2023-08-31T02:00:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.702+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 shutdown_connections 2023-08-31T02:00:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.702+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6e3406a0e0 0x7f6e3406c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.702+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5015d750 0x7f6e501f48d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.702+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e500cd3f0 0x7f6e500c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.702+0000 7f6e56f1d700 1 --2- 172.21.15.84:0/1770145666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50159320 0x7f6e501474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.702+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 >> 172.21.15.84:0/1770145666 conn(0x7f6e500b0c40 msgr2=0x7f6e50157170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.702+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 shutdown_connections 2023-08-31T02:00:51.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.702+0000 7f6e56f1d700 1 -- 172.21.15.84:0/1770145666 wait complete. 2023-08-31T02:00:51.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:00:51.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.837+0000 7fe2b9e11700 1 -- 172.21.15.84:0/1913375629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b40c99b0 msgr2=0x7fe2b40708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.837+0000 7fe2b9e11700 1 --2- 172.21.15.84:0/1913375629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b40c99b0 0x7fe2b40708a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009990 tx=0x7fe29c009ca0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.837+0000 7fe2b9e11700 1 -- 172.21.15.84:0/1913375629 shutdown_connections 2023-08-31T02:00:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.837+0000 7fe2b9e11700 1 --2- 172.21.15.84:0/1913375629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b40c99b0 0x7fe2b40708a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.837+0000 7fe2b9e11700 1 -- 172.21.15.84:0/1913375629 >> 172.21.15.84:0/1913375629 conn(0x7fe2b40cdeb0 msgr2=0x7fe2b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.837+0000 7fe2b9e11700 1 -- 172.21.15.84:0/1913375629 shutdown_connections 2023-08-31T02:00:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.837+0000 7fe2b9e11700 1 -- 172.21.15.84:0/1913375629 wait complete. 2023-08-31T02:00:51.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.838+0000 7fe2b9e11700 1 Processor -- start 2023-08-31T02:00:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.838+0000 7fe2b9e11700 1 -- start start 2023-08-31T02:00:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b9e11700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2b40b0d00 0x7fe2b406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b9e11700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2b40c99b0 0x7fe2b41e3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b9e11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4158120 0x7fe2b414cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b9e11700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b406a230 con 0x7fe2b4158120 2023-08-31T02:00:51.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b9e11700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b406a510 con 0x7fe2b40b0d00 2023-08-31T02:00:51.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b9e11700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b406a7f0 con 0x7fe2b40c99b0 2023-08-31T02:00:51.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4158120 0x7fe2b414cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4158120 0x7fe2b414cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52776/0 (socket says 172.21.15.84:52776) 2023-08-31T02:00:51.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.839+0000 7fe2b3fff700 1 -- 172.21.15.84:0/2259571246 learned_addr learned my addr 172.21.15.84:0/2259571246 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b37fe700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2b40b0d00 0x7fe2b406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b2ffd700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2b40c99b0 0x7fe2b41e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b3fff700 1 -- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2b40c99b0 msgr2=0x7fe2b41e3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b3fff700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2b40c99b0 0x7fe2b41e3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b3fff700 1 -- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2b40b0d00 msgr2=0x7fe2b406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b3fff700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2b40b0d00 0x7fe2b406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b3fff700 1 -- 172.21.15.84:0/2259571246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0095f0 con 0x7fe2b4158120 2023-08-31T02:00:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b37fe700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2b40b0d00 0x7fe2b406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b2ffd700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2b40c99b0 0x7fe2b41e3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b3fff700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4158120 0x7fe2b414cc80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00cbc0 tx=0x7fe2ac00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2abfff700 1 -- 172.21.15.84:0/2259571246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac003c00 con 0x7fe2b4158120 2023-08-31T02:00:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2abfff700 1 -- 172.21.15.84:0/2259571246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe2ac003d60 con 0x7fe2b4158120 2023-08-31T02:00:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b406aad0 con 0x7fe2b4158120 2023-08-31T02:00:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2abfff700 1 -- 172.21.15.84:0/2259571246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00ac10 con 0x7fe2b4158120 2023-08-31T02:00:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.840+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b406d4b0 con 0x7fe2b4158120 2023-08-31T02:00:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.841+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b406aff0 con 0x7fe2b4158120 2023-08-31T02:00:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.841+0000 7fe2abfff700 1 -- 172.21.15.84:0/2259571246 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2ac0050d0 con 0x7fe2b4158120 2023-08-31T02:00:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.842+0000 7fe2abfff700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe29406a0e0 0x7fe29406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.842+0000 7fe2abfff700 1 -- 172.21.15.84:0/2259571246 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe2ac088ba0 con 0x7fe2b4158120 2023-08-31T02:00:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.842+0000 7fe2b37fe700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe29406a0e0 0x7fe29406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.842+0000 7fe2b37fe700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe29406a0e0 0x7fe29406c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006fd0 tx=0x7fe2a4008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:51.846+0000 7fe2abfff700 1 -- 172.21.15.84:0/2259571246 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe2b406aff0 con 0x7fe2b4158120 2023-08-31T02:00:52.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.051+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe2b406aff0 con 0x7fe2b4158120 2023-08-31T02:00:52.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.052+0000 7fe2abfff700 1 -- 172.21.15.84:0/2259571246 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe2b406aff0 con 0x7fe2b4158120 2023-08-31T02:00:52.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe29406a0e0 msgr2=0x7fe29406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe29406a0e0 0x7fe29406c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006fd0 tx=0x7fe2a4008040 comp rx=0 tx=0).stop 2023-08-31T02:00:52.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4158120 msgr2=0x7fe2b414cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4158120 0x7fe2b414cc80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00cbc0 tx=0x7fe2ac00cf80 comp rx=0 tx=0).stop 2023-08-31T02:00:52.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 shutdown_connections 2023-08-31T02:00:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe29406a0e0 0x7fe29406c5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4158120 0x7fe2b414cc80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2b40b0d00 0x7fe2b406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 --2- 172.21.15.84:0/2259571246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2b40c99b0 0x7fe2b41e3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 >> 172.21.15.84:0/2259571246 conn(0x7fe2b40cdeb0 msgr2=0x7fe2b40658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:52.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 shutdown_connections 2023-08-31T02:00:52.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.054+0000 7fe2b9e11700 1 -- 172.21.15.84:0/2259571246 wait complete. 2023-08-31T02:00:52.049 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:00:52.059 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-08-31T02:00:52.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:52.059 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-31T02:00:52.104 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:00:52.104 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:00:52.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:52.105 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T02:00:52.122 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:00:52.122 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:52.147 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:00:52.148 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:52.208 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.339+0000 7fed8c883700 1 -- 172.21.15.84:0/3185397020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed88158220 msgr2=0x7fed880cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.339+0000 7fed8c883700 1 --2- 172.21.15.84:0/3185397020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed88158220 0x7fed880cc920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed780098c0 tx=0x7fed78009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.339+0000 7fed8c883700 1 -- 172.21.15.84:0/3185397020 shutdown_connections 2023-08-31T02:00:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.339+0000 7fed8c883700 1 --2- 172.21.15.84:0/3185397020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed88158220 0x7fed880cc920 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.339+0000 7fed8c883700 1 --2- 172.21.15.84:0/3185397020 >> v2:172.21.15.170:3300/0 conn(0x7fed880707c0 0x7fed88070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.339+0000 7fed8c883700 1 -- 172.21.15.84:0/3185397020 >> 172.21.15.84:0/3185397020 conn(0x7fed880caa20 msgr2=0x7fed880cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.339+0000 7fed8c883700 1 -- 172.21.15.84:0/3185397020 shutdown_connections 2023-08-31T02:00:52.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.339+0000 7fed8c883700 1 -- 172.21.15.84:0/3185397020 wait complete. 2023-08-31T02:00:52.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.340+0000 7fed8c883700 1 Processor -- start 2023-08-31T02:00:52.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.340+0000 7fed8c883700 1 -- start start 2023-08-31T02:00:52.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed8c883700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed880707c0 0x7fed8814b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:52.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed8c883700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed880b0df0 0x7fed880af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:52.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed8c883700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed88158220 0x7fed880af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:52.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed8c883700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed881ef740 con 0x7fed880b0df0 2023-08-31T02:00:52.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed8c883700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed880c3a30 con 0x7fed88158220 2023-08-31T02:00:52.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed8c883700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed88154b80 con 0x7fed880707c0 2023-08-31T02:00:52.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed880b0df0 0x7fed880af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:52.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed880b0df0 0x7fed880af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52786/0 (socket says 172.21.15.84:52786) 2023-08-31T02:00:52.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed85d9b700 1 -- 172.21.15.84:0/1269159709 learned_addr learned my addr 172.21.15.84:0/1269159709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:52.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed8659c700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed880707c0 0x7fed8814b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.341+0000 7fed86d9d700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed88158220 0x7fed880af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed85d9b700 1 -- 172.21.15.84:0/1269159709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed880707c0 msgr2=0x7fed8814b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed85d9b700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed880707c0 0x7fed8814b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed85d9b700 1 -- 172.21.15.84:0/1269159709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed88158220 msgr2=0x7fed880af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed85d9b700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed88158220 0x7fed880af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed85d9b700 1 -- 172.21.15.84:0/1269159709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed80009c40 con 0x7fed880b0df0 2023-08-31T02:00:52.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed85d9b700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed880b0df0 0x7fed880af2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c490 tx=0x7fed7c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed76ffd700 1 -- 172.21.15.84:0/1269159709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c004230 con 0x7fed880b0df0 2023-08-31T02:00:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed76ffd700 1 -- 172.21.15.84:0/1269159709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fed7c00ce90 con 0x7fed880b0df0 2023-08-31T02:00:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed78009520 con 0x7fed880b0df0 2023-08-31T02:00:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed76ffd700 1 -- 172.21.15.84:0/1269159709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c003680 con 0x7fed880b0df0 2023-08-31T02:00:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.342+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed881548a0 con 0x7fed880b0df0 2023-08-31T02:00:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.343+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed881ef880 con 0x7fed880b0df0 2023-08-31T02:00:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.343+0000 7fed76ffd700 1 -- 172.21.15.84:0/1269159709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fed7c0037e0 con 0x7fed880b0df0 2023-08-31T02:00:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.344+0000 7fed76ffd700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed6806a0e0 0x7fed6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.344+0000 7fed76ffd700 1 -- 172.21.15.84:0/1269159709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fed7c087de0 con 0x7fed880b0df0 2023-08-31T02:00:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.344+0000 7fed8659c700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed6806a0e0 0x7fed6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.344+0000 7fed8659c700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed6806a0e0 0x7fed6806c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fed78000c00 tx=0x7fed78011040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.348+0000 7fed76ffd700 1 -- 172.21.15.84:0/1269159709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fed881ef880 con 0x7fed880b0df0 2023-08-31T02:00:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.538+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed881ef880 con 0x7fed880b0df0 2023-08-31T02:00:52.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.539+0000 7fed76ffd700 1 -- 172.21.15.84:0/1269159709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7fed881ef880 con 0x7fed880b0df0 2023-08-31T02:00:52.532 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:52.532 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:52.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed6806a0e0 msgr2=0x7fed6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed6806a0e0 0x7fed6806c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fed78000c00 tx=0x7fed78011040 comp rx=0 tx=0).stop 2023-08-31T02:00:52.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed880b0df0 msgr2=0x7fed880af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed880b0df0 0x7fed880af2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c490 tx=0x7fed7c00c7a0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 shutdown_connections 2023-08-31T02:00:52.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fed6806a0e0 0x7fed6806c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed88158220 0x7fed880af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed880707c0 0x7fed8814b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 --2- 172.21.15.84:0/1269159709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed880b0df0 0x7fed880af2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 >> 172.21.15.84:0/1269159709 conn(0x7fed880caa20 msgr2=0x7fed8815ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:52.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 shutdown_connections 2023-08-31T02:00:52.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.541+0000 7fed8c883700 1 -- 172.21.15.84:0/1269159709 wait complete. 2023-08-31T02:00:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:52.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 -- 172.21.15.84:0/2723940964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f612415d750 msgr2=0x7f61240ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 --2- 172.21.15.84:0/2723940964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f612415d750 0x7f61240ccce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f61240b5200 tx=0x7f6110009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 -- 172.21.15.84:0/2723940964 shutdown_connections 2023-08-31T02:00:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 --2- 172.21.15.84:0/2723940964 >> v2:172.21.15.170:3300/0 conn(0x7f61240cd220 0x7f61240aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 --2- 172.21.15.84:0/2723940964 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159320 0x7f61240b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 --2- 172.21.15.84:0/2723940964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f612415d750 0x7f61240ccce0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 -- 172.21.15.84:0/2723940964 >> 172.21.15.84:0/2723940964 conn(0x7f61240b0c40 msgr2=0x7f61240b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 -- 172.21.15.84:0/2723940964 shutdown_connections 2023-08-31T02:00:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.682+0000 7f612b0bf700 1 -- 172.21.15.84:0/2723940964 wait complete. 2023-08-31T02:00:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.683+0000 7f612b0bf700 1 Processor -- start 2023-08-31T02:00:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.683+0000 7f612b0bf700 1 -- start start 2023-08-31T02:00:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f612b0bf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61240cd220 0x7f612414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f612b0bf700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159320 0x7f612415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f612b0bf700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f612415d750 0x7f612415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f612b0bf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612406c310 con 0x7f61240cd220 2023-08-31T02:00:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f612b0bf700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61240c7da0 con 0x7f612415d750 2023-08-31T02:00:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f612b0bf700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61240c7460 con 0x7f6124159320 2023-08-31T02:00:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6128e5b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61240cd220 0x7f612414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:52.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6128e5b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61240cd220 0x7f612414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52798/0 (socket says 172.21.15.84:52798) 2023-08-31T02:00:52.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6128e5b700 1 -- 172.21.15.84:0/3074790412 learned_addr learned my addr 172.21.15.84:0/3074790412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:52.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6123fff700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159320 0x7f612415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:52.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f612965c700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f612415d750 0x7f612415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:52.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6128e5b700 1 -- 172.21.15.84:0/3074790412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159320 msgr2=0x7f612415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6128e5b700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159320 0x7f612415b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6128e5b700 1 -- 172.21.15.84:0/3074790412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f612415d750 msgr2=0x7f612415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6128e5b700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f612415d750 0x7f612415b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.684+0000 7f6128e5b700 1 -- 172.21.15.84:0/3074790412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100095f0 con 0x7f61240cd220 2023-08-31T02:00:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.685+0000 7f6128e5b700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61240cd220 0x7f612414b890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f611800b560 tx=0x7f611800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.685+0000 7f61217fa700 1 -- 172.21.15.84:0/3074790412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118011830 con 0x7f61240cd220 2023-08-31T02:00:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.685+0000 7f61217fa700 1 -- 172.21.15.84:0/3074790412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6118011a80 con 0x7f61240cd220 2023-08-31T02:00:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.685+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612414bdd0 con 0x7f61240cd220 2023-08-31T02:00:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.685+0000 7f61217fa700 1 -- 172.21.15.84:0/3074790412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118011e90 con 0x7f61240cd220 2023-08-31T02:00:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.685+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61240c76e0 con 0x7f61240cd220 2023-08-31T02:00:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.686+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612404e7c0 con 0x7f61240cd220 2023-08-31T02:00:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.686+0000 7f61217fa700 1 -- 172.21.15.84:0/3074790412 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f611801a400 con 0x7f61240cd220 2023-08-31T02:00:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.686+0000 7f61217fa700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f610806a0e0 0x7f610806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.687+0000 7f61217fa700 1 -- 172.21.15.84:0/3074790412 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6118088a70 con 0x7f61240cd220 2023-08-31T02:00:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.687+0000 7f6123fff700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f610806a0e0 0x7f610806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:52.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.687+0000 7f6123fff700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f610806a0e0 0x7f610806c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61240aeeb0 tx=0x7f6110011040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:52.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.691+0000 7f61217fa700 1 -- 172.21.15.84:0/3074790412 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6118053ed0 con 0x7f61240cd220 2023-08-31T02:00:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.880+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f612406d650 con 0x7f61240cd220 2023-08-31T02:00:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.880+0000 7f61217fa700 1 -- 172.21.15.84:0/3074790412 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61180574f0 con 0x7f61240cd220 2023-08-31T02:00:52.873 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:52.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f610806a0e0 msgr2=0x7f610806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f610806a0e0 0x7f610806c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61240aeeb0 tx=0x7f6110011040 comp rx=0 tx=0).stop 2023-08-31T02:00:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61240cd220 msgr2=0x7f612414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61240cd220 0x7f612414b890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f611800b560 tx=0x7f611800b920 comp rx=0 tx=0).stop 2023-08-31T02:00:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 shutdown_connections 2023-08-31T02:00:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f610806a0e0 0x7f610806c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f612415d750 0x7f612415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61240cd220 0x7f612414b890 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 --2- 172.21.15.84:0/3074790412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159320 0x7f612415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:52.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.882+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 >> 172.21.15.84:0/3074790412 conn(0x7f61240b0c40 msgr2=0x7f612406ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:52.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.883+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 shutdown_connections 2023-08-31T02:00:52.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:52.883+0000 7f612b0bf700 1 -- 172.21.15.84:0/3074790412 wait complete. 2023-08-31T02:00:52.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.020+0000 7f803d5f4700 1 -- 172.21.15.84:0/2567833398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020003a00 msgr2=0x7f8020003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.020+0000 7f803d5f4700 1 --2- 172.21.15.84:0/2567833398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020003a00 0x7f8020003e20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c310 tx=0x7f8020005880 comp rx=0 tx=0).stop 2023-08-31T02:00:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.020+0000 7f803d5f4700 1 -- 172.21.15.84:0/2567833398 shutdown_connections 2023-08-31T02:00:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.020+0000 7f803d5f4700 1 --2- 172.21.15.84:0/2567833398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020003a00 0x7f8020003e20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.020+0000 7f803d5f4700 1 -- 172.21.15.84:0/2567833398 >> 172.21.15.84:0/2567833398 conn(0x7f80380afb00 msgr2=0x7f80380aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.020+0000 7f803d5f4700 1 -- 172.21.15.84:0/2567833398 shutdown_connections 2023-08-31T02:00:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.020+0000 7f803d5f4700 1 -- 172.21.15.84:0/2567833398 wait complete. 2023-08-31T02:00:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.021+0000 7f803d5f4700 1 Processor -- start 2023-08-31T02:00:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.021+0000 7f803d5f4700 1 -- start start 2023-08-31T02:00:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f803d5f4700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8020003a00 0x7f803806a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f803d5f4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80380c19e0 0x7f80380c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f803d5f4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80380c4630 0x7f80381f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f803d5f4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380aa9b0 con 0x7f80380c4630 2023-08-31T02:00:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f803d5f4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380c61b0 con 0x7f80380c19e0 2023-08-31T02:00:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f803d5f4700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80380c6490 con 0x7f8020003a00 2023-08-31T02:00:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f80377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80380c4630 0x7f80381f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f80377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80380c4630 0x7f80381f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52822/0 (socket says 172.21.15.84:52822) 2023-08-31T02:00:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.022+0000 7f80377fe700 1 -- 172.21.15.84:0/3805643877 learned_addr learned my addr 172.21.15.84:0/3805643877 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f80367fc700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80380c19e0 0x7f80380c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f8036ffd700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8020003a00 0x7f803806a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f80377fe700 1 -- 172.21.15.84:0/3805643877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8020003a00 msgr2=0x7f803806a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f80377fe700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8020003a00 0x7f803806a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f80377fe700 1 -- 172.21.15.84:0/3805643877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80380c19e0 msgr2=0x7f80380c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f80377fe700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80380c19e0 0x7f80380c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f80377fe700 1 -- 172.21.15.84:0/3805643877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380c6770 con 0x7f80380c4630 2023-08-31T02:00:53.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f80377fe700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80380c4630 0x7f80381f4000 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f80380702a0 tx=0x7f80300018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:53.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f801f7fe700 1 -- 172.21.15.84:0/3805643877 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030011660 con 0x7f80380c4630 2023-08-31T02:00:53.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f801f7fe700 1 -- 172.21.15.84:0/3805643877 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f80300118d0 con 0x7f80380c4630 2023-08-31T02:00:53.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80380c6a50 con 0x7f80380c4630 2023-08-31T02:00:53.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f801f7fe700 1 -- 172.21.15.84:0/3805643877 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030011ce0 con 0x7f80380c4630 2023-08-31T02:00:53.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.023+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803806a9e0 con 0x7f80380c4630 2023-08-31T02:00:53.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.024+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80380aaaf0 con 0x7f80380c4630 2023-08-31T02:00:53.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.024+0000 7f801f7fe700 1 -- 172.21.15.84:0/3805643877 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f803001a400 con 0x7f80380c4630 2023-08-31T02:00:53.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.025+0000 7f801f7fe700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f802406a0e0 0x7f802406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.025+0000 7f801f7fe700 1 -- 172.21.15.84:0/3805643877 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f80300893c0 con 0x7f80380c4630 2023-08-31T02:00:53.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.025+0000 7f8036ffd700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f802406a0e0 0x7f802406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.025+0000 7f8036ffd700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f802406a0e0 0x7f802406c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f802c000c00 tx=0x7f802c00f000 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:53.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.029+0000 7f801f7fe700 1 -- 172.21.15.84:0/3805643877 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f80380aaaf0 con 0x7f80380c4630 2023-08-31T02:00:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.219+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80380aaaf0 con 0x7f80380c4630 2023-08-31T02:00:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.219+0000 7f801f7fe700 1 -- 172.21.15.84:0/3805643877 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80380aaaf0 con 0x7f80380c4630 2023-08-31T02:00:53.212 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f802406a0e0 msgr2=0x7f802406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f802406a0e0 0x7f802406c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f802c000c00 tx=0x7f802c00f000 comp rx=0 tx=0).stop 2023-08-31T02:00:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80380c4630 msgr2=0x7f80381f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80380c4630 0x7f80381f4000 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f80380702a0 tx=0x7f80300018c0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 shutdown_connections 2023-08-31T02:00:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f802406a0e0 0x7f802406c5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80380c4630 0x7f80381f4000 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8020003a00 0x7f803806a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 --2- 172.21.15.84:0/3805643877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80380c19e0 0x7f80380c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 >> 172.21.15.84:0/3805643877 conn(0x7f80380afb00 msgr2=0x7f80381567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 shutdown_connections 2023-08-31T02:00:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.221+0000 7f803d5f4700 1 -- 172.21.15.84:0/3805643877 wait complete. 2023-08-31T02:00:53.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:53.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.360+0000 7f02c2a1e700 1 -- 172.21.15.84:0/3232436748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc0cd380 msgr2=0x7f02bc159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.360+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/3232436748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc0cd380 0x7f02bc159140 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0cb4e0 tx=0x7f02ac009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:53.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.360+0000 7f02c2a1e700 1 -- 172.21.15.84:0/3232436748 shutdown_connections 2023-08-31T02:00:53.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.360+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/3232436748 >> v2:172.21.15.170:3300/0 conn(0x7f02bc0ca0c0 0x7f02bc14ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.360+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/3232436748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc0cd380 0x7f02bc159140 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.360+0000 7f02c2a1e700 1 -- 172.21.15.84:0/3232436748 >> 172.21.15.84:0/3232436748 conn(0x7f02bc0ca930 msgr2=0x7f02bc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.360+0000 7f02c2a1e700 1 -- 172.21.15.84:0/3232436748 shutdown_connections 2023-08-31T02:00:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.360+0000 7f02c2a1e700 1 -- 172.21.15.84:0/3232436748 wait complete. 2023-08-31T02:00:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.361+0000 7f02c2a1e700 1 Processor -- start 2023-08-31T02:00:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.361+0000 7f02c2a1e700 1 -- start start 2023-08-31T02:00:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c2a1e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02bc0ca0c0 0x7f02bc155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c2a1e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02bc0cd380 0x7f02bc14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c2a1e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc15c930 0x7f02bc14cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c2a1e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc1544b0 con 0x7f02bc15c930 2023-08-31T02:00:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c2a1e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc153830 con 0x7f02bc0ca0c0 2023-08-31T02:00:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c2a1e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc153b10 con 0x7f02bc0cd380 2023-08-31T02:00:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc15c930 0x7f02bc14cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc15c930 0x7f02bc14cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52836/0 (socket says 172.21.15.84:52836) 2023-08-31T02:00:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 -- 172.21.15.84:0/2899162316 learned_addr learned my addr 172.21.15.84:0/2899162316 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:53.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02bbfff700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02bc0ca0c0 0x7f02bc155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02bb7fe700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02bc0cd380 0x7f02bc14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 -- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02bc0cd380 msgr2=0x7f02bc14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02bc0cd380 0x7f02bc14c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 -- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02bc0ca0c0 msgr2=0x7f02bc155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02bc0ca0c0 0x7f02bc155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 -- 172.21.15.84:0/2899162316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac0095f0 con 0x7f02bc15c930 2023-08-31T02:00:53.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02bbfff700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02bc0ca0c0 0x7f02bc155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:53.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.362+0000 7f02c0fbb700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc15c930 0x7f02bc14cec0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f02b400b9e0 tx=0x7f02b400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:53.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.363+0000 7f02b8ff9700 1 -- 172.21.15.84:0/2899162316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b400c930 con 0x7f02bc15c930 2023-08-31T02:00:53.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.363+0000 7f02b8ff9700 1 -- 172.21.15.84:0/2899162316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f02b400cba0 con 0x7f02bc15c930 2023-08-31T02:00:53.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.363+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc153df0 con 0x7f02bc15c930 2023-08-31T02:00:53.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.363+0000 7f02b8ff9700 1 -- 172.21.15.84:0/2899162316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4014440 con 0x7f02bc15c930 2023-08-31T02:00:53.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.363+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc14d400 con 0x7f02bc15c930 2023-08-31T02:00:53.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.363+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc04e7c0 con 0x7f02bc15c930 2023-08-31T02:00:53.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.364+0000 7f02b8ff9700 1 -- 172.21.15.84:0/2899162316 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f02b401d3b0 con 0x7f02bc15c930 2023-08-31T02:00:53.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.364+0000 7f02b8ff9700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f02a806a0e0 0x7f02a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.364+0000 7f02b8ff9700 1 -- 172.21.15.84:0/2899162316 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f02b4006e40 con 0x7f02bc15c930 2023-08-31T02:00:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.364+0000 7f02bbfff700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f02a806a0e0 0x7f02a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.365+0000 7f02bbfff700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f02a806a0e0 0x7f02a806c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0098e0 tx=0x7f02ac0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.369+0000 7f02b8ff9700 1 -- 172.21.15.84:0/2899162316 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f02b4053b90 con 0x7f02bc15c930 2023-08-31T02:00:53.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.557+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02bc15c1c0 con 0x7f02bc15c930 2023-08-31T02:00:53.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.557+0000 7f02b8ff9700 1 -- 172.21.15.84:0/2899162316 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02b40571b0 con 0x7f02bc15c930 2023-08-31T02:00:53.550 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:53.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f02a806a0e0 msgr2=0x7f02a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f02a806a0e0 0x7f02a806c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0098e0 tx=0x7f02ac0047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc15c930 msgr2=0x7f02bc14cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc15c930 0x7f02bc14cec0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f02b400b9e0 tx=0x7f02b400bda0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 shutdown_connections 2023-08-31T02:00:53.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f02a806a0e0 0x7f02a806c5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc15c930 0x7f02bc14cec0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02bc0ca0c0 0x7f02bc155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 --2- 172.21.15.84:0/2899162316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02bc0cd380 0x7f02bc14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 >> 172.21.15.84:0/2899162316 conn(0x7f02bc0ca930 msgr2=0x7f02bc0c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:53.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 shutdown_connections 2023-08-31T02:00:53.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.559+0000 7f02c2a1e700 1 -- 172.21.15.84:0/2899162316 wait complete. 2023-08-31T02:00:53.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:53.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.697+0000 7fb1ee982700 1 -- 172.21.15.84:0/1790609318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80cd380 msgr2=0x7fb1e8159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.697+0000 7fb1ee982700 1 --2- 172.21.15.84:0/1790609318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80cd380 0x7fb1e8159140 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0005fd0 tx=0x7fb1d0009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.697+0000 7fb1ee982700 1 -- 172.21.15.84:0/1790609318 shutdown_connections 2023-08-31T02:00:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.697+0000 7fb1ee982700 1 --2- 172.21.15.84:0/1790609318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80cd380 0x7fb1e8159140 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.697+0000 7fb1ee982700 1 -- 172.21.15.84:0/1790609318 >> 172.21.15.84:0/1790609318 conn(0x7fb1e80ca930 msgr2=0x7fb1e80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.697+0000 7fb1ee982700 1 -- 172.21.15.84:0/1790609318 shutdown_connections 2023-08-31T02:00:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.697+0000 7fb1ee982700 1 -- 172.21.15.84:0/1790609318 wait complete. 2023-08-31T02:00:53.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.698+0000 7fb1ee982700 1 Processor -- start 2023-08-31T02:00:53.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1ee982700 1 -- start start 2023-08-31T02:00:53.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1ee982700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80ca0c0 0x7fb1e8143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1ee982700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1e80cd380 0x7fb1e81e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1ee982700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e815c930 0x7fb1e806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1ee982700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e815aec0 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1ee982700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8153720 con 0x7fb1e815c930 2023-08-31T02:00:53.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1ee982700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8153160 con 0x7fb1e80cd380 2023-08-31T02:00:53.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1e7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80ca0c0 0x7fb1e8143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1e7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80ca0c0 0x7fb1e8143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52846/0 (socket says 172.21.15.84:52846) 2023-08-31T02:00:53.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.699+0000 7fb1e7fff700 1 -- 172.21.15.84:0/2451584663 learned_addr learned my addr 172.21.15.84:0/2451584663 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:53.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e7fff700 1 -- 172.21.15.84:0/2451584663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1e80cd380 msgr2=0x7fb1e81e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e77fe700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1e80cd380 0x7fb1e81e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e7fff700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1e80cd380 0x7fb1e81e3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e7fff700 1 -- 172.21.15.84:0/2451584663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e815c930 msgr2=0x7fb1e806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1ecf1f700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e815c930 0x7fb1e806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e7fff700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e815c930 0x7fb1e806d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e7fff700 1 -- 172.21.15.84:0/2451584663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00095f0 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e7fff700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80ca0c0 0x7fb1e8143f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00098e0 tx=0x7fb1d0004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:53.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e4ff9700 1 -- 172.21.15.84:0/2451584663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d001d070 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e4ff9700 1 -- 172.21.15.84:0/2451584663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb1d0004320 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1e4ff9700 1 -- 172.21.15.84:0/2451584663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0003680 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e8153440 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.700+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e81e3010 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.701+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e804e7c0 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.701+0000 7fb1e4ff9700 1 -- 172.21.15.84:0/2451584663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb1d00037e0 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.702+0000 7fb1e4ff9700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1c806a0e0 0x7fb1c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:53.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.702+0000 7fb1e4ff9700 1 -- 172.21.15.84:0/2451584663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb1d0089e30 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.702+0000 7fb1e77fe700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1c806a0e0 0x7fb1c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:53.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.702+0000 7fb1e77fe700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1c806a0e0 0x7fb1c806c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8144ae0 tx=0x7fb1d8008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:53.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.706+0000 7fb1e4ff9700 1 -- 172.21.15.84:0/2451584663 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb1d0055290 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.895+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1e80cb5c0 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.896+0000 7fb1e4ff9700 1 -- 172.21.15.84:0/2451584663 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb1d0026020 con 0x7fb1e80ca0c0 2023-08-31T02:00:53.889 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:53.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1c806a0e0 msgr2=0x7fb1c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1c806a0e0 0x7fb1c806c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8144ae0 tx=0x7fb1d8008040 comp rx=0 tx=0).stop 2023-08-31T02:00:53.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80ca0c0 msgr2=0x7fb1e8143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:53.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80ca0c0 0x7fb1e8143f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00098e0 tx=0x7fb1d0004b10 comp rx=0 tx=0).stop 2023-08-31T02:00:53.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 shutdown_connections 2023-08-31T02:00:53.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1c806a0e0 0x7fb1c806c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e815c930 0x7fb1e806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1e80ca0c0 0x7fb1e8143f60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 --2- 172.21.15.84:0/2451584663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1e80cd380 0x7fb1e81e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:53.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 >> 172.21.15.84:0/2451584663 conn(0x7fb1e80ca930 msgr2=0x7fb1e80aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:53.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 shutdown_connections 2023-08-31T02:00:53.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:53.898+0000 7fb1ee982700 1 -- 172.21.15.84:0/2451584663 wait complete. 2023-08-31T02:00:53.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:00:54.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.033+0000 7f7390070700 1 -- 172.21.15.84:0/1291584123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 msgr2=0x7f73880b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.033+0000 7f7390070700 1 --2- 172.21.15.84:0/1291584123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 0x7f73880b3630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7388070100 tx=0x7f7384009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:54.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.033+0000 7f7390070700 1 -- 172.21.15.84:0/1291584123 shutdown_connections 2023-08-31T02:00:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.033+0000 7f7390070700 1 --2- 172.21.15.84:0/1291584123 >> v2:172.21.15.170:3300/0 conn(0x7f73880ccae0 0x7f73880ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.033+0000 7f7390070700 1 --2- 172.21.15.84:0/1291584123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 0x7f73880b3630 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.033+0000 7f7390070700 1 -- 172.21.15.84:0/1291584123 >> 172.21.15.84:0/1291584123 conn(0x7f7388070860 msgr2=0x7f7388070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:54.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.033+0000 7f7390070700 1 -- 172.21.15.84:0/1291584123 shutdown_connections 2023-08-31T02:00:54.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.033+0000 7f7390070700 1 -- 172.21.15.84:0/1291584123 wait complete. 2023-08-31T02:00:54.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.034+0000 7f7390070700 1 Processor -- start 2023-08-31T02:00:54.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.034+0000 7f7390070700 1 -- start start 2023-08-31T02:00:54.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f7390070700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73880ccae0 0x7f73881e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f7390070700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7388158080 0x7f7388154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f7390070700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 0x7f73881e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f7390070700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73881e2630 con 0x7f7388158460 2023-08-31T02:00:54.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f7390070700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73881e2910 con 0x7f7388158080 2023-08-31T02:00:54.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f7390070700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73881e2bf0 con 0x7f73880ccae0 2023-08-31T02:00:54.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 0x7f73881e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 0x7f73881e1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52864/0 (socket says 172.21.15.84:52864) 2023-08-31T02:00:54.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 -- 172.21.15.84:0/3389878611 learned_addr learned my addr 172.21.15.84:0/3389878611 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:54.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738d60b700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7388158080 0x7f7388154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738de0c700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73880ccae0 0x7f73881e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 -- 172.21.15.84:0/3389878611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73880ccae0 msgr2=0x7f73881e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73880ccae0 0x7f73881e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 -- 172.21.15.84:0/3389878611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7388158080 msgr2=0x7f7388154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7388158080 0x7f7388154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 -- 172.21.15.84:0/3389878611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73840095f0 con 0x7f7388158460 2023-08-31T02:00:54.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.035+0000 7f738e60d700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 0x7f73881e1c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7380007d70 tx=0x7f738000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:54.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.036+0000 7f737e7fc700 1 -- 172.21.15.84:0/3389878611 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738000ac90 con 0x7f7388158460 2023-08-31T02:00:54.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.036+0000 7f737e7fc700 1 -- 172.21.15.84:0/3389878611 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7380012420 con 0x7f7388158460 2023-08-31T02:00:54.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.036+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73881e2ed0 con 0x7f7388158460 2023-08-31T02:00:54.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.036+0000 7f737e7fc700 1 -- 172.21.15.84:0/3389878611 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380012830 con 0x7f7388158460 2023-08-31T02:00:54.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.036+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73881554e0 con 0x7f7388158460 2023-08-31T02:00:54.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.037+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73881e33f0 con 0x7f7388158460 2023-08-31T02:00:54.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.037+0000 7f737e7fc700 1 -- 172.21.15.84:0/3389878611 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7380004bb0 con 0x7f7388158460 2023-08-31T02:00:54.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.038+0000 7f737e7fc700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f736c06a0e0 0x7f736c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.038+0000 7f737e7fc700 1 -- 172.21.15.84:0/3389878611 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f73800893f0 con 0x7f7388158460 2023-08-31T02:00:54.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.038+0000 7f738de0c700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f736c06a0e0 0x7f736c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.038+0000 7f738de0c700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f736c06a0e0 0x7f736c06c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7378007fd0 tx=0x7f7378009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:54.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.041+0000 7f737e7fc700 1 -- 172.21.15.84:0/3389878611 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f73800548a0 con 0x7f7388158460 2023-08-31T02:00:54.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.250+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73881e33f0 con 0x7f7388158460 2023-08-31T02:00:54.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.250+0000 7f737e7fc700 1 -- 172.21.15.84:0/3389878611 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73881e33f0 con 0x7f7388158460 2023-08-31T02:00:54.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f736c06a0e0 msgr2=0x7f736c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f736c06a0e0 0x7f736c06c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7378007fd0 tx=0x7f7378009040 comp rx=0 tx=0).stop 2023-08-31T02:00:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 msgr2=0x7f73881e1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 0x7f73881e1c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7380007d70 tx=0x7f738000a340 comp rx=0 tx=0).stop 2023-08-31T02:00:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 shutdown_connections 2023-08-31T02:00:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f736c06a0e0 0x7f736c06c5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7388158460 0x7f73881e1c50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73880ccae0 0x7f73881e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 --2- 172.21.15.84:0/3389878611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7388158080 0x7f7388154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 >> 172.21.15.84:0/3389878611 conn(0x7f7388070860 msgr2=0x7f7388157450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 shutdown_connections 2023-08-31T02:00:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.252+0000 7f7390070700 1 -- 172.21.15.84:0/3389878611 wait complete. 2023-08-31T02:00:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:00:54.257 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:00:54.257 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:54.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:54.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 -- 172.21.15.84:0/1802479717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 msgr2=0x7fd8380cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 --2- 172.21.15.84:0/1802479717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 0x7fd8380cc260 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd83806fce0 tx=0x7fd828009c50 comp rx=0 tx=0).stop 2023-08-31T02:00:54.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 -- 172.21.15.84:0/1802479717 shutdown_connections 2023-08-31T02:00:54.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 --2- 172.21.15.84:0/1802479717 >> v2:172.21.15.170:3300/0 conn(0x7fd8380c98f0 0x7fd8380cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 --2- 172.21.15.84:0/1802479717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd838158180 0x7fd8380b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 --2- 172.21.15.84:0/1802479717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 0x7fd8380cc260 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 -- 172.21.15.84:0/1802479717 >> 172.21.15.84:0/1802479717 conn(0x7fd8380ca000 msgr2=0x7fd8380ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:54.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 -- 172.21.15.84:0/1802479717 shutdown_connections 2023-08-31T02:00:54.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.409+0000 7fd83f2df700 1 -- 172.21.15.84:0/1802479717 wait complete. 2023-08-31T02:00:54.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.410+0000 7fd83f2df700 1 Processor -- start 2023-08-31T02:00:54.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.410+0000 7fd83f2df700 1 -- start start 2023-08-31T02:00:54.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83f2df700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8380c98f0 0x7fd838149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83f2df700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd838158180 0x7fd8381e1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83f2df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 0x7fd83815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83f2df700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83814a0b0 con 0x7fd838158560 2023-08-31T02:00:54.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83f2df700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838159f70 con 0x7fd8380c98f0 2023-08-31T02:00:54.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83f2df700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83815aaf0 con 0x7fd838158180 2023-08-31T02:00:54.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 0x7fd83815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 0x7fd83815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52878/0 (socket says 172.21.15.84:52878) 2023-08-31T02:00:54.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 -- 172.21.15.84:0/3298042477 learned_addr learned my addr 172.21.15.84:0/3298042477 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:54.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d07b700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8380c98f0 0x7fd838149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83c87a700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd838158180 0x7fd8381e1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 -- 172.21.15.84:0/3298042477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd838158180 msgr2=0x7fd8381e1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd838158180 0x7fd8381e1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 -- 172.21.15.84:0/3298042477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8380c98f0 msgr2=0x7fd838149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8380c98f0 0x7fd838149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 -- 172.21.15.84:0/3298042477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828009580 con 0x7fd838158560 2023-08-31T02:00:54.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.411+0000 7fd83d87c700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 0x7fd83815af80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd83000add0 tx=0x7fd83000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:54.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.412+0000 7fd82dffb700 1 -- 172.21.15.84:0/3298042477 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000f070 con 0x7fd838158560 2023-08-31T02:00:54.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.412+0000 7fd82dffb700 1 -- 172.21.15.84:0/3298042477 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd83000ae00 con 0x7fd838158560 2023-08-31T02:00:54.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.412+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83815a1c0 con 0x7fd838158560 2023-08-31T02:00:54.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.412+0000 7fd82dffb700 1 -- 172.21.15.84:0/3298042477 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830004e10 con 0x7fd838158560 2023-08-31T02:00:54.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.412+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83815a780 con 0x7fd838158560 2023-08-31T02:00:54.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.413+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83804e7c0 con 0x7fd838158560 2023-08-31T02:00:54.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.413+0000 7fd82dffb700 1 -- 172.21.15.84:0/3298042477 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd83000c830 con 0x7fd838158560 2023-08-31T02:00:54.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.413+0000 7fd82dffb700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.414+0000 7fd82dffb700 1 -- 172.21.15.84:0/3298042477 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fd830088390 con 0x7fd838158560 2023-08-31T02:00:54.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.414+0000 7fd83d07b700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.414+0000 7fd83d07b700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd834005950 tx=0x7fd83400a300 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:54.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.418+0000 7fd82dffb700 1 -- 172.21.15.84:0/3298042477 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd8300537f0 con 0x7fd838158560 2023-08-31T02:00:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.611+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd83815ac30 con 0x7fd838158560 2023-08-31T02:00:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.613+0000 7fd82dffb700 1 -- 172.21.15.84:0/3298042477 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7fd830056e10 con 0x7fd838158560 2023-08-31T02:00:54.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:54.606 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd81c06a0e0 msgr2=0x7fd81c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd834005950 tx=0x7fd83400a300 comp rx=0 tx=0).stop 2023-08-31T02:00:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 msgr2=0x7fd83815af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 0x7fd83815af80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd83000add0 tx=0x7fd83000c330 comp rx=0 tx=0).stop 2023-08-31T02:00:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 shutdown_connections 2023-08-31T02:00:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd81c06a0e0 0x7fd81c06c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd838158560 0x7fd83815af80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8380c98f0 0x7fd838149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 --2- 172.21.15.84:0/3298042477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd838158180 0x7fd8381e1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 >> 172.21.15.84:0/3298042477 conn(0x7fd8380ca000 msgr2=0x7fd838155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 shutdown_connections 2023-08-31T02:00:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.615+0000 7fd83f2df700 1 -- 172.21.15.84:0/3298042477 wait complete. 2023-08-31T02:00:54.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:54.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.754+0000 7efd873e3700 1 -- 172.21.15.84:0/2563220351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 msgr2=0x7efd800b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.754+0000 7efd873e3700 1 --2- 172.21.15.84:0/2563220351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 0x7efd800b17f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efd7c005fd0 tx=0x7efd7c009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.754+0000 7efd873e3700 1 -- 172.21.15.84:0/2563220351 shutdown_connections 2023-08-31T02:00:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.754+0000 7efd873e3700 1 --2- 172.21.15.84:0/2563220351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 0x7efd800b17f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.754+0000 7efd873e3700 1 -- 172.21.15.84:0/2563220351 >> 172.21.15.84:0/2563220351 conn(0x7efd800cd980 msgr2=0x7efd800cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.754+0000 7efd873e3700 1 -- 172.21.15.84:0/2563220351 shutdown_connections 2023-08-31T02:00:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.754+0000 7efd873e3700 1 -- 172.21.15.84:0/2563220351 wait complete. 2023-08-31T02:00:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.755+0000 7efd873e3700 1 Processor -- start 2023-08-31T02:00:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.755+0000 7efd873e3700 1 -- start start 2023-08-31T02:00:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd873e3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd800c9650 0x7efd800a9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd873e3700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd800cba80 0x7efd8014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd873e3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 0x7efd8014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd873e3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8014f1a0 con 0x7efd800cc800 2023-08-31T02:00:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd873e3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd800ac340 con 0x7efd800c9650 2023-08-31T02:00:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd873e3700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800abd80 con 0x7efd800cba80 2023-08-31T02:00:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 0x7efd8014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 0x7efd8014ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52890/0 (socket says 172.21.15.84:52890) 2023-08-31T02:00:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 -- 172.21.15.84:0/1852339112 learned_addr learned my addr 172.21.15.84:0/1852339112 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd8517f700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd800c9650 0x7efd800a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd8497e700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd800cba80 0x7efd8014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 -- 172.21.15.84:0/1852339112 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd800cba80 msgr2=0x7efd8014e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd800cba80 0x7efd8014e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 -- 172.21.15.84:0/1852339112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd800c9650 msgr2=0x7efd800a9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd800c9650 0x7efd800a9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 -- 172.21.15.84:0/1852339112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0095f0 con 0x7efd800cc800 2023-08-31T02:00:54.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd85980700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 0x7efd8014ec60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd7800cb40 tx=0x7efd7800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd75ffb700 1 -- 172.21.15.84:0/1852339112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78003c00 con 0x7efd800cc800 2023-08-31T02:00:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd75ffb700 1 -- 172.21.15.84:0/1852339112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efd78003d60 con 0x7efd800cc800 2023-08-31T02:00:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd75ffb700 1 -- 172.21.15.84:0/1852339112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800abb0 con 0x7efd800cc800 2023-08-31T02:00:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd800ac060 con 0x7efd800cc800 2023-08-31T02:00:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.756+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8006bd30 con 0x7efd800cc800 2023-08-31T02:00:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.757+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8004e7c0 con 0x7efd800cc800 2023-08-31T02:00:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.758+0000 7efd75ffb700 1 -- 172.21.15.84:0/1852339112 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd7800ad10 con 0x7efd800cc800 2023-08-31T02:00:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.758+0000 7efd75ffb700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efd6406a0e0 0x7efd6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.758+0000 7efd75ffb700 1 -- 172.21.15.84:0/1852339112 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7efd780889c0 con 0x7efd800cc800 2023-08-31T02:00:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.758+0000 7efd8517f700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efd6406a0e0 0x7efd6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.758+0000 7efd8517f700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efd6406a0e0 0x7efd6406c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0098e0 tx=0x7efd7c011040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.762+0000 7efd75ffb700 1 -- 172.21.15.84:0/1852339112 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efd78053d90 con 0x7efd800cc800 2023-08-31T02:00:54.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.950+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd800b1f70 con 0x7efd800cc800 2023-08-31T02:00:54.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.950+0000 7efd75ffb700 1 -- 172.21.15.84:0/1852339112 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd780573b0 con 0x7efd800cc800 2023-08-31T02:00:54.943 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efd6406a0e0 msgr2=0x7efd6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efd6406a0e0 0x7efd6406c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0098e0 tx=0x7efd7c011040 comp rx=0 tx=0).stop 2023-08-31T02:00:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 msgr2=0x7efd8014ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 0x7efd8014ec60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd7800cb40 tx=0x7efd7800cf00 comp rx=0 tx=0).stop 2023-08-31T02:00:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 shutdown_connections 2023-08-31T02:00:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efd6406a0e0 0x7efd6406c5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd800cc800 0x7efd8014ec60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd800c9650 0x7efd800a9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 --2- 172.21.15.84:0/1852339112 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd800cba80 0x7efd8014e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 >> 172.21.15.84:0/1852339112 conn(0x7efd800cd980 msgr2=0x7efd80157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 shutdown_connections 2023-08-31T02:00:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:54.952+0000 7efd873e3700 1 -- 172.21.15.84:0/1852339112 wait complete. 2023-08-31T02:00:54.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:55.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 -- 172.21.15.84:0/3995191625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98980cba20 msgr2=0x7f9898069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 --2- 172.21.15.84:0/3995191625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98980cba20 0x7f9898069ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f989808a4e0 tx=0x7f988c009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:55.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 -- 172.21.15.84:0/3995191625 shutdown_connections 2023-08-31T02:00:55.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 --2- 172.21.15.84:0/3995191625 >> v2:172.21.15.170:3300/0 conn(0x7f989806a420 0x7f989815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 --2- 172.21.15.84:0/3995191625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f989815eac0 0x7f98980699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 --2- 172.21.15.84:0/3995191625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98980cba20 0x7f9898069ee0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 -- 172.21.15.84:0/3995191625 >> 172.21.15.84:0/3995191625 conn(0x7f98980d11c0 msgr2=0x7f98980d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:55.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 -- 172.21.15.84:0/3995191625 shutdown_connections 2023-08-31T02:00:55.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.091+0000 7f989d667700 1 -- 172.21.15.84:0/3995191625 wait complete. 2023-08-31T02:00:55.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.092+0000 7f989d667700 1 Processor -- start 2023-08-31T02:00:55.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.092+0000 7f989d667700 1 -- start start 2023-08-31T02:00:55.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f989d667700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f989806a420 0x7f98981546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f989d667700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98980cba20 0x7f9898154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f989d667700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f989815eac0 0x7f98980b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f989d667700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898155ca0 con 0x7f989815eac0 2023-08-31T02:00:55.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f989d667700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980a7b70 con 0x7f989806a420 2023-08-31T02:00:55.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f989d667700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989815b570 con 0x7f98980cba20 2023-08-31T02:00:55.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f989815eac0 0x7f98980b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f989815eac0 0x7f98980b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52904/0 (socket says 172.21.15.84:52904) 2023-08-31T02:00:55.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 -- 172.21.15.84:0/3661338371 learned_addr learned my addr 172.21.15.84:0/3661338371 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:55.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98967fc700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98980cba20 0x7f9898154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f9896ffd700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f989806a420 0x7f98981546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 -- 172.21.15.84:0/3661338371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98980cba20 msgr2=0x7f9898154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98980cba20 0x7f9898154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 -- 172.21.15.84:0/3661338371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f989806a420 msgr2=0x7f98981546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f989806a420 0x7f98981546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 -- 172.21.15.84:0/3661338371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0095f0 con 0x7f989815eac0 2023-08-31T02:00:55.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.093+0000 7f98977fe700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f989815eac0 0x7f98980b0c00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f989000cbe0 tx=0x7f989000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:55.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.094+0000 7f987f7fe700 1 -- 172.21.15.84:0/3661338371 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000aa60 con 0x7f989815eac0 2023-08-31T02:00:55.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.094+0000 7f987f7fe700 1 -- 172.21.15.84:0/3661338371 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f989000acd0 con 0x7f989815eac0 2023-08-31T02:00:55.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.094+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989815b850 con 0x7f989815eac0 2023-08-31T02:00:55.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.094+0000 7f987f7fe700 1 -- 172.21.15.84:0/3661338371 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890012680 con 0x7f989815eac0 2023-08-31T02:00:55.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.094+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989815be10 con 0x7f989815eac0 2023-08-31T02:00:55.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.095+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989804e7c0 con 0x7f989815eac0 2023-08-31T02:00:55.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.095+0000 7f987f7fe700 1 -- 172.21.15.84:0/3661338371 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f989001b400 con 0x7f989815eac0 2023-08-31T02:00:55.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.095+0000 7f987f7fe700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f988406a0e0 0x7f988406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.095+0000 7f9896ffd700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f988406a0e0 0x7f988406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.095+0000 7f987f7fe700 1 -- 172.21.15.84:0/3661338371 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f98900890c0 con 0x7f989815eac0 2023-08-31T02:00:55.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.096+0000 7f9896ffd700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f988406a0e0 0x7f988406c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9888005fd0 tx=0x7f988800b390 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:55.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.100+0000 7f987f7fe700 1 -- 172.21.15.84:0/3661338371 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9890054490 con 0x7f989815eac0 2023-08-31T02:00:55.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.292+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f989815ef80 con 0x7f989815eac0 2023-08-31T02:00:55.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.292+0000 7f987f7fe700 1 -- 172.21.15.84:0/3661338371 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f989001f1b0 con 0x7f989815eac0 2023-08-31T02:00:55.285 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:55.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f988406a0e0 msgr2=0x7f988406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f988406a0e0 0x7f988406c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9888005fd0 tx=0x7f988800b390 comp rx=0 tx=0).stop 2023-08-31T02:00:55.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f989815eac0 msgr2=0x7f98980b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f989815eac0 0x7f98980b0c00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f989000cbe0 tx=0x7f989000cef0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 shutdown_connections 2023-08-31T02:00:55.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f988406a0e0 0x7f988406c5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f989815eac0 0x7f98980b0c00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f989806a420 0x7f98981546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 --2- 172.21.15.84:0/3661338371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98980cba20 0x7f9898154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 >> 172.21.15.84:0/3661338371 conn(0x7f98980d11c0 msgr2=0x7f98980699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:55.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 shutdown_connections 2023-08-31T02:00:55.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.294+0000 7f989d667700 1 -- 172.21.15.84:0/3661338371 wait complete. 2023-08-31T02:00:55.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:55.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.433+0000 7f2a6856c700 1 -- 172.21.15.84:0/8117057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a600ca2d0 msgr2=0x7f2a6006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.433+0000 7f2a6856c700 1 --2- 172.21.15.84:0/8117057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a600ca2d0 0x7f2a6006c720 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0098c0 tx=0x7f2a5c009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.433+0000 7f2a6856c700 1 -- 172.21.15.84:0/8117057 shutdown_connections 2023-08-31T02:00:55.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.433+0000 7f2a6856c700 1 --2- 172.21.15.84:0/8117057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a6015bce0 0x7f2a600cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.433+0000 7f2a6856c700 1 --2- 172.21.15.84:0/8117057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a600ca2d0 0x7f2a6006c720 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.433+0000 7f2a6856c700 1 -- 172.21.15.84:0/8117057 >> 172.21.15.84:0/8117057 conn(0x7f2a600afb00 msgr2=0x7f2a600aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:55.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.433+0000 7f2a6856c700 1 -- 172.21.15.84:0/8117057 shutdown_connections 2023-08-31T02:00:55.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.433+0000 7f2a6856c700 1 -- 172.21.15.84:0/8117057 wait complete. 2023-08-31T02:00:55.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.434+0000 7f2a6856c700 1 Processor -- start 2023-08-31T02:00:55.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.434+0000 7f2a6856c700 1 -- start start 2023-08-31T02:00:55.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a6856c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600ca2d0 0x7f2a6014bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a6856c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a6015b790 0x7f2a600ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a6856c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6015bce0 0x7f2a6014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a6856c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600ad5b0 con 0x7f2a6015b790 2023-08-31T02:00:55.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a6856c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6014f560 con 0x7f2a6015bce0 2023-08-31T02:00:55.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a6856c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c6d10 con 0x7f2a600ca2d0 2023-08-31T02:00:55.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a6015b790 0x7f2a600ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a6015b790 0x7f2a600ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52916/0 (socket says 172.21.15.84:52916) 2023-08-31T02:00:55.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 -- 172.21.15.84:0/3536672060 learned_addr learned my addr 172.21.15.84:0/3536672060 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:55.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a66b09700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6015bce0 0x7f2a6014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a66308700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600ca2d0 0x7f2a6014bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 -- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600ca2d0 msgr2=0x7f2a6014bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600ca2d0 0x7f2a6014bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 -- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6015bce0 msgr2=0x7f2a6014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6015bce0 0x7f2a6014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 -- 172.21.15.84:0/3536672060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009c40 con 0x7f2a6015b790 2023-08-31T02:00:55.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a66b09700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6015bce0 0x7f2a6014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:55.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a65b07700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a6015b790 0x7f2a600ad070 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009230 tx=0x7f2a5c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:55.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a56ffd700 1 -- 172.21.15.84:0/3536672060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c025070 con 0x7f2a6015b790 2023-08-31T02:00:55.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a56ffd700 1 -- 172.21.15.84:0/3536672060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2a5c00fb40 con 0x7f2a6015b790 2023-08-31T02:00:55.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c009520 con 0x7f2a6015b790 2023-08-31T02:00:55.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a56ffd700 1 -- 172.21.15.84:0/3536672060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c01b040 con 0x7f2a6015b790 2023-08-31T02:00:55.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.435+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a600c72d0 con 0x7f2a6015b790 2023-08-31T02:00:55.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.436+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a600c74c0 con 0x7f2a6015b790 2023-08-31T02:00:55.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.437+0000 7f2a56ffd700 1 -- 172.21.15.84:0/3536672060 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a5c004830 con 0x7f2a6015b790 2023-08-31T02:00:55.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.437+0000 7f2a56ffd700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2a4406a0e0 0x7f2a4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.437+0000 7f2a56ffd700 1 -- 172.21.15.84:0/3536672060 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2a5c08a4a0 con 0x7f2a6015b790 2023-08-31T02:00:55.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.437+0000 7f2a66308700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2a4406a0e0 0x7f2a4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.437+0000 7f2a66308700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2a4406a0e0 0x7f2a4406c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001830 tx=0x7f2a50007d50 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:55.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.441+0000 7f2a56ffd700 1 -- 172.21.15.84:0/3536672060 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a5c055880 con 0x7f2a6015b790 2023-08-31T02:00:55.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.634+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a6004e7c0 con 0x7f2a6015b790 2023-08-31T02:00:55.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.635+0000 7f2a56ffd700 1 -- 172.21.15.84:0/3536672060 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a5c058ea0 con 0x7f2a6015b790 2023-08-31T02:00:55.628 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2a4406a0e0 msgr2=0x7f2a4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2a4406a0e0 0x7f2a4406c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001830 tx=0x7f2a50007d50 comp rx=0 tx=0).stop 2023-08-31T02:00:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a6015b790 msgr2=0x7f2a600ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a6015b790 0x7f2a600ad070 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009230 tx=0x7f2a5c00f690 comp rx=0 tx=0).stop 2023-08-31T02:00:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 shutdown_connections 2023-08-31T02:00:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2a4406a0e0 0x7f2a4406c5a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6015bce0 0x7f2a6014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600ca2d0 0x7f2a6014bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 --2- 172.21.15.84:0/3536672060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a6015b790 0x7f2a600ad070 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 >> 172.21.15.84:0/3536672060 conn(0x7f2a600afb00 msgr2=0x7f2a6015a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 shutdown_connections 2023-08-31T02:00:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.637+0000 7f2a6856c700 1 -- 172.21.15.84:0/3536672060 wait complete. 2023-08-31T02:00:55.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:55.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.773+0000 7f0d891cc700 1 -- 172.21.15.84:0/3173250118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d8415d750 msgr2=0x7f0d840ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.773+0000 7f0d891cc700 1 --2- 172.21.15.84:0/3173250118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d8415d750 0x7f0d840ccce0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0d840b5200 tx=0x7f0d74009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:55.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.773+0000 7f0d891cc700 1 -- 172.21.15.84:0/3173250118 shutdown_connections 2023-08-31T02:00:55.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.773+0000 7f0d891cc700 1 --2- 172.21.15.84:0/3173250118 >> v2:172.21.15.170:3300/0 conn(0x7f0d840cd220 0x7f0d840aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.773+0000 7f0d891cc700 1 --2- 172.21.15.84:0/3173250118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d84159320 0x7f0d840b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.774+0000 7f0d891cc700 1 --2- 172.21.15.84:0/3173250118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d8415d750 0x7f0d840ccce0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.774+0000 7f0d891cc700 1 -- 172.21.15.84:0/3173250118 >> 172.21.15.84:0/3173250118 conn(0x7f0d840b0c40 msgr2=0x7f0d840b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.774+0000 7f0d891cc700 1 -- 172.21.15.84:0/3173250118 shutdown_connections 2023-08-31T02:00:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.774+0000 7f0d891cc700 1 -- 172.21.15.84:0/3173250118 wait complete. 2023-08-31T02:00:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.775+0000 7f0d891cc700 1 Processor -- start 2023-08-31T02:00:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.775+0000 7f0d891cc700 1 -- start start 2023-08-31T02:00:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d891cc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d840cd220 0x7f0d840c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d891cc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d84159320 0x7f0d84153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d891cc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d8415d750 0x7f0d840c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d891cc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840c3e30 con 0x7f0d840cd220 2023-08-31T02:00:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d891cc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840c31b0 con 0x7f0d84159320 2023-08-31T02:00:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d891cc700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840c3490 con 0x7f0d8415d750 2023-08-31T02:00:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d82d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d840cd220 0x7f0d840c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d82d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d840cd220 0x7f0d840c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52930/0 (socket says 172.21.15.84:52930) 2023-08-31T02:00:55.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.776+0000 7f0d82d9d700 1 -- 172.21.15.84:0/2018884300 learned_addr learned my addr 172.21.15.84:0/2018884300 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:55.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d8259c700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d84159320 0x7f0d84153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d8359e700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d8415d750 0x7f0d840c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d82d9d700 1 -- 172.21.15.84:0/2018884300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d8415d750 msgr2=0x7f0d840c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d82d9d700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d8415d750 0x7f0d840c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d82d9d700 1 -- 172.21.15.84:0/2018884300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d84159320 msgr2=0x7f0d84153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d82d9d700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d84159320 0x7f0d84153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d82d9d700 1 -- 172.21.15.84:0/2018884300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740095f0 con 0x7f0d840cd220 2023-08-31T02:00:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d82d9d700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d840cd220 0x7f0d840c4250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800d950 tx=0x7f0d7800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d6b7fe700 1 -- 172.21.15.84:0/2018884300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78009b40 con 0x7f0d840cd220 2023-08-31T02:00:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d6b7fe700 1 -- 172.21.15.84:0/2018884300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0d78009d90 con 0x7f0d840cd220 2023-08-31T02:00:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d840c3770 con 0x7f0d840cd220 2023-08-31T02:00:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d6b7fe700 1 -- 172.21.15.84:0/2018884300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780106c0 con 0x7f0d840cd220 2023-08-31T02:00:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.777+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84154a00 con 0x7f0d840cd220 2023-08-31T02:00:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.778+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8404e7c0 con 0x7f0d840cd220 2023-08-31T02:00:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.778+0000 7f0d6b7fe700 1 -- 172.21.15.84:0/2018884300 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0d78010820 con 0x7f0d840cd220 2023-08-31T02:00:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.779+0000 7f0d6b7fe700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d7006a0e0 0x7f0d7006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.779+0000 7f0d8259c700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d7006a0e0 0x7f0d7006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:55.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.779+0000 7f0d6b7fe700 1 -- 172.21.15.84:0/2018884300 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f0d78088fb0 con 0x7f0d840cd220 2023-08-31T02:00:55.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.779+0000 7f0d8259c700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d7006a0e0 0x7f0d7006c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0d740098e0 tx=0x7f0d74011040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:55.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.783+0000 7f0d6b7fe700 1 -- 172.21.15.84:0/2018884300 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0d780542e0 con 0x7f0d840cd220 2023-08-31T02:00:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.970+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0d84154d90 con 0x7f0d840cd220 2023-08-31T02:00:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.971+0000 7f0d6b7fe700 1 -- 172.21.15.84:0/2018884300 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0d780200a0 con 0x7f0d840cd220 2023-08-31T02:00:55.964 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:55.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d7006a0e0 msgr2=0x7f0d7006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d7006a0e0 0x7f0d7006c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0d740098e0 tx=0x7f0d74011040 comp rx=0 tx=0).stop 2023-08-31T02:00:55.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d840cd220 msgr2=0x7f0d840c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:55.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d840cd220 0x7f0d840c4250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800d950 tx=0x7f0d7800dd10 comp rx=0 tx=0).stop 2023-08-31T02:00:55.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 shutdown_connections 2023-08-31T02:00:55.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0d7006a0e0 0x7f0d7006c5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d8415d750 0x7f0d840c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d840cd220 0x7f0d840c4250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 --2- 172.21.15.84:0/2018884300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d84159320 0x7f0d84153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 >> 172.21.15.84:0/2018884300 conn(0x7f0d840b0c40 msgr2=0x7f0d8406eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 shutdown_connections 2023-08-31T02:00:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:55.973+0000 7f0d891cc700 1 -- 172.21.15.84:0/2018884300 wait complete. 2023-08-31T02:00:55.978 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:00:56.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.108+0000 7f89c37ac700 1 -- 172.21.15.84:0/3497603906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc0c99b0 msgr2=0x7f89bc0708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.108+0000 7f89c37ac700 1 --2- 172.21.15.84:0/3497603906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc0c99b0 0x7f89bc0708a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f89ac005fd0 tx=0x7f89ac009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:56.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.108+0000 7f89c37ac700 1 -- 172.21.15.84:0/3497603906 shutdown_connections 2023-08-31T02:00:56.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.108+0000 7f89c37ac700 1 --2- 172.21.15.84:0/3497603906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89bc158120 0x7f89bc0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.108+0000 7f89c37ac700 1 --2- 172.21.15.84:0/3497603906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc0c99b0 0x7f89bc0708a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.108+0000 7f89c37ac700 1 -- 172.21.15.84:0/3497603906 >> 172.21.15.84:0/3497603906 conn(0x7f89bc0cdeb0 msgr2=0x7f89bc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:56.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.109+0000 7f89c37ac700 1 -- 172.21.15.84:0/3497603906 shutdown_connections 2023-08-31T02:00:56.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.109+0000 7f89c37ac700 1 -- 172.21.15.84:0/3497603906 wait complete. 2023-08-31T02:00:56.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.110+0000 7f89c37ac700 1 Processor -- start 2023-08-31T02:00:56.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.110+0000 7f89c37ac700 1 -- start start 2023-08-31T02:00:56.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c37ac700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89bc0b0d00 0x7f89bc1ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c37ac700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89bc0c99b0 0x7f89bc0c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c37ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc158120 0x7f89bc1e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c37ac700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc156b90 con 0x7f89bc158120 2023-08-31T02:00:56.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c37ac700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc0c7e30 con 0x7f89bc0c99b0 2023-08-31T02:00:56.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c37ac700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc0c7870 con 0x7f89bc0b0d00 2023-08-31T02:00:56.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1d49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc158120 0x7f89bc1e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1d49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc158120 0x7f89bc1e3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52946/0 (socket says 172.21.15.84:52946) 2023-08-31T02:00:56.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1d49700 1 -- 172.21.15.84:0/79286700 learned_addr learned my addr 172.21.15.84:0/79286700 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:56.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1548700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89bc0b0d00 0x7f89bc1ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c0d47700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89bc0c99b0 0x7f89bc0c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1d49700 1 -- 172.21.15.84:0/79286700 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89bc0b0d00 msgr2=0x7f89bc1ee7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1d49700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89bc0b0d00 0x7f89bc1ee7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1d49700 1 -- 172.21.15.84:0/79286700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89bc0c99b0 msgr2=0x7f89bc0c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1d49700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89bc0c99b0 0x7f89bc0c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.111+0000 7f89c1d49700 1 -- 172.21.15.84:0/79286700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0095f0 con 0x7f89bc158120 2023-08-31T02:00:56.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.112+0000 7f89c1d49700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc158120 0x7f89bc1e3310 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f89b400cba0 tx=0x7f89b400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:56.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.112+0000 7f89b1ffb700 1 -- 172.21.15.84:0/79286700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400aaa0 con 0x7f89bc158120 2023-08-31T02:00:56.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.112+0000 7f89b1ffb700 1 -- 172.21.15.84:0/79286700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f89b400acf0 con 0x7f89bc158120 2023-08-31T02:00:56.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.112+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc0c7b50 con 0x7f89bc158120 2023-08-31T02:00:56.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.112+0000 7f89b1ffb700 1 -- 172.21.15.84:0/79286700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400aea0 con 0x7f89bc158120 2023-08-31T02:00:56.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.112+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc158b40 con 0x7f89bc158120 2023-08-31T02:00:56.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.113+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89bc158d30 con 0x7f89bc158120 2023-08-31T02:00:56.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.113+0000 7f89b1ffb700 1 -- 172.21.15.84:0/79286700 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89b401b400 con 0x7f89bc158120 2023-08-31T02:00:56.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.114+0000 7f89b1ffb700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f89a006a0e0 0x7f89a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.114+0000 7f89b1ffb700 1 -- 172.21.15.84:0/79286700 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f89b4089040 con 0x7f89bc158120 2023-08-31T02:00:56.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.114+0000 7f89c1548700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f89a006a0e0 0x7f89a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.114+0000 7f89c1548700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f89a006a0e0 0x7f89a006c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f89b800abc0 tx=0x7f89b800a2d0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:56.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.118+0000 7f89b1ffb700 1 -- 172.21.15.84:0/79286700 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f89b40544a0 con 0x7f89bc158120 2023-08-31T02:00:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.323+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f89bc04e7c0 con 0x7f89bc158120 2023-08-31T02:00:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.323+0000 7f89b1ffb700 1 -- 172.21.15.84:0/79286700 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f89b4016080 con 0x7f89bc158120 2023-08-31T02:00:56.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.325+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f89a006a0e0 msgr2=0x7f89a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.325+0000 7f89c37ac700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f89a006a0e0 0x7f89a006c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f89b800abc0 tx=0x7f89b800a2d0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.325+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc158120 msgr2=0x7f89bc1e3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.325+0000 7f89c37ac700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc158120 0x7f89bc1e3310 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f89b400cba0 tx=0x7f89b400ceb0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.326+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 shutdown_connections 2023-08-31T02:00:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.326+0000 7f89c37ac700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f89a006a0e0 0x7f89a006c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.326+0000 7f89c37ac700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89bc158120 0x7f89bc1e3310 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.326+0000 7f89c37ac700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89bc0b0d00 0x7f89bc1ee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.326+0000 7f89c37ac700 1 --2- 172.21.15.84:0/79286700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89bc0c99b0 0x7f89bc0c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.326+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 >> 172.21.15.84:0/79286700 conn(0x7f89bc0cdeb0 msgr2=0x7f89bc0aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:56.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.326+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 shutdown_connections 2023-08-31T02:00:56.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.326+0000 7f89c37ac700 1 -- 172.21.15.84:0/79286700 wait complete. 2023-08-31T02:00:56.321 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:00:56.330 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2023-08-31T02:00:56.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:56.331 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-08-31T02:00:56.377 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:00:56.378 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:00:56.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:00:56.378 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-31T02:00:56.405 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:00:56.405 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:56.425 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:00:56.425 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:56.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:56.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.650+0000 7f76cbdc7700 1 -- 172.21.15.84:0/1023677015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c415b670 msgr2=0x7f76c40b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.650+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/1023677015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c415b670 0x7f76c40b2ce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f76b40098c0 tx=0x7f76b4009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.650+0000 7f76cbdc7700 1 -- 172.21.15.84:0/1023677015 shutdown_connections 2023-08-31T02:00:56.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.650+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/1023677015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76c415fa70 0x7f76c40b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.650+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/1023677015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c415b670 0x7f76c40b2ce0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.650+0000 7f76cbdc7700 1 -- 172.21.15.84:0/1023677015 >> 172.21.15.84:0/1023677015 conn(0x7f76c40cdce0 msgr2=0x7f76c40ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:56.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.650+0000 7f76cbdc7700 1 -- 172.21.15.84:0/1023677015 shutdown_connections 2023-08-31T02:00:56.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.650+0000 7f76cbdc7700 1 -- 172.21.15.84:0/1023677015 wait complete. 2023-08-31T02:00:56.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.651+0000 7f76cbdc7700 1 Processor -- start 2023-08-31T02:00:56.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76cbdc7700 1 -- start start 2023-08-31T02:00:56.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76cbdc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40cc9a0 0x7f76c40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76cbdc7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c415b670 0x7f76c4153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76cbdc7700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76c415fa70 0x7f76c40c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76cbdc7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40c7e10 con 0x7f76c40cc9a0 2023-08-31T02:00:56.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76cbdc7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4153ed0 con 0x7f76c415b670 2023-08-31T02:00:56.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76cbdc7700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41552e0 con 0x7f76c415fa70 2023-08-31T02:00:56.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76c9b63700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40cc9a0 0x7f76c40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76c9b63700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40cc9a0 0x7f76c40b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52956/0 (socket says 172.21.15.84:52956) 2023-08-31T02:00:56.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.652+0000 7f76c9b63700 1 -- 172.21.15.84:0/497173007 learned_addr learned my addr 172.21.15.84:0/497173007 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:56.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76c9b63700 1 -- 172.21.15.84:0/497173007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76c415fa70 msgr2=0x7f76c40c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76c9b63700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76c415fa70 0x7f76c40c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76c9b63700 1 -- 172.21.15.84:0/497173007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c415b670 msgr2=0x7f76c4153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76c9b63700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c415b670 0x7f76c4153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76c9b63700 1 -- 172.21.15.84:0/497173007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009520 con 0x7f76c40cc9a0 2023-08-31T02:00:56.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76c9b63700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40cc9a0 0x7f76c40b31c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f76b4000c00 tx=0x7f76b4017840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:56.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76ba7fc700 1 -- 172.21.15.84:0/497173007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b401b040 con 0x7f76c40cc9a0 2023-08-31T02:00:56.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76ba7fc700 1 -- 172.21.15.84:0/497173007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f76b400f460 con 0x7f76c40cc9a0 2023-08-31T02:00:56.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76ba7fc700 1 -- 172.21.15.84:0/497173007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400f870 con 0x7f76c40cc9a0 2023-08-31T02:00:56.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c41555c0 con 0x7f76c40cc9a0 2023-08-31T02:00:56.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.653+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c4155b80 con 0x7f76c40cc9a0 2023-08-31T02:00:56.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.654+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c404e7c0 con 0x7f76c40cc9a0 2023-08-31T02:00:56.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.654+0000 7f76ba7fc700 1 -- 172.21.15.84:0/497173007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f76b400f9d0 con 0x7f76c40cc9a0 2023-08-31T02:00:56.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.655+0000 7f76ba7fc700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f76a806a0e0 0x7f76a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.655+0000 7f76ba7fc700 1 -- 172.21.15.84:0/497173007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f76b408ad40 con 0x7f76c40cc9a0 2023-08-31T02:00:56.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.655+0000 7f76c9362700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f76a806a0e0 0x7f76a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.655+0000 7f76c9362700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f76a806a0e0 0x7f76a806c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f76c0007fd0 tx=0x7f76c00079a0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:56.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.659+0000 7f76ba7fc700 1 -- 172.21.15.84:0/497173007 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f76b40561a0 con 0x7f76c40cc9a0 2023-08-31T02:00:56.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.849+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76c40cf1e0 con 0x7f76c40cc9a0 2023-08-31T02:00:56.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.851+0000 7f76ba7fc700 1 -- 172.21.15.84:0/497173007 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f76b40597c0 con 0x7f76c40cc9a0 2023-08-31T02:00:56.844 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:56.844 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:56.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f76a806a0e0 msgr2=0x7f76a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f76a806a0e0 0x7f76a806c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f76c0007fd0 tx=0x7f76c00079a0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40cc9a0 msgr2=0x7f76c40b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40cc9a0 0x7f76c40b31c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f76b4000c00 tx=0x7f76b4017840 comp rx=0 tx=0).stop 2023-08-31T02:00:56.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 shutdown_connections 2023-08-31T02:00:56.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f76a806a0e0 0x7f76a806c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76c415fa70 0x7f76c40c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40cc9a0 0x7f76c40b31c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 --2- 172.21.15.84:0/497173007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c415b670 0x7f76c4153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 >> 172.21.15.84:0/497173007 conn(0x7f76c40cdce0 msgr2=0x7f76c40d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:56.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 shutdown_connections 2023-08-31T02:00:56.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.853+0000 7f76cbdc7700 1 -- 172.21.15.84:0/497173007 wait complete. 2023-08-31T02:00:56.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:56.859 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:56.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.991+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1201921934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec15b790 msgr2=0x7f8fec06c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.991+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1201921934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec15b790 0x7f8fec06c720 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0702a0 tx=0x7f8fe0009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:56.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.991+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1201921934 shutdown_connections 2023-08-31T02:00:56.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.991+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1201921934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec15b790 0x7f8fec06c720 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.991+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1201921934 >> v2:172.21.15.170:3300/0 conn(0x7f8fec0ca2d0 0x7f8fec0cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.991+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1201921934 >> 172.21.15.84:0/1201921934 conn(0x7f8fec0afb00 msgr2=0x7f8fec0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:56.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.991+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1201921934 shutdown_connections 2023-08-31T02:00:56.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.991+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1201921934 wait complete. 2023-08-31T02:00:56.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.992+0000 7f8ff2d04700 1 Processor -- start 2023-08-31T02:00:56.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.992+0000 7f8ff2d04700 1 -- start start 2023-08-31T02:00:56.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff2d04700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec0ca2d0 0x7f8fec14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff2d04700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fec15b790 0x7f8fec0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff2d04700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fec15bce0 0x7f8fec158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff2d04700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec158950 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff2d04700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec14e7b0 con 0x7f8fec15b790 2023-08-31T02:00:56.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff2d04700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec157a30 con 0x7f8fec15bce0 2023-08-31T02:00:56.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec0ca2d0 0x7f8fec14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec0ca2d0 0x7f8fec14e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52970/0 (socket says 172.21.15.84:52970) 2023-08-31T02:00:56.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 -- 172.21.15.84:0/1940316470 learned_addr learned my addr 172.21.15.84:0/1940316470 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:56.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff12a1700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fec15bce0 0x7f8fec158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8febfff700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fec15b790 0x7f8fec0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 -- 172.21.15.84:0/1940316470 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fec15bce0 msgr2=0x7f8fec158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fec15bce0 0x7f8fec158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 -- 172.21.15.84:0/1940316470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fec15b790 msgr2=0x7f8fec0c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:56.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fec15b790 0x7f8fec0c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:56.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 -- 172.21.15.84:0/1940316470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00095f0 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.993+0000 7f8ff0aa0700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec0ca2d0 0x7f8fec14e270 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009fd0 tx=0x7f8fe0005140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:56.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.994+0000 7f8fe97fa700 1 -- 172.21.15.84:0/1940316470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe001f070 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.994+0000 7f8fe97fa700 1 -- 172.21.15.84:0/1940316470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8fe0004320 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.994+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec06df30 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.994+0000 7f8fe97fa700 1 -- 172.21.15.84:0/1940316470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000b760 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.994+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec157fb0 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.995+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec158bc0 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.995+0000 7f8fe97fa700 1 -- 172.21.15.84:0/1940316470 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8fe000b8c0 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.995+0000 7f8fe97fa700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.995+0000 7f8fe97fa700 1 -- 172.21.15.84:0/1940316470 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8fe008c010 con 0x7f8fec0ca2d0 2023-08-31T02:00:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.996+0000 7f8febfff700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:56.996+0000 7f8febfff700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8fec154280 tx=0x7f8fd8008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.000+0000 7f8fe97fa700 1 -- 172.21.15.84:0/1940316470 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8fe0057470 con 0x7f8fec0ca2d0 2023-08-31T02:00:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.186+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fec04e7c0 con 0x7f8fec0ca2d0 2023-08-31T02:00:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.186+0000 7f8fe97fa700 1 -- 172.21.15.84:0/1940316470 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fe005aa90 con 0x7f8fec0ca2d0 2023-08-31T02:00:57.179 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:57.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.188+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8fd006a0e0 msgr2=0x7f8fd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.188+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8fec154280 tx=0x7f8fd8008040 comp rx=0 tx=0).stop 2023-08-31T02:00:57.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.188+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec0ca2d0 msgr2=0x7f8fec14e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.188+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec0ca2d0 0x7f8fec14e270 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009fd0 tx=0x7f8fe0005140 comp rx=0 tx=0).stop 2023-08-31T02:00:57.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.189+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 shutdown_connections 2023-08-31T02:00:57.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.189+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.189+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fec15bce0 0x7f8fec158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.189+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fec0ca2d0 0x7f8fec14e270 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.189+0000 7f8ff2d04700 1 --2- 172.21.15.84:0/1940316470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fec15b790 0x7f8fec0c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.189+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 >> 172.21.15.84:0/1940316470 conn(0x7f8fec0afb00 msgr2=0x7f8fec15a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:57.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.189+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 shutdown_connections 2023-08-31T02:00:57.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.189+0000 7f8ff2d04700 1 -- 172.21.15.84:0/1940316470 wait complete. 2023-08-31T02:00:57.193 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.326+0000 7f13ae88f700 1 -- 172.21.15.84:0/4231801278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 msgr2=0x7f13a81585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.326+0000 7f13ae88f700 1 --2- 172.21.15.84:0/4231801278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 0x7f13a81585b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009fd0 tx=0x7f13a000b380 comp rx=0 tx=0).stop 2023-08-31T02:00:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.326+0000 7f13ae88f700 1 -- 172.21.15.84:0/4231801278 shutdown_connections 2023-08-31T02:00:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.326+0000 7f13ae88f700 1 --2- 172.21.15.84:0/4231801278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 0x7f13a81585b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.326+0000 7f13ae88f700 1 --2- 172.21.15.84:0/4231801278 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13a80cc800 0x7f13a80b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.326+0000 7f13ae88f700 1 -- 172.21.15.84:0/4231801278 >> 172.21.15.84:0/4231801278 conn(0x7f13a80cd980 msgr2=0x7f13a80cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:57.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.326+0000 7f13ae88f700 1 -- 172.21.15.84:0/4231801278 shutdown_connections 2023-08-31T02:00:57.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.326+0000 7f13ae88f700 1 -- 172.21.15.84:0/4231801278 wait complete. 2023-08-31T02:00:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.327+0000 7f13ae88f700 1 Processor -- start 2023-08-31T02:00:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13ae88f700 1 -- start start 2023-08-31T02:00:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13ae88f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13a80c9650 0x7f13a814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13ae88f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 0x7f13a81e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13ae88f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a80cc800 0x7f13a80ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13ae88f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a814e0f0 con 0x7f13a80cba80 2023-08-31T02:00:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13ae88f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81e32d0 con 0x7f13a80cc800 2023-08-31T02:00:57.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13ae88f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81e35b0 con 0x7f13a80c9650 2023-08-31T02:00:57.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 0x7f13a81e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:57.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 0x7f13a81e4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52986/0 (socket says 172.21.15.84:52986) 2023-08-31T02:00:57.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13a77fe700 1 -- 172.21.15.84:0/1922447177 learned_addr learned my addr 172.21.15.84:0/1922447177 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:57.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.328+0000 7f13a7fff700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13a80c9650 0x7f13a814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13ace2c700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a80cc800 0x7f13a80ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a77fe700 1 -- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13a80c9650 msgr2=0x7f13a814dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a77fe700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13a80c9650 0x7f13a814dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a77fe700 1 -- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a80cc800 msgr2=0x7f13a80ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a77fe700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a80cc800 0x7f13a80ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a77fe700 1 -- 172.21.15.84:0/1922447177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a0009d00 con 0x7f13a80cba80 2023-08-31T02:00:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a7fff700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13a80c9650 0x7f13a814dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:57.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13ace2c700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a80cc800 0x7f13a80ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:57.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a77fe700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 0x7f13a81e4370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f139800c4d0 tx=0x7f139800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:57.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a4ff9700 1 -- 172.21.15.84:0/1922447177 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398011790 con 0x7f13a80cba80 2023-08-31T02:00:57.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a4ff9700 1 -- 172.21.15.84:0/1922447177 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f13980119e0 con 0x7f13a80cba80 2023-08-31T02:00:57.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a81e3890 con 0x7f13a80cba80 2023-08-31T02:00:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13a4ff9700 1 -- 172.21.15.84:0/1922447177 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398011df0 con 0x7f13a80cba80 2023-08-31T02:00:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.329+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a81e3e50 con 0x7f13a80cba80 2023-08-31T02:00:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.330+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a804e7c0 con 0x7f13a80cba80 2023-08-31T02:00:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.330+0000 7f13a4ff9700 1 -- 172.21.15.84:0/1922447177 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f139801c460 con 0x7f13a80cba80 2023-08-31T02:00:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.331+0000 7f13a4ff9700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f139406a0e0 0x7f139406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:57.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.331+0000 7f13a4ff9700 1 -- 172.21.15.84:0/1922447177 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1398088890 con 0x7f13a80cba80 2023-08-31T02:00:57.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.331+0000 7f13a7fff700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f139406a0e0 0x7f139406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:57.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.331+0000 7f13a7fff700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f139406a0e0 0x7f139406c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13a80c6170 tx=0x7f139c005f30 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:57.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.335+0000 7f13a4ff9700 1 -- 172.21.15.84:0/1922447177 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1398053cf0 con 0x7f13a80cba80 2023-08-31T02:00:57.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.524+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13a80b1f20 con 0x7f13a80cba80 2023-08-31T02:00:57.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.524+0000 7f13a4ff9700 1 -- 172.21.15.84:0/1922447177 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1398057310 con 0x7f13a80cba80 2023-08-31T02:00:57.517 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:57.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f139406a0e0 msgr2=0x7f139406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f139406a0e0 0x7f139406c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13a80c6170 tx=0x7f139c005f30 comp rx=0 tx=0).stop 2023-08-31T02:00:57.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 msgr2=0x7f13a81e4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 0x7f13a81e4370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f139800c4d0 tx=0x7f139800c890 comp rx=0 tx=0).stop 2023-08-31T02:00:57.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 shutdown_connections 2023-08-31T02:00:57.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f139406a0e0 0x7f139406c5a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a80cc800 0x7f13a80ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13a80c9650 0x7f13a814dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 --2- 172.21.15.84:0/1922447177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a80cba80 0x7f13a81e4370 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 >> 172.21.15.84:0/1922447177 conn(0x7f13a80cd980 msgr2=0x7f13a8158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:57.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 shutdown_connections 2023-08-31T02:00:57.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.526+0000 7f13ae88f700 1 -- 172.21.15.84:0/1922447177 wait complete. 2023-08-31T02:00:57.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:57.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.663+0000 7f84cf59e700 1 -- 172.21.15.84:0/3096628431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0159620 msgr2=0x7f84d0070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.663+0000 7f84cf59e700 1 --2- 172.21.15.84:0/3096628431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0159620 0x7f84d0070620 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f84c00098c0 tx=0x7f84c0009bd0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.664+0000 7f84cf59e700 1 -- 172.21.15.84:0/3096628431 shutdown_connections 2023-08-31T02:00:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.664+0000 7f84cf59e700 1 --2- 172.21.15.84:0/3096628431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d0070b60 0x7f84d00b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.664+0000 7f84cf59e700 1 --2- 172.21.15.84:0/3096628431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0159620 0x7f84d0070620 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.664+0000 7f84cf59e700 1 -- 172.21.15.84:0/3096628431 >> 172.21.15.84:0/3096628431 conn(0x7f84d00ca8f0 msgr2=0x7f84d00cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.664+0000 7f84cf59e700 1 -- 172.21.15.84:0/3096628431 shutdown_connections 2023-08-31T02:00:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.664+0000 7f84cf59e700 1 -- 172.21.15.84:0/3096628431 wait complete. 2023-08-31T02:00:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.665+0000 7f84cf59e700 1 Processor -- start 2023-08-31T02:00:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.665+0000 7f84cf59e700 1 -- start start 2023-08-31T02:00:57.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cf59e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d0070b60 0x7f84d0158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:57.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cf59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0155aa0 0x7f84d0153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:57.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cf59e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d0159620 0x7f84d0154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:57.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cf59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01547a0 con 0x7f84d0155aa0 2023-08-31T02:00:57.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cf59e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d00c5920 con 0x7f84d0070b60 2023-08-31T02:00:57.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cf59e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d00c5c00 con 0x7f84d0159620 2023-08-31T02:00:57.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0155aa0 0x7f84d0153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:57.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0155aa0 0x7f84d0153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52998/0 (socket says 172.21.15.84:52998) 2023-08-31T02:00:57.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 -- 172.21.15.84:0/2174105312 learned_addr learned my addr 172.21.15.84:0/2174105312 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:57.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84ced9d700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d0159620 0x7f84d0154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:57.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84ce59c700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d0070b60 0x7f84d0158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:57.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 -- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d0159620 msgr2=0x7f84d0154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d0159620 0x7f84d0154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 -- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d0070b60 msgr2=0x7f84d0158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d0070b60 0x7f84d0158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 -- 172.21.15.84:0/2174105312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c0009520 con 0x7f84d0155aa0 2023-08-31T02:00:57.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84ced9d700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d0159620 0x7f84d0154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:57.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84ce59c700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d0070b60 0x7f84d0158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:00:57.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cdd9b700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0155aa0 0x7f84d0153d20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f84c0000c00 tx=0x7f84c000f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:57.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84beffd700 1 -- 172.21.15.84:0/2174105312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0025070 con 0x7f84d0155aa0 2023-08-31T02:00:57.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84beffd700 1 -- 172.21.15.84:0/2174105312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f84c000fc70 con 0x7f84d0155aa0 2023-08-31T02:00:57.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d015c2e0 con 0x7f84d0155aa0 2023-08-31T02:00:57.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84beffd700 1 -- 172.21.15.84:0/2174105312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c001b040 con 0x7f84d0155aa0 2023-08-31T02:00:57.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.666+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d00c61c0 con 0x7f84d0155aa0 2023-08-31T02:00:57.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.667+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d0067120 con 0x7f84d0155aa0 2023-08-31T02:00:57.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.668+0000 7f84beffd700 1 -- 172.21.15.84:0/2174105312 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f84c0004a90 con 0x7f84d0155aa0 2023-08-31T02:00:57.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.669+0000 7f84beffd700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f84b006a110 0x7f84b006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:57.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.669+0000 7f84beffd700 1 -- 172.21.15.84:0/2174105312 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f84c008af70 con 0x7f84d0155aa0 2023-08-31T02:00:57.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.669+0000 7f84ce59c700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f84b006a110 0x7f84b006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:57.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.669+0000 7f84ce59c700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f84b006a110 0x7f84b006c5d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84c40017b0 tx=0x7f84c4009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:57.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.673+0000 7f84beffd700 1 -- 172.21.15.84:0/2174105312 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f84c00564b0 con 0x7f84d0155aa0 2023-08-31T02:00:57.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.862+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84d00cdc20 con 0x7f84d0155aa0 2023-08-31T02:00:57.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.862+0000 7f84beffd700 1 -- 172.21.15.84:0/2174105312 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84c0059ad0 con 0x7f84d0155aa0 2023-08-31T02:00:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f84b006a110 msgr2=0x7f84b006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f84b006a110 0x7f84b006c5d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84c40017b0 tx=0x7f84c4009040 comp rx=0 tx=0).stop 2023-08-31T02:00:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0155aa0 msgr2=0x7f84d0153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0155aa0 0x7f84d0153d20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f84c0000c00 tx=0x7f84c000f7c0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 shutdown_connections 2023-08-31T02:00:57.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f84b006a110 0x7f84b006c5d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d0159620 0x7f84d0154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d0070b60 0x7f84d0158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 --2- 172.21.15.84:0/2174105312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d0155aa0 0x7f84d0153d20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 >> 172.21.15.84:0/2174105312 conn(0x7f84d00ca8f0 msgr2=0x7f84d00cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:57.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 shutdown_connections 2023-08-31T02:00:57.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:57.864+0000 7f84cf59e700 1 -- 172.21.15.84:0/2174105312 wait complete. 2023-08-31T02:00:57.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:00:57.972 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:00:57.975 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:00:57.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.002+0000 7f6a25b02700 1 -- 172.21.15.84:0/770579204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a20159320 msgr2=0x7f6a200b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:57.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.002+0000 7f6a25b02700 1 --2- 172.21.15.84:0/770579204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a20159320 0x7f6a200b0020 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6a200b1c90 tx=0x7f6a10009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:57.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.002+0000 7f6a25b02700 1 -- 172.21.15.84:0/770579204 shutdown_connections 2023-08-31T02:00:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.002+0000 7f6a25b02700 1 --2- 172.21.15.84:0/770579204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a20159320 0x7f6a200b0020 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.002+0000 7f6a25b02700 1 --2- 172.21.15.84:0/770579204 >> v2:172.21.15.170:3300/0 conn(0x7f6a2015d750 0x7f6a200ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.002+0000 7f6a25b02700 1 -- 172.21.15.84:0/770579204 >> 172.21.15.84:0/770579204 conn(0x7f6a200b0c40 msgr2=0x7f6a200b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.002+0000 7f6a25b02700 1 -- 172.21.15.84:0/770579204 shutdown_connections 2023-08-31T02:00:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.002+0000 7f6a25b02700 1 -- 172.21.15.84:0/770579204 wait complete. 2023-08-31T02:00:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.003+0000 7f6a25b02700 1 Processor -- start 2023-08-31T02:00:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.003+0000 7f6a25b02700 1 -- start start 2023-08-31T02:00:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a25b02700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a200cd220 0x7f6a201585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a25b02700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a20159320 0x7f6a200c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a25b02700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a2015d750 0x7f6a200c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a25b02700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2006cd20 con 0x7f6a200cd220 2023-08-31T02:00:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a25b02700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2006c0a0 con 0x7f6a20159320 2023-08-31T02:00:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a25b02700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2006c380 con 0x7f6a2015d750 2023-08-31T02:00:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a1f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a200cd220 0x7f6a201585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a1f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a200cd220 0x7f6a201585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53010/0 (socket says 172.21.15.84:53010) 2023-08-31T02:00:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.004+0000 7f6a1f7fe700 1 -- 172.21.15.84:0/438090097 learned_addr learned my addr 172.21.15.84:0/438090097 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1ffff700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a2015d750 0x7f6a200c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1effd700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a20159320 0x7f6a200c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1f7fe700 1 -- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a2015d750 msgr2=0x7f6a200c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1f7fe700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a2015d750 0x7f6a200c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1f7fe700 1 -- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a20159320 msgr2=0x7f6a200c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1f7fe700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a20159320 0x7f6a200c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1f7fe700 1 -- 172.21.15.84:0/438090097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100095f0 con 0x7f6a200cd220 2023-08-31T02:00:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1ffff700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a2015d750 0x7f6a200c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a1f7fe700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a200cd220 0x7f6a201585d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6a100098e0 tx=0x7f6a1000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a07fff700 1 -- 172.21.15.84:0/438090097 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1001d070 con 0x7f6a200cd220 2023-08-31T02:00:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2006c660 con 0x7f6a200cd220 2023-08-31T02:00:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a07fff700 1 -- 172.21.15.84:0/438090097 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6a10003890 con 0x7f6a200cd220 2023-08-31T02:00:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a07fff700 1 -- 172.21.15.84:0/438090097 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10003ca0 con 0x7f6a200cd220 2023-08-31T02:00:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.005+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2006bd50 con 0x7f6a200cd220 2023-08-31T02:00:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.006+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2004e7c0 con 0x7f6a200cd220 2023-08-31T02:00:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.007+0000 7f6a07fff700 1 -- 172.21.15.84:0/438090097 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6a10022470 con 0x7f6a200cd220 2023-08-31T02:00:58.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.007+0000 7f6a07fff700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6a0c06a0e0 0x7f6a0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.007+0000 7f6a07fff700 1 -- 172.21.15.84:0/438090097 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6a1008a0d0 con 0x7f6a200cd220 2023-08-31T02:00:58.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.007+0000 7f6a1effd700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6a0c06a0e0 0x7f6a0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.007+0000 7f6a1effd700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6a0c06a0e0 0x7f6a0c06c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a14005950 tx=0x7f6a140058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.012+0000 7f6a07fff700 1 -- 172.21.15.84:0/438090097 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6a10055520 con 0x7f6a200cd220 2023-08-31T02:00:58.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.202+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6a20071d10 con 0x7f6a200cd220 2023-08-31T02:00:58.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.202+0000 7f6a07fff700 1 -- 172.21.15.84:0/438090097 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6a10058b40 con 0x7f6a200cd220 2023-08-31T02:00:58.195 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:58.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6a0c06a0e0 msgr2=0x7f6a0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6a0c06a0e0 0x7f6a0c06c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a14005950 tx=0x7f6a140058e0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a200cd220 msgr2=0x7f6a201585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a200cd220 0x7f6a201585d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6a100098e0 tx=0x7f6a1000beb0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 shutdown_connections 2023-08-31T02:00:58.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6a0c06a0e0 0x7f6a0c06c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a2015d750 0x7f6a200c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a200cd220 0x7f6a201585d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 --2- 172.21.15.84:0/438090097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a20159320 0x7f6a200c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 >> 172.21.15.84:0/438090097 conn(0x7f6a200b0c40 msgr2=0x7f6a2015ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:58.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 shutdown_connections 2023-08-31T02:00:58.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.204+0000 7f6a25b02700 1 -- 172.21.15.84:0/438090097 wait complete. 2023-08-31T02:00:58.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:00:58.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.340+0000 7f91ff8b3700 1 -- 172.21.15.84:0/2944413408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 msgr2=0x7f91f815cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.340+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/2944413408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 0x7f91f815cdb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009fd0 tx=0x7f91f000b380 comp rx=0 tx=0).stop 2023-08-31T02:00:58.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.340+0000 7f91ff8b3700 1 -- 172.21.15.84:0/2944413408 shutdown_connections 2023-08-31T02:00:58.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.340+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/2944413408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 0x7f91f815cdb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.340+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/2944413408 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91f80ce120 0x7f91f80cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.340+0000 7f91ff8b3700 1 -- 172.21.15.84:0/2944413408 >> 172.21.15.84:0/2944413408 conn(0x7f91f8069fd0 msgr2=0x7f91f80cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:58.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.340+0000 7f91ff8b3700 1 -- 172.21.15.84:0/2944413408 shutdown_connections 2023-08-31T02:00:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.340+0000 7f91ff8b3700 1 -- 172.21.15.84:0/2944413408 wait complete. 2023-08-31T02:00:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.341+0000 7f91ff8b3700 1 Processor -- start 2023-08-31T02:00:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.341+0000 7f91ff8b3700 1 -- start start 2023-08-31T02:00:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91ff8b3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91f80b0d90 0x7f91f814f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91ff8b3700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91f80ce120 0x7f91f80c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91ff8b3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 0x7f91f80c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91ff8b3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80c5fd0 con 0x7f91f8159370 2023-08-31T02:00:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91ff8b3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8154870 con 0x7f91f80b0d90 2023-08-31T02:00:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91ff8b3700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8154260 con 0x7f91f80ce120 2023-08-31T02:00:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 0x7f91f80c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 0x7f91f80c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53026/0 (socket says 172.21.15.84:53026) 2023-08-31T02:00:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 -- 172.21.15.84:0/3254634481 learned_addr learned my addr 172.21.15.84:0/3254634481 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fd64f700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91f80b0d90 0x7f91f814f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fce4e700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91f80ce120 0x7f91f80c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 -- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91f80ce120 msgr2=0x7f91f80c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91f80ce120 0x7f91f80c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 -- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91f80b0d90 msgr2=0x7f91f814f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91f80b0d90 0x7f91f814f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 -- 172.21.15.84:0/3254634481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f0009d00 con 0x7f91f8159370 2023-08-31T02:00:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fd64f700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91f80b0d90 0x7f91f814f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:58.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91fde50700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 0x7f91f80c3480 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f91f80ccad0 tx=0x7f91f0009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:58.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91edffb700 1 -- 172.21.15.84:0/3254634481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f000e040 con 0x7f91f8159370 2023-08-31T02:00:58.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91edffb700 1 -- 172.21.15.84:0/3254634481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f91f0007c00 con 0x7f91f8159370 2023-08-31T02:00:58.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.342+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f80c5cf0 con 0x7f91f8159370 2023-08-31T02:00:58.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.343+0000 7f91edffb700 1 -- 172.21.15.84:0/3254634481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0004030 con 0x7f91f8159370 2023-08-31T02:00:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.343+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f80c29c0 con 0x7f91f8159370 2023-08-31T02:00:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.344+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f80b1b30 con 0x7f91f8159370 2023-08-31T02:00:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.344+0000 7f91edffb700 1 -- 172.21.15.84:0/3254634481 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91f0004190 con 0x7f91f8159370 2023-08-31T02:00:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.344+0000 7f91edffb700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f91dc06a0e0 0x7f91dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.344+0000 7f91edffb700 1 -- 172.21.15.84:0/3254634481 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f91f008a050 con 0x7f91f8159370 2023-08-31T02:00:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.344+0000 7f91fd64f700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f91dc06a0e0 0x7f91dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.345+0000 7f91fd64f700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f91dc06a0e0 0x7f91dc06c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f91e8003fc0 tx=0x7f91e8009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.349+0000 7f91edffb700 1 -- 172.21.15.84:0/3254634481 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f91f0055570 con 0x7f91f8159370 2023-08-31T02:00:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.555+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f91f81540c0 con 0x7f91f8159370 2023-08-31T02:00:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.555+0000 7f91edffb700 1 -- 172.21.15.84:0/3254634481 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f91f81540c0 con 0x7f91f8159370 2023-08-31T02:00:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f91dc06a0e0 msgr2=0x7f91dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f91dc06a0e0 0x7f91dc06c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f91e8003fc0 tx=0x7f91e8009040 comp rx=0 tx=0).stop 2023-08-31T02:00:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 msgr2=0x7f91f80c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 0x7f91f80c3480 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f91f80ccad0 tx=0x7f91f0009470 comp rx=0 tx=0).stop 2023-08-31T02:00:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 shutdown_connections 2023-08-31T02:00:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f91dc06a0e0 0x7f91dc06c5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91f8159370 0x7f91f80c3480 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91f80b0d90 0x7f91f814f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 --2- 172.21.15.84:0/3254634481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91f80ce120 0x7f91f80c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.557+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 >> 172.21.15.84:0/3254634481 conn(0x7f91f8069fd0 msgr2=0x7f91f8157dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.558+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 shutdown_connections 2023-08-31T02:00:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.558+0000 7f91ff8b3700 1 -- 172.21.15.84:0/3254634481 wait complete. 2023-08-31T02:00:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:00:58.562 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:00:58.562 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:00:58.580 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:00:58.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.750+0000 7f606481e700 1 -- 172.21.15.84:0/3875003851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c005210 msgr2=0x7f604c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.750+0000 7f606481e700 1 --2- 172.21.15.84:0/3875003851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c005210 0x7f604c00ba10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f605800e350 tx=0x7f604c005880 comp rx=0 tx=0).stop 2023-08-31T02:00:58.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.750+0000 7f606481e700 1 -- 172.21.15.84:0/3875003851 shutdown_connections 2023-08-31T02:00:58.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.750+0000 7f606481e700 1 --2- 172.21.15.84:0/3875003851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c005210 0x7f604c00ba10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.750+0000 7f606481e700 1 -- 172.21.15.84:0/3875003851 >> 172.21.15.84:0/3875003851 conn(0x7f60600caa20 msgr2=0x7f60600cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:58.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.750+0000 7f606481e700 1 -- 172.21.15.84:0/3875003851 shutdown_connections 2023-08-31T02:00:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.750+0000 7f606481e700 1 -- 172.21.15.84:0/3875003851 wait complete. 2023-08-31T02:00:58.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f606481e700 1 Processor -- start 2023-08-31T02:00:58.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f606481e700 1 -- start start 2023-08-31T02:00:58.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f606481e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c005210 0x7f606014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f606481e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6060150430 0x7f60601508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f606481e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f606015ab70 0x7f606015b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f606481e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060150df0 con 0x7f606015ab70 2023-08-31T02:00:58.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f606481e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606015b8e0 con 0x7f6060150430 2023-08-31T02:00:58.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f606481e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60601e0ce0 con 0x7f604c005210 2023-08-31T02:00:58.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f605ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f606015ab70 0x7f606015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f605ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f606015ab70 0x7f606015b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53048/0 (socket says 172.21.15.84:53048) 2023-08-31T02:00:58.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.752+0000 7f605ed9d700 1 -- 172.21.15.84:0/2689002526 learned_addr learned my addr 172.21.15.84:0/2689002526 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:58.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605e59c700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c005210 0x7f606014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605dd9b700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6060150430 0x7f60601508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605ed9d700 1 -- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c005210 msgr2=0x7f606014daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605ed9d700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c005210 0x7f606014daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605ed9d700 1 -- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6060150430 msgr2=0x7f60601508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605ed9d700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6060150430 0x7f60601508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605ed9d700 1 -- 172.21.15.84:0/2689002526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060151c80 con 0x7f606015ab70 2023-08-31T02:00:58.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605dd9b700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6060150430 0x7f60601508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:58.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605e59c700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c005210 0x7f606014daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:58.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f605ed9d700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f606015ab70 0x7f606015b000 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f606006b520 tx=0x7f6058009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:58.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f6056ffd700 1 -- 172.21.15.84:0/2689002526 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058003c00 con 0x7f606015ab70 2023-08-31T02:00:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f6056ffd700 1 -- 172.21.15.84:0/2689002526 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6058003d60 con 0x7f606015ab70 2023-08-31T02:00:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6060151f20 con 0x7f606015ab70 2023-08-31T02:00:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f6056ffd700 1 -- 172.21.15.84:0/2689002526 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058007760 con 0x7f606015ab70 2023-08-31T02:00:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.753+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60601524e0 con 0x7f606015ab70 2023-08-31T02:00:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.754+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606004e7c0 con 0x7f606015ab70 2023-08-31T02:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.754+0000 7f6056ffd700 1 -- 172.21.15.84:0/2689002526 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60580078c0 con 0x7f606015ab70 2023-08-31T02:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.755+0000 7f6056ffd700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f604006a0e0 0x7f604006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.755+0000 7f6056ffd700 1 -- 172.21.15.84:0/2689002526 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6058088da0 con 0x7f606015ab70 2023-08-31T02:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.755+0000 7f605e59c700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f604006a0e0 0x7f604006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.755+0000 7f605e59c700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f604006a0e0 0x7f604006c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f60480017a0 tx=0x7f6048000ff0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.759+0000 7f6056ffd700 1 -- 172.21.15.84:0/2689002526 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6058054200 con 0x7f606015ab70 2023-08-31T02:00:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.950+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f606006be30 con 0x7f606015ab70 2023-08-31T02:00:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.951+0000 7f6056ffd700 1 -- 172.21.15.84:0/2689002526 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f6058057820 con 0x7f606015ab70 2023-08-31T02:00:58.944 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:00:58.944 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:00:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f604006a0e0 msgr2=0x7f604006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f604006a0e0 0x7f604006c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f60480017a0 tx=0x7f6048000ff0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f606015ab70 msgr2=0x7f606015b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:58.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f606015ab70 0x7f606015b000 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f606006b520 tx=0x7f6058009380 comp rx=0 tx=0).stop 2023-08-31T02:00:58.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 shutdown_connections 2023-08-31T02:00:58.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f604006a0e0 0x7f604006c5a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f606015ab70 0x7f606015b000 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c005210 0x7f606014daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 --2- 172.21.15.84:0/2689002526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6060150430 0x7f60601508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.953+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 >> 172.21.15.84:0/2689002526 conn(0x7f60600caa20 msgr2=0x7f606006d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.954+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 shutdown_connections 2023-08-31T02:00:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:58.954+0000 7f606481e700 1 -- 172.21.15.84:0/2689002526 wait complete. 2023-08-31T02:00:58.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:00:58.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:00:59.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.092+0000 7fe788962700 1 -- 172.21.15.84:0/3871626432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78415bbb0 msgr2=0x7fe78415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.092+0000 7fe788962700 1 --2- 172.21.15.84:0/3871626432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78415bbb0 0x7fe78415bf90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe7840c1a20 tx=0x7fe77c00b380 comp rx=0 tx=0).stop 2023-08-31T02:00:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.092+0000 7fe788962700 1 -- 172.21.15.84:0/3871626432 shutdown_connections 2023-08-31T02:00:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.092+0000 7fe788962700 1 --2- 172.21.15.84:0/3871626432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78415bbb0 0x7fe78415bf90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.092+0000 7fe788962700 1 --2- 172.21.15.84:0/3871626432 >> v2:172.21.15.170:3300/0 conn(0x7fe7840b17a0 0x7fe7840b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.092+0000 7fe788962700 1 -- 172.21.15.84:0/3871626432 >> 172.21.15.84:0/3871626432 conn(0x7fe7840caa00 msgr2=0x7fe7840cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.092+0000 7fe788962700 1 -- 172.21.15.84:0/3871626432 shutdown_connections 2023-08-31T02:00:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.092+0000 7fe788962700 1 -- 172.21.15.84:0/3871626432 wait complete. 2023-08-31T02:00:59.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.093+0000 7fe788962700 1 Processor -- start 2023-08-31T02:00:59.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.093+0000 7fe788962700 1 -- start start 2023-08-31T02:00:59.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe788962700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7840b17a0 0x7fe784154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe788962700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78414efe0 0x7fe78414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe788962700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe78415bbb0 0x7fe78414fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe788962700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78414dae0 con 0x7fe78414efe0 2023-08-31T02:00:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe788962700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840c24e0 con 0x7fe78415bbb0 2023-08-31T02:00:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe788962700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7841539c0 con 0x7fe7840b17a0 2023-08-31T02:00:59.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe781d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78414efe0 0x7fe78414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe781d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78414efe0 0x7fe78414d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53060/0 (socket says 172.21.15.84:53060) 2023-08-31T02:00:59.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe781d9b700 1 -- 172.21.15.84:0/1176274747 learned_addr learned my addr 172.21.15.84:0/1176274747 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:59.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe782d9d700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe78415bbb0 0x7fe78414fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.094+0000 7fe78259c700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7840b17a0 0x7fe784154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe781d9b700 1 -- 172.21.15.84:0/1176274747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7840b17a0 msgr2=0x7fe784154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe781d9b700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7840b17a0 0x7fe784154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe781d9b700 1 -- 172.21.15.84:0/1176274747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe78415bbb0 msgr2=0x7fe78414fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe781d9b700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe78415bbb0 0x7fe78414fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe781d9b700 1 -- 172.21.15.84:0/1176274747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c009d00 con 0x7fe78414efe0 2023-08-31T02:00:59.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe781d9b700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78414efe0 0x7fe78414d5a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe77400b530 tx=0x7fe77400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:59.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe772ffd700 1 -- 172.21.15.84:0/1176274747 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774011830 con 0x7fe78414efe0 2023-08-31T02:00:59.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe772ffd700 1 -- 172.21.15.84:0/1176274747 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe774011aa0 con 0x7fe78414efe0 2023-08-31T02:00:59.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7840c1bf0 con 0x7fe78414efe0 2023-08-31T02:00:59.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe772ffd700 1 -- 172.21.15.84:0/1176274747 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774010380 con 0x7fe78414efe0 2023-08-31T02:00:59.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.095+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7840c1e90 con 0x7fe78414efe0 2023-08-31T02:00:59.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.096+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78404e7c0 con 0x7fe78414efe0 2023-08-31T02:00:59.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.096+0000 7fe772ffd700 1 -- 172.21.15.84:0/1176274747 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe7740104e0 con 0x7fe78414efe0 2023-08-31T02:00:59.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.097+0000 7fe772ffd700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe76406a0e0 0x7fe76406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.097+0000 7fe772ffd700 1 -- 172.21.15.84:0/1176274747 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe774088b50 con 0x7fe78414efe0 2023-08-31T02:00:59.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.097+0000 7fe78259c700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe76406a0e0 0x7fe76406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.097+0000 7fe78259c700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe76406a0e0 0x7fe76406c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe778001730 tx=0x7fe778009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:59.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.101+0000 7fe772ffd700 1 -- 172.21.15.84:0/1176274747 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe774053ea0 con 0x7fe78414efe0 2023-08-31T02:00:59.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.294+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7840c8870 con 0x7fe78414efe0 2023-08-31T02:00:59.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.295+0000 7fe772ffd700 1 -- 172.21.15.84:0/1176274747 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7740574c0 con 0x7fe78414efe0 2023-08-31T02:00:59.288 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:00:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe76406a0e0 msgr2=0x7fe76406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe76406a0e0 0x7fe76406c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe778001730 tx=0x7fe778009040 comp rx=0 tx=0).stop 2023-08-31T02:00:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78414efe0 msgr2=0x7fe78414d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78414efe0 0x7fe78414d5a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe77400b530 tx=0x7fe77400b8f0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 shutdown_connections 2023-08-31T02:00:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe76406a0e0 0x7fe76406c5a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe78415bbb0 0x7fe78414fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7840b17a0 0x7fe784154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 --2- 172.21.15.84:0/1176274747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78414efe0 0x7fe78414d5a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 >> 172.21.15.84:0/1176274747 conn(0x7fe7840caa00 msgr2=0x7fe78414e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 shutdown_connections 2023-08-31T02:00:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.297+0000 7fe788962700 1 -- 172.21.15.84:0/1176274747 wait complete. 2023-08-31T02:00:59.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:00:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.435+0000 7f46906c8700 1 -- 172.21.15.84:0/152894803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46880cd5a0 msgr2=0x7f46880c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.435+0000 7f46906c8700 1 --2- 172.21.15.84:0/152894803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46880cd5a0 0x7f46880c8bd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4680009fd0 tx=0x7f468000b380 comp rx=0 tx=0).stop 2023-08-31T02:00:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.435+0000 7f46906c8700 1 -- 172.21.15.84:0/152894803 shutdown_connections 2023-08-31T02:00:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.435+0000 7f46906c8700 1 --2- 172.21.15.84:0/152894803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46880cd5a0 0x7f46880c8bd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.435+0000 7f46906c8700 1 --2- 172.21.15.84:0/152894803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46880c9820 0x7f46880cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.435+0000 7f46906c8700 1 -- 172.21.15.84:0/152894803 >> 172.21.15.84:0/152894803 conn(0x7f46880afb70 msgr2=0x7f46880aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.435+0000 7f46906c8700 1 -- 172.21.15.84:0/152894803 shutdown_connections 2023-08-31T02:00:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.435+0000 7f46906c8700 1 -- 172.21.15.84:0/152894803 wait complete. 2023-08-31T02:00:59.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.436+0000 7f46906c8700 1 Processor -- start 2023-08-31T02:00:59.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.436+0000 7f46906c8700 1 -- start start 2023-08-31T02:00:59.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f46906c8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46880cd5a0 0x7f4688137490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f46906c8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46881419d0 0x7f468813ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f46906c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f468813bf80 0x7f46880c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f46906c8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46881396b0 con 0x7f468813bf80 2023-08-31T02:00:59.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f46906c8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468813c430 con 0x7f46881419d0 2023-08-31T02:00:59.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f46906c8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46881379d0 con 0x7f46880cd5a0 2023-08-31T02:00:59.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f468813bf80 0x7f46880c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f468813bf80 0x7f46880c7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53076/0 (socket says 172.21.15.84:53076) 2023-08-31T02:00:59.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 -- 172.21.15.84:0/311710821 learned_addr learned my addr 172.21.15.84:0/311710821 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:59.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468dc63700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46881419d0 0x7f468813ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468e464700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46880cd5a0 0x7f4688137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 -- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46880cd5a0 msgr2=0x7f4688137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46880cd5a0 0x7f4688137490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 -- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46881419d0 msgr2=0x7f468813ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46881419d0 0x7f468813ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 -- 172.21.15.84:0/311710821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680009d00 con 0x7f468813bf80 2023-08-31T02:00:59.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468e464700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46880cd5a0 0x7f4688137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:59.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468dc63700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46881419d0 0x7f468813ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:00:59.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f468ec65700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f468813bf80 0x7f46880c7050 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f46880b0930 tx=0x7f4680009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:59.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f467effd700 1 -- 172.21.15.84:0/311710821 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468000e040 con 0x7f468813bf80 2023-08-31T02:00:59.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f467effd700 1 -- 172.21.15.84:0/311710821 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4680007ac0 con 0x7f468813bf80 2023-08-31T02:00:59.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4688138a30 con 0x7f468813bf80 2023-08-31T02:00:59.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f467effd700 1 -- 172.21.15.84:0/311710821 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680004030 con 0x7f468813bf80 2023-08-31T02:00:59.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.437+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4688138ff0 con 0x7f468813bf80 2023-08-31T02:00:59.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.438+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46881397f0 con 0x7f468813bf80 2023-08-31T02:00:59.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.439+0000 7f467effd700 1 -- 172.21.15.84:0/311710821 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4680004190 con 0x7f468813bf80 2023-08-31T02:00:59.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.439+0000 7f467effd700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f466c06a0e0 0x7f466c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.439+0000 7f468e464700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f466c06a0e0 0x7f466c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.439+0000 7f467effd700 1 -- 172.21.15.84:0/311710821 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4680089f70 con 0x7f468813bf80 2023-08-31T02:00:59.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.440+0000 7f468e464700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f466c06a0e0 0x7f466c06c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4678009930 tx=0x7f4678008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:59.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.444+0000 7f467effd700 1 -- 172.21.15.84:0/311710821 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f46800bc990 con 0x7f468813bf80 2023-08-31T02:00:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.635+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f468804e7c0 con 0x7f468813bf80 2023-08-31T02:00:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.635+0000 7f467effd700 1 -- 172.21.15.84:0/311710821 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46800170a0 con 0x7f468813bf80 2023-08-31T02:00:59.629 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:00:59.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f466c06a0e0 msgr2=0x7f466c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f466c06a0e0 0x7f466c06c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4678009930 tx=0x7f4678008040 comp rx=0 tx=0).stop 2023-08-31T02:00:59.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f468813bf80 msgr2=0x7f46880c7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f468813bf80 0x7f46880c7050 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f46880b0930 tx=0x7f4680009740 comp rx=0 tx=0).stop 2023-08-31T02:00:59.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 shutdown_connections 2023-08-31T02:00:59.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f466c06a0e0 0x7f466c06c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f468813bf80 0x7f46880c7050 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46880cd5a0 0x7f4688137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 --2- 172.21.15.84:0/311710821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46881419d0 0x7f468813ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 >> 172.21.15.84:0/311710821 conn(0x7f46880afb70 msgr2=0x7f468813efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:59.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.637+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 shutdown_connections 2023-08-31T02:00:59.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.638+0000 7f46906c8700 1 -- 172.21.15.84:0/311710821 wait complete. 2023-08-31T02:00:59.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:00:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.774+0000 7fa98e66c700 1 -- 172.21.15.84:0/4133389556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 msgr2=0x7fa98806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.774+0000 7fa98e66c700 1 --2- 172.21.15.84:0/4133389556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 0x7fa98806c720 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa9880b0760 tx=0x7fa978009c70 comp rx=0 tx=0).stop 2023-08-31T02:00:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.774+0000 7fa98e66c700 1 -- 172.21.15.84:0/4133389556 shutdown_connections 2023-08-31T02:00:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.774+0000 7fa98e66c700 1 --2- 172.21.15.84:0/4133389556 >> v2:172.21.15.170:3300/0 conn(0x7fa98815bce0 0x7fa9880cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.774+0000 7fa98e66c700 1 --2- 172.21.15.84:0/4133389556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 0x7fa98806c720 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.774+0000 7fa98e66c700 1 -- 172.21.15.84:0/4133389556 >> 172.21.15.84:0/4133389556 conn(0x7fa9880afb00 msgr2=0x7fa9880aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:59.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.774+0000 7fa98e66c700 1 -- 172.21.15.84:0/4133389556 shutdown_connections 2023-08-31T02:00:59.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.774+0000 7fa98e66c700 1 -- 172.21.15.84:0/4133389556 wait complete. 2023-08-31T02:00:59.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.775+0000 7fa98e66c700 1 Processor -- start 2023-08-31T02:00:59.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa98e66c700 1 -- start start 2023-08-31T02:00:59.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa98e66c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 0x7fa988151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa98e66c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa98815b790 0x7fa988159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa98e66c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa98815bce0 0x7fa988159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa98e66c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880b2dd0 con 0x7fa9880ca2d0 2023-08-31T02:00:59.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa98e66c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988156a50 con 0x7fa98815bce0 2023-08-31T02:00:59.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa98e66c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880b1540 con 0x7fa98815b790 2023-08-31T02:00:59.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa987fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 0x7fa988151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa987fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 0x7fa988151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53086/0 (socket says 172.21.15.84:53086) 2023-08-31T02:00:59.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.776+0000 7fa987fff700 1 -- 172.21.15.84:0/2425110728 learned_addr learned my addr 172.21.15.84:0/2425110728 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:00:59.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa98cc09700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa98815bce0 0x7fa988159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa9877fe700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa98815b790 0x7fa988159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa987fff700 1 -- 172.21.15.84:0/2425110728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa98815b790 msgr2=0x7fa988159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa987fff700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa98815b790 0x7fa988159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa987fff700 1 -- 172.21.15.84:0/2425110728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa98815bce0 msgr2=0x7fa988159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa987fff700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa98815bce0 0x7fa988159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa987fff700 1 -- 172.21.15.84:0/2425110728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780095f0 con 0x7fa9880ca2d0 2023-08-31T02:00:59.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa987fff700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 0x7fa988151a20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c4e0 tx=0x7fa97c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:59.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa984ff9700 1 -- 172.21.15.84:0/2425110728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0052d0 con 0x7fa9880ca2d0 2023-08-31T02:00:59.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa984ff9700 1 -- 172.21.15.84:0/2425110728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa97c005520 con 0x7fa9880ca2d0 2023-08-31T02:00:59.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9880b1820 con 0x7fa9880ca2d0 2023-08-31T02:00:59.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa984ff9700 1 -- 172.21.15.84:0/2425110728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0038e0 con 0x7fa9880ca2d0 2023-08-31T02:00:59.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.777+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9880b1de0 con 0x7fa9880ca2d0 2023-08-31T02:00:59.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.778+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9880b2000 con 0x7fa9880ca2d0 2023-08-31T02:00:59.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.778+0000 7fa984ff9700 1 -- 172.21.15.84:0/2425110728 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa97c003a40 con 0x7fa9880ca2d0 2023-08-31T02:00:59.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.779+0000 7fa984ff9700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa97406a0e0 0x7fa97406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:00:59.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.779+0000 7fa9877fe700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa97406a0e0 0x7fa97406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:00:59.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.779+0000 7fa984ff9700 1 -- 172.21.15.84:0/2425110728 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa97c087f40 con 0x7fa9880ca2d0 2023-08-31T02:00:59.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.779+0000 7fa9877fe700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa97406a0e0 0x7fa97406c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa978000c00 tx=0x7fa9780047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:00:59.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.783+0000 7fa984ff9700 1 -- 172.21.15.84:0/2425110728 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa97c0533a0 con 0x7fa9880ca2d0 2023-08-31T02:00:59.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.970+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa98806de50 con 0x7fa9880ca2d0 2023-08-31T02:00:59.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.971+0000 7fa984ff9700 1 -- 172.21.15.84:0/2425110728 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa97c0569c0 con 0x7fa9880ca2d0 2023-08-31T02:00:59.964 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:00:59.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa97406a0e0 msgr2=0x7fa97406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa97406a0e0 0x7fa97406c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa978000c00 tx=0x7fa9780047c0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 msgr2=0x7fa988151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:00:59.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 0x7fa988151a20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c4e0 tx=0x7fa97c00c8a0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 shutdown_connections 2023-08-31T02:00:59.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa97406a0e0 0x7fa97406c5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa98815bce0 0x7fa988159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9880ca2d0 0x7fa988151a20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 --2- 172.21.15.84:0/2425110728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa98815b790 0x7fa988159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:00:59.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 >> 172.21.15.84:0/2425110728 conn(0x7fa9880afb00 msgr2=0x7fa9880cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:00:59.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 shutdown_connections 2023-08-31T02:00:59.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:00:59.973+0000 7fa98e66c700 1 -- 172.21.15.84:0/2425110728 wait complete. 2023-08-31T02:00:59.978 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:01:00.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.111+0000 7f9632847700 1 -- 172.21.15.84:0/3027082689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c159320 msgr2=0x7f962c0b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.111+0000 7f9632847700 1 --2- 172.21.15.84:0/3027082689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c159320 0x7f962c0b0020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f96200098c0 tx=0x7f9620009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.111+0000 7f9632847700 1 -- 172.21.15.84:0/3027082689 shutdown_connections 2023-08-31T02:01:00.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.111+0000 7f9632847700 1 --2- 172.21.15.84:0/3027082689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c159320 0x7f962c0b0020 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.111+0000 7f9632847700 1 -- 172.21.15.84:0/3027082689 >> 172.21.15.84:0/3027082689 conn(0x7f962c0b0c40 msgr2=0x7f962c0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:00.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.112+0000 7f9632847700 1 -- 172.21.15.84:0/3027082689 shutdown_connections 2023-08-31T02:01:00.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.112+0000 7f9632847700 1 -- 172.21.15.84:0/3027082689 wait complete. 2023-08-31T02:01:00.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.113+0000 7f9632847700 1 Processor -- start 2023-08-31T02:01:00.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.113+0000 7f9632847700 1 -- start start 2023-08-31T02:01:00.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.113+0000 7f9632847700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c0cd3f0 0x7f962c15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.113+0000 7f9632847700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962c159320 0x7f962c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.113+0000 7f9632847700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f962c15d750 0x7f962c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9632847700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0c9000 con 0x7f962c0cd3f0 2023-08-31T02:01:00.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9632847700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0c8a40 con 0x7f962c15d750 2023-08-31T02:01:00.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9632847700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0c8d20 con 0x7f962c159320 2023-08-31T02:01:00.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c0cd3f0 0x7f962c15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c0cd3f0 0x7f962c15bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53100/0 (socket says 172.21.15.84:53100) 2023-08-31T02:01:00.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 -- 172.21.15.84:0/4196994916 learned_addr learned my addr 172.21.15.84:0/4196994916 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:00.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 -- 172.21.15.84:0/4196994916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962c159320 msgr2=0x7f962c06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962c159320 0x7f962c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 -- 172.21.15.84:0/4196994916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f962c15d750 msgr2=0x7f962c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9630de4700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f962c15d750 0x7f962c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f962c15d750 0x7f962c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 -- 172.21.15.84:0/4196994916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9620009520 con 0x7f962c0cd3f0 2023-08-31T02:01:00.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9630de4700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f962c15d750 0x7f962c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:00.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f962bfff700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c0cd3f0 0x7f962c15bf80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9620009fd0 tx=0x7f9620003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:00.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9628ff9700 1 -- 172.21.15.84:0/4196994916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962001c070 con 0x7f962c0cd3f0 2023-08-31T02:01:00.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9628ff9700 1 -- 172.21.15.84:0/4196994916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f962000b6a0 con 0x7f962c0cd3f0 2023-08-31T02:01:00.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c15ba60 con 0x7f962c0cd3f0 2023-08-31T02:01:00.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9628ff9700 1 -- 172.21.15.84:0/4196994916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000ba90 con 0x7f962c0cd3f0 2023-08-31T02:01:00.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.114+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c15c4c0 con 0x7f962c0cd3f0 2023-08-31T02:01:00.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.115+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c15bc70 con 0x7f962c0cd3f0 2023-08-31T02:01:00.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.115+0000 7f9628ff9700 1 -- 172.21.15.84:0/4196994916 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9620020070 con 0x7f962c0cd3f0 2023-08-31T02:01:00.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.116+0000 7f9628ff9700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f961806a0e0 0x7f961806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.116+0000 7f9628ff9700 1 -- 172.21.15.84:0/4196994916 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9620089d40 con 0x7f962c0cd3f0 2023-08-31T02:01:00.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.116+0000 7f962b7fe700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f961806a0e0 0x7f961806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.116+0000 7f962b7fe700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f961806a0e0 0x7f961806c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f962c0cd3a0 tx=0x7f961c0079c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:00.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.120+0000 7f9628ff9700 1 -- 172.21.15.84:0/4196994916 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f96200551a0 con 0x7f962c0cd3f0 2023-08-31T02:01:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.306+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f962c04e7c0 con 0x7f962c0cd3f0 2023-08-31T02:01:00.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.307+0000 7f9628ff9700 1 -- 172.21.15.84:0/4196994916 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f96200587c0 con 0x7f962c0cd3f0 2023-08-31T02:01:00.300 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:00.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f961806a0e0 msgr2=0x7f961806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f961806a0e0 0x7f961806c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f962c0cd3a0 tx=0x7f961c0079c0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c0cd3f0 msgr2=0x7f962c15bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c0cd3f0 0x7f962c15bf80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9620009fd0 tx=0x7f9620003eb0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 shutdown_connections 2023-08-31T02:01:00.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f961806a0e0 0x7f961806c5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f962c15d750 0x7f962c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f962c0cd3f0 0x7f962c15bf80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 --2- 172.21.15.84:0/4196994916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962c159320 0x7f962c06c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 >> 172.21.15.84:0/4196994916 conn(0x7f962c0b0c40 msgr2=0x7f962c15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:00.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 shutdown_connections 2023-08-31T02:01:00.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.309+0000 7f9632847700 1 -- 172.21.15.84:0/4196994916 wait complete. 2023-08-31T02:01:00.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:01:00.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.447+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3176673507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c003a30 msgr2=0x7fe27c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.447+0000 7fe29a6c4700 1 --2- 172.21.15.84:0/3176673507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27c003a30 0x7fe27c003e50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe28800dba0 tx=0x7fe27c005880 comp rx=0 tx=0).stop 2023-08-31T02:01:00.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.447+0000 7fe298c61700 1 -- 172.21.15.84:0/3176673507 reap_dead start 2023-08-31T02:01:00.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.447+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3176673507 shutdown_connections 2023-08-31T02:01:00.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.447+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3176673507 >> 172.21.15.84:0/3176673507 conn(0x7fe2940cdeb0 msgr2=0x7fe2940ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:00.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.447+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3176673507 shutdown_connections 2023-08-31T02:01:00.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.447+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3176673507 wait complete. 2023-08-31T02:01:00.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.448+0000 7fe29a6c4700 1 Processor -- start 2023-08-31T02:01:00.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.448+0000 7fe29a6c4700 1 -- start start 2023-08-31T02:01:00.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe29a6c4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe27c003a30 0x7fe29414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe29a6c4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2940c2a20 0x7fe2940c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe29a6c4700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940ad970 0x7fe2940addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe29a6c4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940c4b60 con 0x7fe2940c2a20 2023-08-31T02:01:00.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe29a6c4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940ae330 con 0x7fe27c003a30 2023-08-31T02:01:00.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe29a6c4700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29415a200 con 0x7fe2940ad970 2023-08-31T02:01:00.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe2937fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2940c2a20 0x7fe2940c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe2937fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2940c2a20 0x7fe2940c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53124/0 (socket says 172.21.15.84:53124) 2023-08-31T02:01:00.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.449+0000 7fe2937fe700 1 -- 172.21.15.84:0/3636276103 learned_addr learned my addr 172.21.15.84:0/3636276103 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:00.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe2937fe700 1 -- 172.21.15.84:0/3636276103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940ad970 msgr2=0x7fe2940addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe2937fe700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940ad970 0x7fe2940addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe2937fe700 1 -- 172.21.15.84:0/3636276103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe27c003a30 msgr2=0x7fe29414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe293fff700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe27c003a30 0x7fe29414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe2937fe700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe27c003a30 0x7fe29414c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe2937fe700 1 -- 172.21.15.84:0/3636276103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29415a4e0 con 0x7fe2940c2a20 2023-08-31T02:01:00.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe2937fe700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2940c2a20 0x7fe2940c2ea0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe284001eb0 tx=0x7fe28400ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:00.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe290ff9700 1 -- 172.21.15.84:0/3636276103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284010890 con 0x7fe2940c2a20 2023-08-31T02:01:00.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe290ff9700 1 -- 172.21.15.84:0/3636276103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe284010ae0 con 0x7fe2940c2a20 2023-08-31T02:01:00.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29415a7c0 con 0x7fe2940c2a20 2023-08-31T02:01:00.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe290ff9700 1 -- 172.21.15.84:0/3636276103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011460 con 0x7fe2940c2a20 2023-08-31T02:01:00.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.450+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29415ad80 con 0x7fe2940c2a20 2023-08-31T02:01:00.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.451+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29415afa0 con 0x7fe2940c2a20 2023-08-31T02:01:00.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.451+0000 7fe290ff9700 1 -- 172.21.15.84:0/3636276103 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2840115c0 con 0x7fe2940c2a20 2023-08-31T02:01:00.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.452+0000 7fe290ff9700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe28006a0e0 0x7fe28006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.452+0000 7fe293fff700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe28006a0e0 0x7fe28006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.452+0000 7fe290ff9700 1 -- 172.21.15.84:0/3636276103 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe284088f20 con 0x7fe2940c2a20 2023-08-31T02:01:00.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.452+0000 7fe293fff700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe28006a0e0 0x7fe28006c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe28800dfd0 tx=0x7fe288004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:00.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.456+0000 7fe290ff9700 1 -- 172.21.15.84:0/3636276103 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe2840542f0 con 0x7fe2940c2a20 2023-08-31T02:01:00.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.662+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe29404e7c0 con 0x7fe2940c2a20 2023-08-31T02:01:00.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.662+0000 7fe290ff9700 1 -- 172.21.15.84:0/3636276103 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe28401f020 con 0x7fe2940c2a20 2023-08-31T02:01:00.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.664+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe28006a0e0 msgr2=0x7fe28006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.664+0000 7fe29a6c4700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe28006a0e0 0x7fe28006c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe28800dfd0 tx=0x7fe288004750 comp rx=0 tx=0).stop 2023-08-31T02:01:00.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.664+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2940c2a20 msgr2=0x7fe2940c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.664+0000 7fe29a6c4700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2940c2a20 0x7fe2940c2ea0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe284001eb0 tx=0x7fe28400ea60 comp rx=0 tx=0).stop 2023-08-31T02:01:00.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.664+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 shutdown_connections 2023-08-31T02:01:00.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.664+0000 7fe29a6c4700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe28006a0e0 0x7fe28006c5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.664+0000 7fe29a6c4700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940ad970 0x7fe2940addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.664+0000 7fe29a6c4700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe27c003a30 0x7fe29414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.665+0000 7fe29a6c4700 1 --2- 172.21.15.84:0/3636276103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2940c2a20 0x7fe2940c2ea0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.665+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 >> 172.21.15.84:0/3636276103 conn(0x7fe2940cdeb0 msgr2=0x7fe2941563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:00.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.665+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 shutdown_connections 2023-08-31T02:01:00.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.665+0000 7fe29a6c4700 1 -- 172.21.15.84:0/3636276103 wait complete. 2023-08-31T02:01:00.660 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:01:00.669 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-08-31T02:01:00.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:00.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-08-31T02:01:00.708 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:01:00.708 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:01:00.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:00.709 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-31T02:01:00.765 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:01:00.766 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:00.787 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:01:00.788 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:00.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.978+0000 7f3517b7a700 1 -- 172.21.15.84:0/1753553163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc004850 msgr2=0x7f34fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.978+0000 7f3517b7a700 1 --2- 172.21.15.84:0/1753553163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc004850 0x7f34fc004cd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3500009bb0 tx=0x7f34fc005880 comp rx=0 tx=0).stop 2023-08-31T02:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.978+0000 7f3516117700 1 -- 172.21.15.84:0/1753553163 reap_dead start 2023-08-31T02:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.978+0000 7f3517b7a700 1 -- 172.21.15.84:0/1753553163 shutdown_connections 2023-08-31T02:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.978+0000 7f3517b7a700 1 -- 172.21.15.84:0/1753553163 >> 172.21.15.84:0/1753553163 conn(0x7f35100caa20 msgr2=0x7f35100cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.978+0000 7f3517b7a700 1 -- 172.21.15.84:0/1753553163 shutdown_connections 2023-08-31T02:01:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.978+0000 7f3517b7a700 1 -- 172.21.15.84:0/1753553163 wait complete. 2023-08-31T02:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.979+0000 7f3517b7a700 1 Processor -- start 2023-08-31T02:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.979+0000 7f3517b7a700 1 -- start start 2023-08-31T02:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3517b7a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc004850 0x7f3510152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3517b7a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35101f2740 0x7f35101e3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3517b7a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351015a9e0 0x7f35100b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3517b7a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101f1a50 con 0x7f351015a9e0 2023-08-31T02:01:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3517b7a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101f22b0 con 0x7f34fc004850 2023-08-31T02:01:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3517b7a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3510153500 con 0x7f35101f2740 2023-08-31T02:01:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3516117700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351015a9e0 0x7f35100b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3516117700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351015a9e0 0x7f35100b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53144/0 (socket says 172.21.15.84:53144) 2023-08-31T02:01:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3516117700 1 -- 172.21.15.84:0/3968850318 learned_addr learned my addr 172.21.15.84:0/3968850318 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3515115700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35101f2740 0x7f35101e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3515916700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc004850 0x7f3510152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3516117700 1 -- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35101f2740 msgr2=0x7f35101e3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3516117700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35101f2740 0x7f35101e3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3516117700 1 -- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc004850 msgr2=0x7f3510152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3516117700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc004850 0x7f3510152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3516117700 1 -- 172.21.15.84:0/3968850318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35101f1c60 con 0x7f351015a9e0 2023-08-31T02:01:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3515916700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc004850 0x7f3510152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:00.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.980+0000 7f3515115700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35101f2740 0x7f35101e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:00.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.981+0000 7f3516117700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351015a9e0 0x7f35100b3000 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f35100b0b30 tx=0x7f350800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:00.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.981+0000 7f35067fc700 1 -- 172.21.15.84:0/3968850318 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800c8a0 con 0x7f351015a9e0 2023-08-31T02:01:00.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.981+0000 7f35067fc700 1 -- 172.21.15.84:0/3968850318 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f350800cb10 con 0x7f351015a9e0 2023-08-31T02:01:00.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.981+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35101f1f40 con 0x7f351015a9e0 2023-08-31T02:01:00.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.981+0000 7f35067fc700 1 -- 172.21.15.84:0/3968850318 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508011460 con 0x7f351015a9e0 2023-08-31T02:01:00.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.981+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35100b3540 con 0x7f351015a9e0 2023-08-31T02:01:00.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.982+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351004e7c0 con 0x7f351015a9e0 2023-08-31T02:01:00.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.982+0000 7f35067fc700 1 -- 172.21.15.84:0/3968850318 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f35080115c0 con 0x7f351015a9e0 2023-08-31T02:01:00.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.982+0000 7f35067fc700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f34f406a0e0 0x7f34f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.983+0000 7f3515916700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f34f406a0e0 0x7f34f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.983+0000 7f35067fc700 1 -- 172.21.15.84:0/3968850318 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f3508088d90 con 0x7f351015a9e0 2023-08-31T02:01:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.983+0000 7f3515916700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f34f406a0e0 0x7f34f406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f350c0066e0 tx=0x7f350c006cd0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:00.987+0000 7f35067fc700 1 -- 172.21.15.84:0/3968850318 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3508054160 con 0x7f351015a9e0 2023-08-31T02:01:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.178+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35101e0e00 con 0x7f351015a9e0 2023-08-31T02:01:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.179+0000 7f35067fc700 1 -- 172.21.15.84:0/3968850318 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f3508057780 con 0x7f351015a9e0 2023-08-31T02:01:01.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:01.172 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f34f406a0e0 msgr2=0x7f34f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f34f406a0e0 0x7f34f406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f350c0066e0 tx=0x7f350c006cd0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351015a9e0 msgr2=0x7f35100b3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351015a9e0 0x7f35100b3000 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f35100b0b30 tx=0x7f350800ec10 comp rx=0 tx=0).stop 2023-08-31T02:01:01.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 shutdown_connections 2023-08-31T02:01:01.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f34f406a0e0 0x7f34f406c5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351015a9e0 0x7f35100b3000 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc004850 0x7f3510152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 --2- 172.21.15.84:0/3968850318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35101f2740 0x7f35101e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 >> 172.21.15.84:0/3968850318 conn(0x7f35100caa20 msgr2=0x7f35101573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 shutdown_connections 2023-08-31T02:01:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.181+0000 7f3517b7a700 1 -- 172.21.15.84:0/3968850318 wait complete. 2023-08-31T02:01:01.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:01:01.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:01:01.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.320+0000 7f675d4c6700 1 -- 172.21.15.84:0/3169488908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580b1080 msgr2=0x7f67581596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.320+0000 7f675d4c6700 1 --2- 172.21.15.84:0/3169488908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580b1080 0x7f67581596a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6750009fd0 tx=0x7f675000b380 comp rx=0 tx=0).stop 2023-08-31T02:01:01.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.320+0000 7f675d4c6700 1 -- 172.21.15.84:0/3169488908 shutdown_connections 2023-08-31T02:01:01.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.320+0000 7f675d4c6700 1 --2- 172.21.15.84:0/3169488908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580b1080 0x7f67581596a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.320+0000 7f675d4c6700 1 --2- 172.21.15.84:0/3169488908 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6758153770 0x7f67580c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.320+0000 7f675d4c6700 1 -- 172.21.15.84:0/3169488908 >> 172.21.15.84:0/3169488908 conn(0x7f67580cba80 msgr2=0x7f67580cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:01.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.320+0000 7f675d4c6700 1 -- 172.21.15.84:0/3169488908 shutdown_connections 2023-08-31T02:01:01.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.320+0000 7f675d4c6700 1 -- 172.21.15.84:0/3169488908 wait complete. 2023-08-31T02:01:01.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.321+0000 7f675d4c6700 1 Processor -- start 2023-08-31T02:01:01.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.321+0000 7f675d4c6700 1 -- start start 2023-08-31T02:01:01.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f675d4c6700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67580b1080 0x7f67580c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:01.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f675d4c6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580cb170 0x7f67580c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:01.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f675d4c6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6758153770 0x7f67580ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:01.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f675d4c6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67580c82b0 con 0x7f67580cb170 2023-08-31T02:01:01.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f675d4c6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67580c8590 con 0x7f6758153770 2023-08-31T02:01:01.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f675d4c6700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67580c8870 con 0x7f67580b1080 2023-08-31T02:01:01.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67567fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580cb170 0x7f67580c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:01.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67567fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580cb170 0x7f67580c13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53156/0 (socket says 172.21.15.84:53156) 2023-08-31T02:01:01.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67567fc700 1 -- 172.21.15.84:0/4175673540 learned_addr learned my addr 172.21.15.84:0/4175673540 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:01.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67577fe700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6758153770 0x7f67580ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:01.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67567fc700 1 -- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67580b1080 msgr2=0x7f67580c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f6756ffd700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67580b1080 0x7f67580c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:01.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67567fc700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67580b1080 0x7f67580c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67567fc700 1 -- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6758153770 msgr2=0x7f67580ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67567fc700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6758153770 0x7f67580ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67567fc700 1 -- 172.21.15.84:0/4175673540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750009d00 con 0x7f67580cb170 2023-08-31T02:01:01.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f67577fe700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6758153770 0x7f67580ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:01.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.322+0000 7f6756ffd700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67580b1080 0x7f67580c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:01.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.323+0000 7f67567fc700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580cb170 0x7f67580c13d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f674c00c4a0 tx=0x7f674c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.323+0000 7f673f7fe700 1 -- 172.21.15.84:0/4175673540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0054e0 con 0x7f67580cb170 2023-08-31T02:01:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.323+0000 7f673f7fe700 1 -- 172.21.15.84:0/4175673540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f674c003680 con 0x7f67580cb170 2023-08-31T02:01:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.323+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67580c8b50 con 0x7f67580cb170 2023-08-31T02:01:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.323+0000 7f673f7fe700 1 -- 172.21.15.84:0/4175673540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c003a90 con 0x7f67580cb170 2023-08-31T02:01:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.323+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67580c7ab0 con 0x7f67580cb170 2023-08-31T02:01:01.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.324+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67580c9070 con 0x7f67580cb170 2023-08-31T02:01:01.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.324+0000 7f673f7fe700 1 -- 172.21.15.84:0/4175673540 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f674c003bf0 con 0x7f67580cb170 2023-08-31T02:01:01.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.325+0000 7f673f7fe700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f674406a0e0 0x7f674406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:01.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.325+0000 7f6756ffd700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f674406a0e0 0x7f674406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:01.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.325+0000 7f673f7fe700 1 -- 172.21.15.84:0/4175673540 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f674c087ed0 con 0x7f67580cb170 2023-08-31T02:01:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.325+0000 7f6756ffd700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f674406a0e0 0x7f674406c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6748005950 tx=0x7f6748005d20 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.329+0000 7f673f7fe700 1 -- 172.21.15.84:0/4175673540 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f67580c9070 con 0x7f67580cb170 2023-08-31T02:01:01.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.525+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67580c9070 con 0x7f67580cb170 2023-08-31T02:01:01.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.525+0000 7f673f7fe700 1 -- 172.21.15.84:0/4175673540 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67580c9070 con 0x7f67580cb170 2023-08-31T02:01:01.519 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:01:01.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f674406a0e0 msgr2=0x7f674406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f674406a0e0 0x7f674406c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6748005950 tx=0x7f6748005d20 comp rx=0 tx=0).stop 2023-08-31T02:01:01.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580cb170 msgr2=0x7f67580c13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580cb170 0x7f67580c13d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f674c00c4a0 tx=0x7f674c00c860 comp rx=0 tx=0).stop 2023-08-31T02:01:01.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 shutdown_connections 2023-08-31T02:01:01.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f674406a0e0 0x7f674406c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6758153770 0x7f67580ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67580b1080 0x7f67580c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 --2- 172.21.15.84:0/4175673540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67580cb170 0x7f67580c13d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 >> 172.21.15.84:0/4175673540 conn(0x7f67580cba80 msgr2=0x7f675815bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:01.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 shutdown_connections 2023-08-31T02:01:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.527+0000 7f675d4c6700 1 -- 172.21.15.84:0/4175673540 wait complete. 2023-08-31T02:01:01.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:01:01.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.668+0000 7f310f27e700 1 -- 172.21.15.84:0/2244851667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cfcc0 msgr2=0x7f31080d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.668+0000 7f310f27e700 1 --2- 172.21.15.84:0/2244851667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cfcc0 0x7f31080d0150 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3100009fd0 tx=0x7f310000b380 comp rx=0 tx=0).stop 2023-08-31T02:01:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.668+0000 7f310f27e700 1 -- 172.21.15.84:0/2244851667 shutdown_connections 2023-08-31T02:01:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.668+0000 7f310f27e700 1 --2- 172.21.15.84:0/2244851667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cfcc0 0x7f31080d0150 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.668+0000 7f310f27e700 1 --2- 172.21.15.84:0/2244851667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f310815eac0 0x7f31080699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.668+0000 7f310f27e700 1 -- 172.21.15.84:0/2244851667 >> 172.21.15.84:0/2244851667 conn(0x7f31080d11c0 msgr2=0x7f31080d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.668+0000 7f310f27e700 1 -- 172.21.15.84:0/2244851667 shutdown_connections 2023-08-31T02:01:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.668+0000 7f310f27e700 1 -- 172.21.15.84:0/2244851667 wait complete. 2023-08-31T02:01:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.670+0000 7f310f27e700 1 Processor -- start 2023-08-31T02:01:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.670+0000 7f310f27e700 1 -- start start 2023-08-31T02:01:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.670+0000 7f310f27e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cba20 0x7f3108151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.670+0000 7f310f27e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31080cfcc0 0x7f3108157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.670+0000 7f310f27e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310815eac0 0x7f3108155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.670+0000 7f310f27e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108154530 con 0x7f31080cba20 2023-08-31T02:01:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.670+0000 7f310f27e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31081523a0 con 0x7f310815eac0 2023-08-31T02:01:01.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.670+0000 7f310f27e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3108154a40 con 0x7f31080cfcc0 2023-08-31T02:01:01.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cba20 0x7f3108151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:01.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cba20 0x7f3108151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53166/0 (socket says 172.21.15.84:53166) 2023-08-31T02:01:01.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 -- 172.21.15.84:0/640642007 learned_addr learned my addr 172.21.15.84:0/640642007 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:01.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 -- 172.21.15.84:0/640642007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31080cfcc0 msgr2=0x7f3108157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31080cfcc0 0x7f3108157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 -- 172.21.15.84:0/640642007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310815eac0 msgr2=0x7f3108155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310815eac0 0x7f3108155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 -- 172.21.15.84:0/640642007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100009d00 con 0x7f31080cba20 2023-08-31T02:01:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310d01a700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cba20 0x7f3108151e60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f310400d950 tx=0x7f310400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:01.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f30fdffb700 1 -- 172.21.15.84:0/640642007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31040098d0 con 0x7f31080cba20 2023-08-31T02:01:01.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f30fdffb700 1 -- 172.21.15.84:0/640642007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3104009b20 con 0x7f31080cba20 2023-08-31T02:01:01.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3108154d20 con 0x7f31080cba20 2023-08-31T02:01:01.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f30fdffb700 1 -- 172.21.15.84:0/640642007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104010460 con 0x7f31080cba20 2023-08-31T02:01:01.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.671+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31081552e0 con 0x7f31080cba20 2023-08-31T02:01:01.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.672+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3108155470 con 0x7f31080cba20 2023-08-31T02:01:01.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.673+0000 7f30fdffb700 1 -- 172.21.15.84:0/640642007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31040105c0 con 0x7f31080cba20 2023-08-31T02:01:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.673+0000 7f30fdffb700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.673+0000 7f310c819700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.673+0000 7f30fdffb700 1 -- 172.21.15.84:0/640642007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f3104088af0 con 0x7f31080cba20 2023-08-31T02:01:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.674+0000 7f310c819700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30f8000f60 tx=0x7f30f8007a40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.678+0000 7f30fdffb700 1 -- 172.21.15.84:0/640642007 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3104053f50 con 0x7f31080cba20 2023-08-31T02:01:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.865+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f310804e7c0 con 0x7f31080cba20 2023-08-31T02:01:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.866+0000 7f30fdffb700 1 -- 172.21.15.84:0/640642007 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3104017020 con 0x7f31080cba20 2023-08-31T02:01:01.859 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:01.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f30ec06a0e0 msgr2=0x7f30ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30f8000f60 tx=0x7f30f8007a40 comp rx=0 tx=0).stop 2023-08-31T02:01:01.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cba20 msgr2=0x7f3108151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cba20 0x7f3108151e60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f310400d950 tx=0x7f310400dd10 comp rx=0 tx=0).stop 2023-08-31T02:01:01.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 shutdown_connections 2023-08-31T02:01:01.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310815eac0 0x7f3108155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31080cba20 0x7f3108151e60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 --2- 172.21.15.84:0/640642007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31080cfcc0 0x7f3108157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:01.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 >> 172.21.15.84:0/640642007 conn(0x7f31080d11c0 msgr2=0x7f3108069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:01.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 shutdown_connections 2023-08-31T02:01:01.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:01.868+0000 7f310f27e700 1 -- 172.21.15.84:0/640642007 wait complete. 2023-08-31T02:01:01.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:01:01.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.006+0000 7efefc910700 1 -- 172.21.15.84:0/4109118257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 msgr2=0x7efee0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:01.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.006+0000 7efefc910700 1 --2- 172.21.15.84:0/4109118257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 0x7efee0005210 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efef000c640 tx=0x7efee0005880 comp rx=0 tx=0).stop 2023-08-31T02:01:01.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.006+0000 7efef6d9d700 1 -- 172.21.15.84:0/4109118257 reap_dead start 2023-08-31T02:01:02.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.006+0000 7efefc910700 1 -- 172.21.15.84:0/4109118257 shutdown_connections 2023-08-31T02:01:02.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.006+0000 7efefc910700 1 -- 172.21.15.84:0/4109118257 >> 172.21.15.84:0/4109118257 conn(0x7efef80afb00 msgr2=0x7efef80aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:02.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.006+0000 7efefc910700 1 -- 172.21.15.84:0/4109118257 shutdown_connections 2023-08-31T02:01:02.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.006+0000 7efefc910700 1 -- 172.21.15.84:0/4109118257 wait complete. 2023-08-31T02:01:02.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.007+0000 7efefc910700 1 Processor -- start 2023-08-31T02:01:02.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.007+0000 7efefc910700 1 -- start start 2023-08-31T02:01:02.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efefc910700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 0x7efef80af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efefc910700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8151010 0x7efef80b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efefc910700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef80c21b0 0x7efef80c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efefc910700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef80c2ba0 con 0x7efee0004d90 2023-08-31T02:01:02.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efefc910700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef80af910 con 0x7efef8151010 2023-08-31T02:01:02.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efefc910700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef8152120 con 0x7efef80c21b0 2023-08-31T02:01:02.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efef659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 0x7efef80af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efef659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 0x7efef80af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53186/0 (socket says 172.21.15.84:53186) 2023-08-31T02:01:02.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efef659c700 1 -- 172.21.15.84:0/2686850770 learned_addr learned my addr 172.21.15.84:0/2686850770 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:02.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efef5d9b700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8151010 0x7efef80b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.008+0000 7efef6d9d700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef80c21b0 0x7efef80c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efef659c700 1 -- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef80c21b0 msgr2=0x7efef80c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efef659c700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef80c21b0 0x7efef80c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efef659c700 1 -- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8151010 msgr2=0x7efef80b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efef659c700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8151010 0x7efef80b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efef659c700 1 -- 172.21.15.84:0/2686850770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef81525b0 con 0x7efee0004d90 2023-08-31T02:01:02.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efef5d9b700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8151010 0x7efef80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:02.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efef659c700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 0x7efef80af3d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efeec004ee0 tx=0x7efeec001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:02.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efee6ffd700 1 -- 172.21.15.84:0/2686850770 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec011660 con 0x7efee0004d90 2023-08-31T02:01:02.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efee6ffd700 1 -- 172.21.15.84:0/2686850770 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efeec0118b0 con 0x7efee0004d90 2023-08-31T02:01:02.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef8153e30 con 0x7efee0004d90 2023-08-31T02:01:02.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efee6ffd700 1 -- 172.21.15.84:0/2686850770 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec011ca0 con 0x7efee0004d90 2023-08-31T02:01:02.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.009+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef8151510 con 0x7efee0004d90 2023-08-31T02:01:02.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.010+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef804e7c0 con 0x7efee0004d90 2023-08-31T02:01:02.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.010+0000 7efee6ffd700 1 -- 172.21.15.84:0/2686850770 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efeec01a400 con 0x7efee0004d90 2023-08-31T02:01:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.011+0000 7efee6ffd700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efed806a0e0 0x7efed806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.011+0000 7efee6ffd700 1 -- 172.21.15.84:0/2686850770 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7efeec089460 con 0x7efee0004d90 2023-08-31T02:01:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.011+0000 7efef5d9b700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efed806a0e0 0x7efed806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.011+0000 7efef5d9b700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efed806a0e0 0x7efed806c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efee8005e10 tx=0x7efee8005da0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.015+0000 7efee6ffd700 1 -- 172.21.15.84:0/2686850770 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efeec054830 con 0x7efee0004d90 2023-08-31T02:01:02.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.205+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efef80718b0 con 0x7efee0004d90 2023-08-31T02:01:02.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.206+0000 7efee6ffd700 1 -- 172.21.15.84:0/2686850770 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7efeec057e50 con 0x7efee0004d90 2023-08-31T02:01:02.199 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:01:02.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.207+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efed806a0e0 msgr2=0x7efed806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efed806a0e0 0x7efed806c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efee8005e10 tx=0x7efee8005da0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 msgr2=0x7efef80af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 0x7efef80af3d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efeec004ee0 tx=0x7efeec001540 comp rx=0 tx=0).stop 2023-08-31T02:01:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 shutdown_connections 2023-08-31T02:01:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7efed806a0e0 0x7efed806c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef80c21b0 0x7efef80c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efee0004d90 0x7efef80af3d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 --2- 172.21.15.84:0/2686850770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8151010 0x7efef80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 >> 172.21.15.84:0/2686850770 conn(0x7efef80afb00 msgr2=0x7efef80c3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:02.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 shutdown_connections 2023-08-31T02:01:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.208+0000 7efefc910700 1 -- 172.21.15.84:0/2686850770 wait complete. 2023-08-31T02:01:02.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:01:02.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.345+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2037674190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eec004d90 msgr2=0x7f2eec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.345+0000 7f2f08f4b700 1 --2- 172.21.15.84:0/2037674190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eec004d90 0x7f2eec005210 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2efc001dd0 tx=0x7f2eec005880 comp rx=0 tx=0).stop 2023-08-31T02:01:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.345+0000 7f2f02d9d700 1 -- 172.21.15.84:0/2037674190 reap_dead start 2023-08-31T02:01:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.345+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2037674190 shutdown_connections 2023-08-31T02:01:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.345+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2037674190 >> 172.21.15.84:0/2037674190 conn(0x7f2f040afb00 msgr2=0x7f2f040aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.345+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2037674190 shutdown_connections 2023-08-31T02:01:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.345+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2037674190 wait complete. 2023-08-31T02:01:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.347+0000 7f2f08f4b700 1 Processor -- start 2023-08-31T02:01:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.347+0000 7f2f08f4b700 1 -- start start 2023-08-31T02:01:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f08f4b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eec004d90 0x7f2f040c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f08f4b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f040c7a70 0x7f2f040b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f08f4b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f041503c0 0x7f2f0406a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f08f4b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040c7ef0 con 0x7f2f041503c0 2023-08-31T02:01:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f08f4b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040b2300 con 0x7f2f040c7a70 2023-08-31T02:01:02.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f08f4b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040c69d0 con 0x7f2eec004d90 2023-08-31T02:01:02.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f041503c0 0x7f2f0406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f041503c0 0x7f2f0406a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53210/0 (socket says 172.21.15.84:53210) 2023-08-31T02:01:02.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 -- 172.21.15.84:0/2759471066 learned_addr learned my addr 172.21.15.84:0/2759471066 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:02.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f0259c700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eec004d90 0x7f2f040c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f01d9b700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f040c7a70 0x7f2f040b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 -- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eec004d90 msgr2=0x7f2f040c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eec004d90 0x7f2f040c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 -- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f040c7a70 msgr2=0x7f2f040b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f040c7a70 0x7f2f040b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 -- 172.21.15.84:0/2759471066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040c6cb0 con 0x7f2f041503c0 2023-08-31T02:01:02.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f0259c700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eec004d90 0x7f2f040c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:02.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f02d9d700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f041503c0 0x7f2f0406a230 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2efc004000 tx=0x7f2efc0011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:02.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2ef2ffd700 1 -- 172.21.15.84:0/2759471066 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc015070 con 0x7f2f041503c0 2023-08-31T02:01:02.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2ef2ffd700 1 -- 172.21.15.84:0/2759471066 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2efc00ccb0 con 0x7f2f041503c0 2023-08-31T02:01:02.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f040c6f90 con 0x7f2f041503c0 2023-08-31T02:01:02.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2ef2ffd700 1 -- 172.21.15.84:0/2759471066 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc006330 con 0x7f2f041503c0 2023-08-31T02:01:02.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.348+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f040c7550 con 0x7f2f041503c0 2023-08-31T02:01:02.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.349+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0404e7c0 con 0x7f2f041503c0 2023-08-31T02:01:02.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.350+0000 7f2ef2ffd700 1 -- 172.21.15.84:0/2759471066 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2efc006490 con 0x7f2f041503c0 2023-08-31T02:01:02.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.350+0000 7f2ef2ffd700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ee406a0e0 0x7f2ee406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.350+0000 7f2ef2ffd700 1 -- 172.21.15.84:0/2759471066 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2efc08a2e0 con 0x7f2f041503c0 2023-08-31T02:01:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.351+0000 7f2f0259c700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ee406a0e0 0x7f2ee406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.351+0000 7f2f0259c700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ee406a0e0 0x7f2ee406c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009d40 tx=0x7f2ef8009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.354+0000 7f2ef2ffd700 1 -- 172.21.15.84:0/2759471066 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2efc055940 con 0x7f2f041503c0 2023-08-31T02:01:02.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.543+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2f040718b0 con 0x7f2f041503c0 2023-08-31T02:01:02.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.544+0000 7f2ef2ffd700 1 -- 172.21.15.84:0/2759471066 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2efc058f60 con 0x7f2f041503c0 2023-08-31T02:01:02.537 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ee406a0e0 msgr2=0x7f2ee406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ee406a0e0 0x7f2ee406c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009d40 tx=0x7f2ef8009260 comp rx=0 tx=0).stop 2023-08-31T02:01:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f041503c0 msgr2=0x7f2f0406a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f041503c0 0x7f2f0406a230 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2efc004000 tx=0x7f2efc0011c0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 shutdown_connections 2023-08-31T02:01:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2ee406a0e0 0x7f2ee406c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f041503c0 0x7f2f0406a230 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eec004d90 0x7f2f040c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 --2- 172.21.15.84:0/2759471066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f040c7a70 0x7f2f040b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 >> 172.21.15.84:0/2759471066 conn(0x7f2f040afb00 msgr2=0x7f2f040c3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 shutdown_connections 2023-08-31T02:01:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.546+0000 7f2f08f4b700 1 -- 172.21.15.84:0/2759471066 wait complete. 2023-08-31T02:01:02.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:01:02.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 -- 172.21.15.84:0/334668576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e4070460 msgr2=0x7f61e415b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/334668576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e4070460 0x7f61e415b3f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f61e4070b50 tx=0x7f61dc00c4c0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 -- 172.21.15.84:0/334668576 shutdown_connections 2023-08-31T02:01:02.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/334668576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e4070460 0x7f61e415b3f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/334668576 >> v2:172.21.15.170:3300/0 conn(0x7f61e41578b0 0x7f61e40cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/334668576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61e40b0460 0x7f61e406ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 -- 172.21.15.84:0/334668576 >> 172.21.15.84:0/334668576 conn(0x7f61e40ca090 msgr2=0x7f61e40ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:02.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 -- 172.21.15.84:0/334668576 shutdown_connections 2023-08-31T02:01:02.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.682+0000 7f61e8ff5700 1 -- 172.21.15.84:0/334668576 wait complete. 2023-08-31T02:01:02.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.683+0000 7f61e8ff5700 1 Processor -- start 2023-08-31T02:01:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.683+0000 7f61e8ff5700 1 -- start start 2023-08-31T02:01:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e8ff5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e4070460 0x7f61e40c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e8ff5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e40b0460 0x7f61e4153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e8ff5700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61e41578b0 0x7f61e40c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e8ff5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40ac280 con 0x7f61e40b0460 2023-08-31T02:01:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e8ff5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41e29a0 con 0x7f61e4070460 2023-08-31T02:01:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e8ff5700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40c4460 con 0x7f61e41578b0 2023-08-31T02:01:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e40b0460 0x7f61e4153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e40b0460 0x7f61e4153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53220/0 (socket says 172.21.15.84:53220) 2023-08-31T02:01:02.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e1d9b700 1 -- 172.21.15.84:0/2631619407 learned_addr learned my addr 172.21.15.84:0/2631619407 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:02.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e2d9d700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61e41578b0 0x7f61e40c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.684+0000 7f61e259c700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e4070460 0x7f61e40c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e1d9b700 1 -- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61e41578b0 msgr2=0x7f61e40c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e1d9b700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61e41578b0 0x7f61e40c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e1d9b700 1 -- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e4070460 msgr2=0x7f61e40c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e1d9b700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e4070460 0x7f61e40c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e1d9b700 1 -- 172.21.15.84:0/2631619407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc00ae10 con 0x7f61e40b0460 2023-08-31T02:01:02.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e2d9d700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61e41578b0 0x7f61e40c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:02.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e1d9b700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e40b0460 0x7f61e4153c10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f61d800b590 tx=0x7f61d800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:02.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61d2ffd700 1 -- 172.21.15.84:0/2631619407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8011830 con 0x7f61e40b0460 2023-08-31T02:01:02.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61d2ffd700 1 -- 172.21.15.84:0/2631619407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f61d8011a80 con 0x7f61e40b0460 2023-08-31T02:01:02.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61d2ffd700 1 -- 172.21.15.84:0/2631619407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8011e90 con 0x7f61e40b0460 2023-08-31T02:01:02.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e4154150 con 0x7f61e40b0460 2023-08-31T02:01:02.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.685+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e41e2350 con 0x7f61e40b0460 2023-08-31T02:01:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.686+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e404e7c0 con 0x7f61e40b0460 2023-08-31T02:01:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.686+0000 7f61d2ffd700 1 -- 172.21.15.84:0/2631619407 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f61d801a400 con 0x7f61e40b0460 2023-08-31T02:01:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.687+0000 7f61d2ffd700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f61c406a0e0 0x7f61c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.687+0000 7f61e259c700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f61c406a0e0 0x7f61c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:02.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.687+0000 7f61d2ffd700 1 -- 172.21.15.84:0/2631619407 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f61d8088b60 con 0x7f61e40b0460 2023-08-31T02:01:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.687+0000 7f61e259c700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f61c406a0e0 0x7f61c406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009870 tx=0x7f61d4008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:02.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.691+0000 7f61d2ffd700 1 -- 172.21.15.84:0/2631619407 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f61d8053eb0 con 0x7f61e40b0460 2023-08-31T02:01:02.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.894+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f61e40c7c20 con 0x7f61e40b0460 2023-08-31T02:01:02.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.894+0000 7f61d2ffd700 1 -- 172.21.15.84:0/2631619407 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f61d80574d0 con 0x7f61e40b0460 2023-08-31T02:01:02.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f61c406a0e0 msgr2=0x7f61c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f61c406a0e0 0x7f61c406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009870 tx=0x7f61d4008040 comp rx=0 tx=0).stop 2023-08-31T02:01:02.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e40b0460 msgr2=0x7f61e4153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:02.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e40b0460 0x7f61e4153c10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f61d800b590 tx=0x7f61d800b950 comp rx=0 tx=0).stop 2023-08-31T02:01:02.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 shutdown_connections 2023-08-31T02:01:02.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f61c406a0e0 0x7f61c406c5a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61e41578b0 0x7f61e40c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e4070460 0x7f61e40c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 --2- 172.21.15.84:0/2631619407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61e40b0460 0x7f61e4153c10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 >> 172.21.15.84:0/2631619407 conn(0x7f61e40ca090 msgr2=0x7f61e40ad990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 shutdown_connections 2023-08-31T02:01:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:02.896+0000 7f61e8ff5700 1 -- 172.21.15.84:0/2631619407 wait complete. 2023-08-31T02:01:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:01:02.901 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:01:02.901 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:02.924 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:03.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 -- 172.21.15.84:0/2195486602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8070460 msgr2=0x7fe3a815ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 --2- 172.21.15.84:0/2195486602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8070460 0x7fe3a815ce60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80caf60 tx=0x7fe3a000b380 comp rx=0 tx=0).stop 2023-08-31T02:01:03.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 -- 172.21.15.84:0/2195486602 shutdown_connections 2023-08-31T02:01:03.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 --2- 172.21.15.84:0/2195486602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8070460 0x7fe3a815ce60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 --2- 172.21.15.84:0/2195486602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3a815a500 0x7fe3a80cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 --2- 172.21.15.84:0/2195486602 >> v2:172.21.15.170:3300/0 conn(0x7fe3a8159950 0x7fe3a806ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 -- 172.21.15.84:0/2195486602 >> 172.21.15.84:0/2195486602 conn(0x7fe3a80ca090 msgr2=0x7fe3a80ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:03.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 -- 172.21.15.84:0/2195486602 shutdown_connections 2023-08-31T02:01:03.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.053+0000 7fe3acda9700 1 -- 172.21.15.84:0/2195486602 wait complete. 2023-08-31T02:01:03.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.054+0000 7fe3acda9700 1 Processor -- start 2023-08-31T02:01:03.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.054+0000 7fe3acda9700 1 -- start start 2023-08-31T02:01:03.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3acda9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a8070460 0x7fe3a814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3acda9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8159950 0x7fe3a81538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3acda9700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3a815a500 0x7fe3a8156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3acda9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a814d970 con 0x7fe3a8159950 2023-08-31T02:01:03.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3acda9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81e2e20 con 0x7fe3a8070460 2023-08-31T02:01:03.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3acda9700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81e30e0 con 0x7fe3a815a500 2023-08-31T02:01:03.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8159950 0x7fe3a81538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8159950 0x7fe3a81538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53234/0 (socket says 172.21.15.84:53234) 2023-08-31T02:01:03.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a5d9b700 1 -- 172.21.15.84:0/26355460 learned_addr learned my addr 172.21.15.84:0/26355460 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:03.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a6d9d700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3a815a500 0x7fe3a8156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a659c700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a8070460 0x7fe3a814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a5d9b700 1 -- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3a815a500 msgr2=0x7fe3a8156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a5d9b700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3a815a500 0x7fe3a8156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a5d9b700 1 -- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a8070460 msgr2=0x7fe3a814d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a5d9b700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a8070460 0x7fe3a814d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a5d9b700 1 -- 172.21.15.84:0/26355460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0009d00 con 0x7fe3a8159950 2023-08-31T02:01:03.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.055+0000 7fe3a6d9d700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3a815a500 0x7fe3a8156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:03.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.056+0000 7fe3a5d9b700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8159950 0x7fe3a81538a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00c8f0 tx=0x7fe39c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:03.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.056+0000 7fe396ffd700 1 -- 172.21.15.84:0/26355460 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c007b00 con 0x7fe3a8159950 2023-08-31T02:01:03.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.056+0000 7fe396ffd700 1 -- 172.21.15.84:0/26355460 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe39c007d50 con 0x7fe3a8159950 2023-08-31T02:01:03.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.056+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a81e33c0 con 0x7fe3a8159950 2023-08-31T02:01:03.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.056+0000 7fe396ffd700 1 -- 172.21.15.84:0/26355460 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00f6b0 con 0x7fe3a8159950 2023-08-31T02:01:03.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.056+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a814dd10 con 0x7fe3a8159950 2023-08-31T02:01:03.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.057+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a81e38e0 con 0x7fe3a8159950 2023-08-31T02:01:03.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.057+0000 7fe396ffd700 1 -- 172.21.15.84:0/26355460 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe39c00f810 con 0x7fe3a8159950 2023-08-31T02:01:03.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.057+0000 7fe396ffd700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe38806a0e0 0x7fe38806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.058+0000 7fe396ffd700 1 -- 172.21.15.84:0/26355460 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe39c088ef0 con 0x7fe3a8159950 2023-08-31T02:01:03.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.058+0000 7fe3a659c700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe38806a0e0 0x7fe38806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.058+0000 7fe3a659c700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe38806a0e0 0x7fe38806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe398005d70 tx=0x7fe398005d00 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:03.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.062+0000 7fe396ffd700 1 -- 172.21.15.84:0/26355460 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe3a81e38e0 con 0x7fe3a8159950 2023-08-31T02:01:03.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.257+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3a81e38e0 con 0x7fe3a8159950 2023-08-31T02:01:03.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.258+0000 7fe396ffd700 1 -- 172.21.15.84:0/26355460 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7fe3a81e38e0 con 0x7fe3a8159950 2023-08-31T02:01:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:03.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe38806a0e0 msgr2=0x7fe38806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe38806a0e0 0x7fe38806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe398005d70 tx=0x7fe398005d00 comp rx=0 tx=0).stop 2023-08-31T02:01:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8159950 msgr2=0x7fe3a81538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8159950 0x7fe3a81538a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00c8f0 tx=0x7fe39c00ccb0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 shutdown_connections 2023-08-31T02:01:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe38806a0e0 0x7fe38806c5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3a815a500 0x7fe3a8156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a8070460 0x7fe3a814d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 --2- 172.21.15.84:0/26355460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3a8159950 0x7fe3a81538a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 >> 172.21.15.84:0/26355460 conn(0x7fe3a80ca090 msgr2=0x7fe3a8157630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 shutdown_connections 2023-08-31T02:01:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.260+0000 7fe3acda9700 1 -- 172.21.15.84:0/26355460 wait complete. 2023-08-31T02:01:03.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:01:03.267 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:01:03.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.400+0000 7fb6b695c700 1 -- 172.21.15.84:0/1447490922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b015d750 msgr2=0x7fb6b00cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.400+0000 7fb6b695c700 1 --2- 172.21.15.84:0/1447490922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b015d750 0x7fb6b00cb360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009fd0 tx=0x7fb6a800b380 comp rx=0 tx=0).stop 2023-08-31T02:01:03.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.400+0000 7fb6b695c700 1 -- 172.21.15.84:0/1447490922 shutdown_connections 2023-08-31T02:01:03.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.400+0000 7fb6b695c700 1 --2- 172.21.15.84:0/1447490922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b015d750 0x7fb6b00cb360 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.400+0000 7fb6b695c700 1 --2- 172.21.15.84:0/1447490922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b00cd3f0 0x7fb6b00b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.400+0000 7fb6b695c700 1 -- 172.21.15.84:0/1447490922 >> 172.21.15.84:0/1447490922 conn(0x7fb6b00b0c40 msgr2=0x7fb6b00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.400+0000 7fb6b695c700 1 -- 172.21.15.84:0/1447490922 shutdown_connections 2023-08-31T02:01:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.400+0000 7fb6b695c700 1 -- 172.21.15.84:0/1447490922 wait complete. 2023-08-31T02:01:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.401+0000 7fb6b695c700 1 Processor -- start 2023-08-31T02:01:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.401+0000 7fb6b695c700 1 -- start start 2023-08-31T02:01:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6b695c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b00cd3f0 0x7fb6b01597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6b695c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b0159320 0x7fb6b00c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6b695c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b015d750 0x7fb6b00b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6b695c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b014eee0 con 0x7fb6b0159320 2023-08-31T02:01:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6b695c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00c4090 con 0x7fb6b015d750 2023-08-31T02:01:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6b695c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00c5a00 con 0x7fb6b00cd3f0 2023-08-31T02:01:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b0159320 0x7fb6b00c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b0159320 0x7fb6b00c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53246/0 (socket says 172.21.15.84:53246) 2023-08-31T02:01:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 -- 172.21.15.84:0/784822268 learned_addr learned my addr 172.21.15.84:0/784822268 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6affff700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b00cd3f0 0x7fb6b01597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6b4ef9700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b015d750 0x7fb6b00b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 -- 172.21.15.84:0/784822268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b00cd3f0 msgr2=0x7fb6b01597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b00cd3f0 0x7fb6b01597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 -- 172.21.15.84:0/784822268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b015d750 msgr2=0x7fb6b00b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b015d750 0x7fb6b00b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 -- 172.21.15.84:0/784822268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8009d00 con 0x7fb6b0159320 2023-08-31T02:01:03.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6af7fe700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b0159320 0x7fb6b00c54c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400d980 tx=0x7fb6a400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.402+0000 7fb6acff9700 1 -- 172.21.15.84:0/784822268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4009b40 con 0x7fb6b0159320 2023-08-31T02:01:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.403+0000 7fb6acff9700 1 -- 172.21.15.84:0/784822268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb6a4009d90 con 0x7fb6b0159320 2023-08-31T02:01:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.403+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b00af390 con 0x7fb6b0159320 2023-08-31T02:01:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.403+0000 7fb6acff9700 1 -- 172.21.15.84:0/784822268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40106c0 con 0x7fb6b0159320 2023-08-31T02:01:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.403+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b006b590 con 0x7fb6b0159320 2023-08-31T02:01:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.404+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b006b3f0 con 0x7fb6b0159320 2023-08-31T02:01:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.404+0000 7fb6acff9700 1 -- 172.21.15.84:0/784822268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb6a4010820 con 0x7fb6b0159320 2023-08-31T02:01:03.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.405+0000 7fb6acff9700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb69c06a0e0 0x7fb69c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.405+0000 7fb6acff9700 1 -- 172.21.15.84:0/784822268 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb6a4089130 con 0x7fb6b0159320 2023-08-31T02:01:03.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.405+0000 7fb6affff700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb69c06a0e0 0x7fb69c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.405+0000 7fb6affff700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb69c06a0e0 0x7fb69c06c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0004f30 tx=0x7fb6a0009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:03.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.409+0000 7fb6acff9700 1 -- 172.21.15.84:0/784822268 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb6a4054590 con 0x7fb6b0159320 2023-08-31T02:01:03.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.595+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6b006b3f0 con 0x7fb6b0159320 2023-08-31T02:01:03.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.595+0000 7fb6acff9700 1 -- 172.21.15.84:0/784822268 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6b006b3f0 con 0x7fb6b0159320 2023-08-31T02:01:03.588 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:01:03.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.597+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb69c06a0e0 msgr2=0x7fb69c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.597+0000 7fb6b695c700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb69c06a0e0 0x7fb69c06c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0004f30 tx=0x7fb6a0009040 comp rx=0 tx=0).stop 2023-08-31T02:01:03.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.597+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b0159320 msgr2=0x7fb6b00c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.597+0000 7fb6b695c700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b0159320 0x7fb6b00c54c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400d980 tx=0x7fb6a400dd40 comp rx=0 tx=0).stop 2023-08-31T02:01:03.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.598+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 shutdown_connections 2023-08-31T02:01:03.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.598+0000 7fb6b695c700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb69c06a0e0 0x7fb69c06c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.598+0000 7fb6b695c700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b015d750 0x7fb6b00b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.598+0000 7fb6b695c700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b00cd3f0 0x7fb6b01597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.598+0000 7fb6b695c700 1 --2- 172.21.15.84:0/784822268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b0159320 0x7fb6b00c54c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.598+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 >> 172.21.15.84:0/784822268 conn(0x7fb6b00b0c40 msgr2=0x7fb6b00b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:03.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.598+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 shutdown_connections 2023-08-31T02:01:03.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.598+0000 7fb6b695c700 1 -- 172.21.15.84:0/784822268 wait complete. 2023-08-31T02:01:03.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:01:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.736+0000 7fea2aa49700 1 -- 172.21.15.84:0/78218648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415b790 msgr2=0x7fea2406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.736+0000 7fea2aa49700 1 --2- 172.21.15.84:0/78218648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415b790 0x7fea2406c720 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fea140098c0 tx=0x7fea14009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.736+0000 7fea2aa49700 1 -- 172.21.15.84:0/78218648 shutdown_connections 2023-08-31T02:01:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.736+0000 7fea2aa49700 1 --2- 172.21.15.84:0/78218648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea240ca2d0 0x7fea240cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.736+0000 7fea2aa49700 1 --2- 172.21.15.84:0/78218648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415b790 0x7fea2406c720 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.736+0000 7fea2aa49700 1 -- 172.21.15.84:0/78218648 >> 172.21.15.84:0/78218648 conn(0x7fea240afb00 msgr2=0x7fea240aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.736+0000 7fea2aa49700 1 -- 172.21.15.84:0/78218648 shutdown_connections 2023-08-31T02:01:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.736+0000 7fea2aa49700 1 -- 172.21.15.84:0/78218648 wait complete. 2023-08-31T02:01:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.737+0000 7fea2aa49700 1 Processor -- start 2023-08-31T02:01:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.738+0000 7fea2aa49700 1 -- start start 2023-08-31T02:01:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.738+0000 7fea2aa49700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea240ca2d0 0x7fea24153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.738+0000 7fea2aa49700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea2415b790 0x7fea241f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.738+0000 7fea2aa49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415bce0 0x7fea241f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea2aa49700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240ab6e0 con 0x7fea2415bce0 2023-08-31T02:01:03.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea2aa49700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea241f2240 con 0x7fea240ca2d0 2023-08-31T02:01:03.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea2aa49700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea241f2520 con 0x7fea2415b790 2023-08-31T02:01:03.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415bce0 0x7fea241f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415bce0 0x7fea241f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53264/0 (socket says 172.21.15.84:53264) 2023-08-31T02:01:03.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 -- 172.21.15.84:0/4226450910 learned_addr learned my addr 172.21.15.84:0/4226450910 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:03.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea237fe700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea2415b790 0x7fea241f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea23fff700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea240ca2d0 0x7fea24153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 -- 172.21.15.84:0/4226450910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea2415b790 msgr2=0x7fea241f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea2415b790 0x7fea241f1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 -- 172.21.15.84:0/4226450910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea240ca2d0 msgr2=0x7fea24153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea240ca2d0 0x7fea24153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 -- 172.21.15.84:0/4226450910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009520 con 0x7fea2415bce0 2023-08-31T02:01:03.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea28fe6700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415bce0 0x7fea241f1c50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00ef30 tx=0x7fea1c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:03.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea20ff9700 1 -- 172.21.15.84:0/4226450910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c018070 con 0x7fea2415bce0 2023-08-31T02:01:03.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea20ff9700 1 -- 172.21.15.84:0/4226450910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea1c00f040 con 0x7fea2415bce0 2023-08-31T02:01:03.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea20ff9700 1 -- 172.21.15.84:0/4226450910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c004bb0 con 0x7fea2415bce0 2023-08-31T02:01:03.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea240ab8f0 con 0x7fea2415bce0 2023-08-31T02:01:03.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.739+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea24153e80 con 0x7fea2415bce0 2023-08-31T02:01:03.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.740+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2404e7c0 con 0x7fea2415bce0 2023-08-31T02:01:03.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.741+0000 7fea20ff9700 1 -- 172.21.15.84:0/4226450910 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea1c004d10 con 0x7fea2415bce0 2023-08-31T02:01:03.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.741+0000 7fea20ff9700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fea0406a0e0 0x7fea0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:03.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.741+0000 7fea20ff9700 1 -- 172.21.15.84:0/4226450910 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fea1c088910 con 0x7fea2415bce0 2023-08-31T02:01:03.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.741+0000 7fea23fff700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fea0406a0e0 0x7fea0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:03.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.741+0000 7fea23fff700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fea0406a0e0 0x7fea0406c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea14009230 tx=0x7fea14019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:03.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.745+0000 7fea20ff9700 1 -- 172.21.15.84:0/4226450910 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fea1c053cf0 con 0x7fea2415bce0 2023-08-31T02:01:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.935+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea240718b0 con 0x7fea2415bce0 2023-08-31T02:01:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.936+0000 7fea20ff9700 1 -- 172.21.15.84:0/4226450910 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea1c005ac0 con 0x7fea2415bce0 2023-08-31T02:01:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:03.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fea0406a0e0 msgr2=0x7fea0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fea0406a0e0 0x7fea0406c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea14009230 tx=0x7fea14019040 comp rx=0 tx=0).stop 2023-08-31T02:01:03.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415bce0 msgr2=0x7fea241f1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:03.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415bce0 0x7fea241f1c50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00ef30 tx=0x7fea1c00c450 comp rx=0 tx=0).stop 2023-08-31T02:01:03.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 shutdown_connections 2023-08-31T02:01:03.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fea0406a0e0 0x7fea0406c5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea2415bce0 0x7fea241f1c50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea240ca2d0 0x7fea24153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 --2- 172.21.15.84:0/4226450910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea2415b790 0x7fea241f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:03.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 >> 172.21.15.84:0/4226450910 conn(0x7fea240afb00 msgr2=0x7fea24159120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:03.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 shutdown_connections 2023-08-31T02:01:03.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:03.938+0000 7fea2aa49700 1 -- 172.21.15.84:0/4226450910 wait complete. 2023-08-31T02:01:03.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:01:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.075+0000 7fc1983e9700 1 -- 172.21.15.84:0/3513469153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 msgr2=0x7fc1900b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.075+0000 7fc1983e9700 1 --2- 172.21.15.84:0/3513469153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 0x7fc1900b0620 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc1900b1ec0 tx=0x7fc18c009ba0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.075+0000 7fc1983e9700 1 -- 172.21.15.84:0/3513469153 shutdown_connections 2023-08-31T02:01:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.075+0000 7fc1983e9700 1 --2- 172.21.15.84:0/3513469153 >> v2:172.21.15.170:3300/0 conn(0x7fc1900b23e0 0x7fc1900b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.075+0000 7fc1983e9700 1 --2- 172.21.15.84:0/3513469153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 0x7fc1900b0620 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.075+0000 7fc1983e9700 1 -- 172.21.15.84:0/3513469153 >> 172.21.15.84:0/3513469153 conn(0x7fc1900afb00 msgr2=0x7fc1900aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.075+0000 7fc1983e9700 1 -- 172.21.15.84:0/3513469153 shutdown_connections 2023-08-31T02:01:04.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.075+0000 7fc1983e9700 1 -- 172.21.15.84:0/3513469153 wait complete. 2023-08-31T02:01:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.076+0000 7fc1983e9700 1 Processor -- start 2023-08-31T02:01:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.076+0000 7fc1983e9700 1 -- start start 2023-08-31T02:01:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc1983e9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc19006db90 0x7fc19015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc1983e9700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1900b23e0 0x7fc1901e32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc1983e9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 0x7fc1901e37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc1983e9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900aa8d0 con 0x7fc1901593b0 2023-08-31T02:01:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc1983e9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901e3e80 con 0x7fc19006db90 2023-08-31T02:01:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc1983e9700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901e4160 con 0x7fc1900b23e0 2023-08-31T02:01:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196986700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 0x7fc1901e37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196986700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 0x7fc1901e37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53276/0 (socket says 172.21.15.84:53276) 2023-08-31T02:01:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196986700 1 -- 172.21.15.84:0/1758407449 learned_addr learned my addr 172.21.15.84:0/1758407449 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc195984700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1900b23e0 0x7fc1901e32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196185700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc19006db90 0x7fc19015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196986700 1 -- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1900b23e0 msgr2=0x7fc1901e32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196986700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1900b23e0 0x7fc1901e32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196986700 1 -- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc19006db90 msgr2=0x7fc19015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196986700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc19006db90 0x7fc19015c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.077+0000 7fc196986700 1 -- 172.21.15.84:0/1758407449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c009520 con 0x7fc1901593b0 2023-08-31T02:01:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.078+0000 7fc196185700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc19006db90 0x7fc19015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.078+0000 7fc196986700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 0x7fc1901e37f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc188007ee0 tx=0x7fc18800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.078+0000 7fc186ffd700 1 -- 172.21.15.84:0/1758407449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188017070 con 0x7fc1901593b0 2023-08-31T02:01:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.078+0000 7fc186ffd700 1 -- 172.21.15.84:0/1758407449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc18800f040 con 0x7fc1901593b0 2023-08-31T02:01:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.078+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1901e4440 con 0x7fc1901593b0 2023-08-31T02:01:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.078+0000 7fc186ffd700 1 -- 172.21.15.84:0/1758407449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800de10 con 0x7fc1901593b0 2023-08-31T02:01:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.078+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19015c7f0 con 0x7fc1901593b0 2023-08-31T02:01:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.079+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc190070450 con 0x7fc1901593b0 2023-08-31T02:01:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.079+0000 7fc186ffd700 1 -- 172.21.15.84:0/1758407449 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc18801c410 con 0x7fc1901593b0 2023-08-31T02:01:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.079+0000 7fc186ffd700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc17406a0e0 0x7fc17406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.080+0000 7fc186ffd700 1 -- 172.21.15.84:0/1758407449 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fc188088410 con 0x7fc1901593b0 2023-08-31T02:01:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.080+0000 7fc196185700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc17406a0e0 0x7fc17406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.080+0000 7fc196185700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc17406a0e0 0x7fc17406c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009fd0 tx=0x7fc18c0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.084+0000 7fc186ffd700 1 -- 172.21.15.84:0/1758407449 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc188053870 con 0x7fc1901593b0 2023-08-31T02:01:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.275+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc19004e7c0 con 0x7fc1901593b0 2023-08-31T02:01:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.275+0000 7fc186ffd700 1 -- 172.21.15.84:0/1758407449 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc18801f110 con 0x7fc1901593b0 2023-08-31T02:01:04.269 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:01:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc17406a0e0 msgr2=0x7fc17406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc17406a0e0 0x7fc17406c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009fd0 tx=0x7fc18c0047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 msgr2=0x7fc1901e37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 0x7fc1901e37f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc188007ee0 tx=0x7fc18800d3b0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 shutdown_connections 2023-08-31T02:01:04.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc17406a0e0 0x7fc17406c5a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1901593b0 0x7fc1901e37f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc19006db90 0x7fc19015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 --2- 172.21.15.84:0/1758407449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1900b23e0 0x7fc1901e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 >> 172.21.15.84:0/1758407449 conn(0x7fc1900afb00 msgr2=0x7fc1900ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 shutdown_connections 2023-08-31T02:01:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.277+0000 7fc1983e9700 1 -- 172.21.15.84:0/1758407449 wait complete. 2023-08-31T02:01:04.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:01:04.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.416+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4118875868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 msgr2=0x7fe5bc0c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.416+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4118875868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 0x7fe5bc0c88e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0b0990 tx=0x7fe5b0009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:04.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.417+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4118875868 shutdown_connections 2023-08-31T02:01:04.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.417+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4118875868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 0x7fe5bc0c88e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.417+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4118875868 >> v2:172.21.15.170:3300/0 conn(0x7fe5bc0ca030 0x7fe5bc0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.417+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4118875868 >> 172.21.15.84:0/4118875868 conn(0x7fe5bc0ca930 msgr2=0x7fe5bc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:04.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.417+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4118875868 shutdown_connections 2023-08-31T02:01:04.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.417+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4118875868 wait complete. 2023-08-31T02:01:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.418+0000 7fe5c0aea700 1 Processor -- start 2023-08-31T02:01:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.418+0000 7fe5c0aea700 1 -- start start 2023-08-31T02:01:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5c0aea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 0x7fe5bc1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5c0aea700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc0c9c00 0x7fe5bc1e1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5c0aea700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5bc0ca030 0x7fe5bc06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5c0aea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc1e1ba0 con 0x7fe5bc0c8500 2023-08-31T02:01:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5c0aea700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc1e18d0 con 0x7fe5bc0ca030 2023-08-31T02:01:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5c0aea700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc144d00 con 0x7fe5bc0c9c00 2023-08-31T02:01:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 0x7fe5bc1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 0x7fe5bc1477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53286/0 (socket says 172.21.15.84:53286) 2023-08-31T02:01:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 -- 172.21.15.84:0/4038628672 learned_addr learned my addr 172.21.15.84:0/4038628672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5bad9d700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5bc0ca030 0x7fe5bc06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5b9d9b700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc0c9c00 0x7fe5bc1e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 -- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc0c9c00 msgr2=0x7fe5bc1e1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc0c9c00 0x7fe5bc1e1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 -- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5bc0ca030 msgr2=0x7fe5bc06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5bc0ca030 0x7fe5bc06d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 -- 172.21.15.84:0/4038628672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b00095f0 con 0x7fe5bc0c8500 2023-08-31T02:01:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5bad9d700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5bc0ca030 0x7fe5bc06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5ba59c700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 0x7fe5bc1477c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00098e0 tx=0x7fe5b000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5aaffd700 1 -- 172.21.15.84:0/4038628672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b001d070 con 0x7fe5bc0c8500 2023-08-31T02:01:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5aaffd700 1 -- 172.21.15.84:0/4038628672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5b0003890 con 0x7fe5bc0c8500 2023-08-31T02:01:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc144fe0 con 0x7fe5bc0c8500 2023-08-31T02:01:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5aaffd700 1 -- 172.21.15.84:0/4038628672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0003c80 con 0x7fe5bc0c8500 2023-08-31T02:01:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.419+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc1455a0 con 0x7fe5bc0c8500 2023-08-31T02:01:04.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.420+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc04e7c0 con 0x7fe5bc0c8500 2023-08-31T02:01:04.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.421+0000 7fe5aaffd700 1 -- 172.21.15.84:0/4038628672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe5b0022470 con 0x7fe5bc0c8500 2023-08-31T02:01:04.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.421+0000 7fe5aaffd700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe59c06a0e0 0x7fe59c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.421+0000 7fe5aaffd700 1 -- 172.21.15.84:0/4038628672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe5b008a0b0 con 0x7fe5bc0c8500 2023-08-31T02:01:04.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.421+0000 7fe5b9d9b700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe59c06a0e0 0x7fe59c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.422+0000 7fe5b9d9b700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe59c06a0e0 0x7fe59c06c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc15b8d0 tx=0x7fe5ac009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.425+0000 7fe5aaffd700 1 -- 172.21.15.84:0/4038628672 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe5b0055490 con 0x7fe5bc0c8500 2023-08-31T02:01:04.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.616+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe5bc158640 con 0x7fe5bc0c8500 2023-08-31T02:01:04.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.617+0000 7fe5aaffd700 1 -- 172.21.15.84:0/4038628672 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe5b0058ab0 con 0x7fe5bc0c8500 2023-08-31T02:01:04.610 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:04.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe59c06a0e0 msgr2=0x7fe59c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe59c06a0e0 0x7fe59c06c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc15b8d0 tx=0x7fe5ac009040 comp rx=0 tx=0).stop 2023-08-31T02:01:04.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 msgr2=0x7fe5bc1477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 0x7fe5bc1477c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00098e0 tx=0x7fe5b000be90 comp rx=0 tx=0).stop 2023-08-31T02:01:04.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 shutdown_connections 2023-08-31T02:01:04.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe59c06a0e0 0x7fe59c06c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5bc0ca030 0x7fe5bc06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc0c8500 0x7fe5bc1477c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 --2- 172.21.15.84:0/4038628672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc0c9c00 0x7fe5bc1e1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 >> 172.21.15.84:0/4038628672 conn(0x7fe5bc0ca930 msgr2=0x7fe5bc0ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:04.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 shutdown_connections 2023-08-31T02:01:04.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.619+0000 7fe5c0aea700 1 -- 172.21.15.84:0/4038628672 wait complete. 2023-08-31T02:01:04.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:01:04.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.755+0000 7f4fb4eef700 1 -- 172.21.15.84:0/3114797758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f98003a30 msgr2=0x7f4f98003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.755+0000 7f4fb4eef700 1 --2- 172.21.15.84:0/3114797758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f98003a30 0x7f4f98003e50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4001730 tx=0x7f4f98005880 comp rx=0 tx=0).stop 2023-08-31T02:01:04.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.755+0000 7f4faed9d700 1 -- 172.21.15.84:0/3114797758 reap_dead start 2023-08-31T02:01:04.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.755+0000 7f4fb4eef700 1 -- 172.21.15.84:0/3114797758 shutdown_connections 2023-08-31T02:01:04.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.755+0000 7f4fb4eef700 1 -- 172.21.15.84:0/3114797758 >> 172.21.15.84:0/3114797758 conn(0x7f4fb0070860 msgr2=0x7f4fb0070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:04.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.755+0000 7f4fb4eef700 1 -- 172.21.15.84:0/3114797758 shutdown_connections 2023-08-31T02:01:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.755+0000 7f4fb4eef700 1 -- 172.21.15.84:0/3114797758 wait complete. 2023-08-31T02:01:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fb4eef700 1 Processor -- start 2023-08-31T02:01:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fb4eef700 1 -- start start 2023-08-31T02:01:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fb4eef700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f98003a30 0x7f4fb0159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fb4eef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb00c6f40 0x7f4fb01552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fb4eef700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb00c59c0 0x7f4fb00c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fb4eef700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00c6380 con 0x7f4fb00c6f40 2023-08-31T02:01:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fb4eef700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb006d350 con 0x7f4fb00c59c0 2023-08-31T02:01:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fb4eef700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0155820 con 0x7f4f98003a30 2023-08-31T02:01:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fadd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb00c6f40 0x7f4fb01552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fadd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb00c6f40 0x7f4fb01552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53308/0 (socket says 172.21.15.84:53308) 2023-08-31T02:01:04.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.757+0000 7f4fadd9b700 1 -- 172.21.15.84:0/369103697 learned_addr learned my addr 172.21.15.84:0/369103697 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:04.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4faed9d700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb00c59c0 0x7f4fb00c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fae59c700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f98003a30 0x7f4fb0159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fadd9b700 1 -- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f98003a30 msgr2=0x7f4fb0159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fadd9b700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f98003a30 0x7f4fb0159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fadd9b700 1 -- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb00c59c0 msgr2=0x7f4fb00c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fadd9b700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb00c59c0 0x7f4fb00c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fadd9b700 1 -- 172.21.15.84:0/369103697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0159be0 con 0x7f4fb00c6f40 2023-08-31T02:01:04.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4faed9d700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb00c59c0 0x7f4fb00c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:04.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fadd9b700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb00c6f40 0x7f4fb01552e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000fa60 tx=0x7f4fa000fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:04.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4f9effd700 1 -- 172.21.15.84:0/369103697 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000bbe0 con 0x7f4fb00c6f40 2023-08-31T02:01:04.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4f9effd700 1 -- 172.21.15.84:0/369103697 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4fa000bd40 con 0x7f4fb00c6f40 2023-08-31T02:01:04.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb0159ec0 con 0x7f4fb00c6f40 2023-08-31T02:01:04.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4f9effd700 1 -- 172.21.15.84:0/369103697 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0011680 con 0x7f4fb00c6f40 2023-08-31T02:01:04.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.758+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb006d5a0 con 0x7f4fb00c6f40 2023-08-31T02:01:04.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.759+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb015a3e0 con 0x7f4fb00c6f40 2023-08-31T02:01:04.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.759+0000 7f4f9effd700 1 -- 172.21.15.84:0/369103697 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4fa00117e0 con 0x7f4fb00c6f40 2023-08-31T02:01:04.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.760+0000 7f4f9effd700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f9006a0e0 0x7f4f9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:04.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.760+0000 7f4f9effd700 1 -- 172.21.15.84:0/369103697 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4fa0089100 con 0x7f4fb00c6f40 2023-08-31T02:01:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.760+0000 7f4fae59c700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f9006a0e0 0x7f4f9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.760+0000 7f4fae59c700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f9006a0e0 0x7f4f9006c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4006040 tx=0x7f4fa4001190 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:04.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.764+0000 7f4f9effd700 1 -- 172.21.15.84:0/369103697 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4fa0054560 con 0x7f4fb00c6f40 2023-08-31T02:01:04.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.970+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4fb004df70 con 0x7f4fb00c6f40 2023-08-31T02:01:04.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.970+0000 7f4f9effd700 1 -- 172.21.15.84:0/369103697 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4fa0057b80 con 0x7f4fb00c6f40 2023-08-31T02:01:04.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.972+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f9006a0e0 msgr2=0x7f4f9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.972+0000 7f4fb4eef700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f9006a0e0 0x7f4f9006c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4006040 tx=0x7f4fa4001190 comp rx=0 tx=0).stop 2023-08-31T02:01:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.972+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb00c6f40 msgr2=0x7f4fb01552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.972+0000 7f4fb4eef700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb00c6f40 0x7f4fb01552e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000fa60 tx=0x7f4fa000fe20 comp rx=0 tx=0).stop 2023-08-31T02:01:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.973+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 shutdown_connections 2023-08-31T02:01:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.973+0000 7f4fb4eef700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f9006a0e0 0x7f4f9006c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.973+0000 7f4fb4eef700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb00c59c0 0x7f4fb00c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.973+0000 7f4fb4eef700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f98003a30 0x7f4fb0159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.973+0000 7f4fb4eef700 1 --2- 172.21.15.84:0/369103697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb00c6f40 0x7f4fb01552e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.973+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 >> 172.21.15.84:0/369103697 conn(0x7f4fb0070860 msgr2=0x7f4fb0157220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.973+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 shutdown_connections 2023-08-31T02:01:04.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:04.973+0000 7f4fb4eef700 1 -- 172.21.15.84:0/369103697 wait complete. 2023-08-31T02:01:04.968 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:01:04.977 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2023-08-31T02:01:04.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:04.978 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-08-31T02:01:05.022 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:01:05.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:01:05.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:05.024 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-31T02:01:05.082 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T02:01:05.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:05.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.214+0000 7f542a7f5700 1 -- 172.21.15.84:0/3444144257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54240707c0 msgr2=0x7f5424070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.214+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3444144257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54240707c0 0x7f5424070bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f541c009f60 tx=0x7f541c009f90 comp rx=0 tx=0).stop 2023-08-31T02:01:05.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.214+0000 7f542a7f5700 1 -- 172.21.15.84:0/3444144257 shutdown_connections 2023-08-31T02:01:05.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.214+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3444144257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5424158220 0x7f54240cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.214+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3444144257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54240707c0 0x7f5424070bf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.214+0000 7f542a7f5700 1 -- 172.21.15.84:0/3444144257 >> 172.21.15.84:0/3444144257 conn(0x7f54240caa20 msgr2=0x7f54240cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:05.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.214+0000 7f542a7f5700 1 -- 172.21.15.84:0/3444144257 shutdown_connections 2023-08-31T02:01:05.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.214+0000 7f542a7f5700 1 -- 172.21.15.84:0/3444144257 wait complete. 2023-08-31T02:01:05.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.215+0000 7f542a7f5700 1 Processor -- start 2023-08-31T02:01:05.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.215+0000 7f542a7f5700 1 -- start start 2023-08-31T02:01:05.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f542a7f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54240707c0 0x7f5424153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f542a7f5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54240b0df0 0x7f54241e1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f542a7f5700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5424158220 0x7f54241f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f542a7f5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424148d00 con 0x7f54240707c0 2023-08-31T02:01:05.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f542a7f5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542414c430 con 0x7f54240b0df0 2023-08-31T02:01:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f542a7f5700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54241e1af0 con 0x7f5424158220 2023-08-31T02:01:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54240707c0 0x7f5424153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54240707c0 0x7f5424153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53320/0 (socket says 172.21.15.84:53320) 2023-08-31T02:01:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5423fff700 1 -- 172.21.15.84:0/3714808176 learned_addr learned my addr 172.21.15.84:0/3714808176 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f54237fe700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54240b0df0 0x7f54241e1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5428d92700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5424158220 0x7f54241f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5423fff700 1 -- 172.21.15.84:0/3714808176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5424158220 msgr2=0x7f54241f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5423fff700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5424158220 0x7f54241f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5423fff700 1 -- 172.21.15.84:0/3714808176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54240b0df0 msgr2=0x7f54241e1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5423fff700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54240b0df0 0x7f54241e1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.216+0000 7f5423fff700 1 -- 172.21.15.84:0/3714808176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009520 con 0x7f54240707c0 2023-08-31T02:01:05.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.217+0000 7f5423fff700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54240707c0 0x7f5424153680 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f541800e9f0 tx=0x7f541800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:05.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.217+0000 7f5420ff9700 1 -- 172.21.15.84:0/3714808176 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800cbd0 con 0x7f54240707c0 2023-08-31T02:01:05.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.217+0000 7f5420ff9700 1 -- 172.21.15.84:0/3714808176 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f541800cd30 con 0x7f54240707c0 2023-08-31T02:01:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.217+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c009c40 con 0x7f54240707c0 2023-08-31T02:01:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.217+0000 7f5420ff9700 1 -- 172.21.15.84:0/3714808176 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800cee0 con 0x7f54240707c0 2023-08-31T02:01:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.217+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54241e20b0 con 0x7f54240707c0 2023-08-31T02:01:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.218+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542404e7c0 con 0x7f54240707c0 2023-08-31T02:01:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.218+0000 7f5420ff9700 1 -- 172.21.15.84:0/3714808176 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5418004280 con 0x7f54240707c0 2023-08-31T02:01:05.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.219+0000 7f5420ff9700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f541006a0e0 0x7f541006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.219+0000 7f5420ff9700 1 -- 172.21.15.84:0/3714808176 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f5418014070 con 0x7f54240707c0 2023-08-31T02:01:05.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.219+0000 7f54237fe700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f541006a0e0 0x7f541006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.219+0000 7f54237fe700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f541006a0e0 0x7f541006c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f54240cd240 tx=0x7f5414007ee0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:05.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.222+0000 7f5420ff9700 1 -- 172.21.15.84:0/3714808176 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5418058150 con 0x7f54240707c0 2023-08-31T02:01:05.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.455+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54240cbea0 con 0x7f54240707c0 2023-08-31T02:01:05.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.455+0000 7f5420ff9700 1 -- 172.21.15.84:0/3714808176 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f5418004530 con 0x7f54240707c0 2023-08-31T02:01:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:05.449 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:16.191493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T02:01:05.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f541006a0e0 msgr2=0x7f541006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f541006a0e0 0x7f541006c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f54240cd240 tx=0x7f5414007ee0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54240707c0 msgr2=0x7f5424153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54240707c0 0x7f5424153680 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f541800e9f0 tx=0x7f541800ed00 comp rx=0 tx=0).stop 2023-08-31T02:01:05.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 shutdown_connections 2023-08-31T02:01:05.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f541006a0e0 0x7f541006c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5424158220 0x7f54241f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54240707c0 0x7f5424153680 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 --2- 172.21.15.84:0/3714808176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54240b0df0 0x7f54241e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.457+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 >> 172.21.15.84:0/3714808176 conn(0x7f54240caa20 msgr2=0x7f542415a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.458+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 shutdown_connections 2023-08-31T02:01:05.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.458+0000 7f542a7f5700 1 -- 172.21.15.84:0/3714808176 wait complete. 2023-08-31T02:01:05.453 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-08-31T02:01:05.463 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:05.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.594+0000 7ff78be85700 1 -- 172.21.15.84:0/275971763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff770004850 msgr2=0x7ff770004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.594+0000 7ff78be85700 1 --2- 172.21.15.84:0/275971763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff770004850 0x7ff770004cd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff780009be0 tx=0x7ff770005880 comp rx=0 tx=0).stop 2023-08-31T02:01:05.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.594+0000 7ff78a422700 1 -- 172.21.15.84:0/275971763 reap_dead start 2023-08-31T02:01:05.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.594+0000 7ff78be85700 1 -- 172.21.15.84:0/275971763 shutdown_connections 2023-08-31T02:01:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.594+0000 7ff78be85700 1 -- 172.21.15.84:0/275971763 >> 172.21.15.84:0/275971763 conn(0x7ff78406fca0 msgr2=0x7ff7840cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.594+0000 7ff78be85700 1 -- 172.21.15.84:0/275971763 shutdown_connections 2023-08-31T02:01:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.594+0000 7ff78be85700 1 -- 172.21.15.84:0/275971763 wait complete. 2023-08-31T02:01:05.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.595+0000 7ff78be85700 1 Processor -- start 2023-08-31T02:01:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.595+0000 7ff78be85700 1 -- start start 2023-08-31T02:01:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff78be85700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff770004850 0x7ff7841ef000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff78be85700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff78415c380 0x7ff7840c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff78be85700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff78415c800 0x7ff7840c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff78be85700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840c7250 con 0x7ff78415c380 2023-08-31T02:01:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff78be85700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff784148030 con 0x7ff770004850 2023-08-31T02:01:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff78be85700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7841ef540 con 0x7ff78415c800 2023-08-31T02:01:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff78415c380 0x7ff7840c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff78415c380 0x7ff7840c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53342/0 (socket says 172.21.15.84:53342) 2023-08-31T02:01:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 -- 172.21.15.84:0/306534036 learned_addr learned my addr 172.21.15.84:0/306534036 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789c21700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff770004850 0x7ff7841ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff78a422700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff78415c800 0x7ff7840c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 -- 172.21.15.84:0/306534036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff78415c800 msgr2=0x7ff7840c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff78415c800 0x7ff7840c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 -- 172.21.15.84:0/306534036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff770004850 msgr2=0x7ff7841ef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff770004850 0x7ff7841ef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 -- 172.21.15.84:0/306534036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7840c3a50 con 0x7ff78415c380 2023-08-31T02:01:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.596+0000 7ff789420700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff78415c380 0x7ff7840c4c40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff780009230 tx=0x7ff780005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.597+0000 7ff77a7fc700 1 -- 172.21.15.84:0/306534036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000eb00 con 0x7ff78415c380 2023-08-31T02:01:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.597+0000 7ff77a7fc700 1 -- 172.21.15.84:0/306534036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff780003680 con 0x7ff78415c380 2023-08-31T02:01:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.597+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7840c3d30 con 0x7ff78415c380 2023-08-31T02:01:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.597+0000 7ff77a7fc700 1 -- 172.21.15.84:0/306534036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780003a50 con 0x7ff78415c380 2023-08-31T02:01:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.597+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7840c42f0 con 0x7ff78415c380 2023-08-31T02:01:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.598+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7840c74f0 con 0x7ff78415c380 2023-08-31T02:01:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.598+0000 7ff77a7fc700 1 -- 172.21.15.84:0/306534036 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff780003bb0 con 0x7ff78415c380 2023-08-31T02:01:05.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.598+0000 7ff77a7fc700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff76806a0e0 0x7ff76806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.599+0000 7ff77a7fc700 1 -- 172.21.15.84:0/306534036 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ff780014070 con 0x7ff78415c380 2023-08-31T02:01:05.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.599+0000 7ff789c21700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff76806a0e0 0x7ff76806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.599+0000 7ff789c21700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff76806a0e0 0x7ff76806c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e00 tx=0x7ff774009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:05.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.603+0000 7ff77a7fc700 1 -- 172.21.15.84:0/306534036 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff7800557a0 con 0x7ff78415c380 2023-08-31T02:01:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.793+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7840c4480 con 0x7ff78415c380 2023-08-31T02:01:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.794+0000 7ff77a7fc700 1 -- 172.21.15.84:0/306534036 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7ff780005b40 con 0x7ff78415c380 2023-08-31T02:01:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:05.788 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff76806a0e0 msgr2=0x7ff76806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff76806a0e0 0x7ff76806c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e00 tx=0x7ff774009260 comp rx=0 tx=0).stop 2023-08-31T02:01:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff78415c380 msgr2=0x7ff7840c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff78415c380 0x7ff7840c4c40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff780009230 tx=0x7ff780005dc0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 shutdown_connections 2023-08-31T02:01:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff76806a0e0 0x7ff76806c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff78415c800 0x7ff7840c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff770004850 0x7ff7841ef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 --2- 172.21.15.84:0/306534036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff78415c380 0x7ff7840c4c40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 >> 172.21.15.84:0/306534036 conn(0x7ff78406fca0 msgr2=0x7ff7840b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 shutdown_connections 2023-08-31T02:01:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.797+0000 7ff78be85700 1 -- 172.21.15.84:0/306534036 wait complete. 2023-08-31T02:01:05.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T01:59:56.419467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T01:59:57.485752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T02:00:01.174373+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T02:01:05.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:01:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.935+0000 7fa8899e0700 1 -- 172.21.15.84:0/910604129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cba20 msgr2=0x7fa88406a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.935+0000 7fa8899e0700 1 --2- 172.21.15.84:0/910604129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cba20 0x7fa88406a0b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa8740098c0 tx=0x7fa874009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.935+0000 7fa8899e0700 1 -- 172.21.15.84:0/910604129 shutdown_connections 2023-08-31T02:01:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.935+0000 7fa8899e0700 1 --2- 172.21.15.84:0/910604129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cba20 0x7fa88406a0b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.935+0000 7fa8899e0700 1 -- 172.21.15.84:0/910604129 >> 172.21.15.84:0/910604129 conn(0x7fa8840d11c0 msgr2=0x7fa8840d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.935+0000 7fa8899e0700 1 -- 172.21.15.84:0/910604129 shutdown_connections 2023-08-31T02:01:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.935+0000 7fa8899e0700 1 -- 172.21.15.84:0/910604129 wait complete. 2023-08-31T02:01:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.937+0000 7fa8899e0700 1 Processor -- start 2023-08-31T02:01:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.937+0000 7fa8899e0700 1 -- start start 2023-08-31T02:01:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.937+0000 7fa8899e0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8840cba20 0x7fa8841494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.937+0000 7fa8899e0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cfcc0 0x7fa8840c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.937+0000 7fa8899e0700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88415eac0 0x7fa8840c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.937+0000 7fa8899e0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840ca840 con 0x7fa8840cfcc0 2023-08-31T02:01:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.937+0000 7fa8899e0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840c8290 con 0x7fa8840cba20 2023-08-31T02:01:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.937+0000 7fa8899e0700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840ca560 con 0x7fa88415eac0 2023-08-31T02:01:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cfcc0 0x7fa8840c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cfcc0 0x7fa8840c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53354/0 (socket says 172.21.15.84:53354) 2023-08-31T02:01:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 -- 172.21.15.84:0/3404068363 learned_addr learned my addr 172.21.15.84:0/3404068363 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa882ffd700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8840cba20 0x7fa8841494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8837fe700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88415eac0 0x7fa8840c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 -- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88415eac0 msgr2=0x7fa8840c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88415eac0 0x7fa8840c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 -- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8840cba20 msgr2=0x7fa8841494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8840cba20 0x7fa8841494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 -- 172.21.15.84:0/3404068363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009520 con 0x7fa8840cfcc0 2023-08-31T02:01:05.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa882ffd700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8840cba20 0x7fa8841494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:05.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8827fc700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cfcc0 0x7fa8840c9c30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa874004000 tx=0x7fa874003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa86bfff700 1 -- 172.21.15.84:0/3404068363 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87401d070 con 0x7fa8840cfcc0 2023-08-31T02:01:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa86bfff700 1 -- 172.21.15.84:0/3404068363 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa87400b970 con 0x7fa8840cfcc0 2023-08-31T02:01:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8840c84e0 con 0x7fa8840cfcc0 2023-08-31T02:01:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa86bfff700 1 -- 172.21.15.84:0/3404068363 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400bd80 con 0x7fa8840cfcc0 2023-08-31T02:01:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.938+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8840c8aa0 con 0x7fa8840cfcc0 2023-08-31T02:01:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.939+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88404e7c0 con 0x7fa8840cfcc0 2023-08-31T02:01:05.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.940+0000 7fa86bfff700 1 -- 172.21.15.84:0/3404068363 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa87400f460 con 0x7fa8840cfcc0 2023-08-31T02:01:05.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.940+0000 7fa86bfff700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87006a0e0 0x7fa87006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:05.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.940+0000 7fa86bfff700 1 -- 172.21.15.84:0/3404068363 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa874089d40 con 0x7fa8840cfcc0 2023-08-31T02:01:05.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.940+0000 7fa882ffd700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87006a0e0 0x7fa87006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:05.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.940+0000 7fa882ffd700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87006a0e0 0x7fa87006c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa878000f60 tx=0x7fa878009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:05.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:05.944+0000 7fa86bfff700 1 -- 172.21.15.84:0/3404068363 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa874055120 con 0x7fa8840cfcc0 2023-08-31T02:01:06.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.132+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa88406c720 con 0x7fa8840cfcc0 2023-08-31T02:01:06.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.133+0000 7fa86bfff700 1 -- 172.21.15.84:0/3404068363 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa874058740 con 0x7fa8840cfcc0 2023-08-31T02:01:06.126 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:01:06.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.134+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87006a0e0 msgr2=0x7fa87006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.134+0000 7fa8899e0700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87006a0e0 0x7fa87006c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa878000f60 tx=0x7fa878009040 comp rx=0 tx=0).stop 2023-08-31T02:01:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.134+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cfcc0 msgr2=0x7fa8840c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.134+0000 7fa8899e0700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cfcc0 0x7fa8840c9c30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa874004000 tx=0x7fa874003eb0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.135+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 shutdown_connections 2023-08-31T02:01:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.135+0000 7fa8899e0700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa87006a0e0 0x7fa87006c5a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.135+0000 7fa8899e0700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88415eac0 0x7fa8840c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.135+0000 7fa8899e0700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8840cba20 0x7fa8841494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.135+0000 7fa8899e0700 1 --2- 172.21.15.84:0/3404068363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8840cfcc0 0x7fa8840c9c30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.135+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 >> 172.21.15.84:0/3404068363 conn(0x7fa8840d11c0 msgr2=0x7fa88415a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.135+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 shutdown_connections 2023-08-31T02:01:06.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.135+0000 7fa8899e0700 1 -- 172.21.15.84:0/3404068363 wait complete. 2023-08-31T02:01:06.139 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:01:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.271+0000 7fb0e2672700 1 -- 172.21.15.84:0/2954748885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0cd380 msgr2=0x7fb0dc159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.271+0000 7fb0e2672700 1 --2- 172.21.15.84:0/2954748885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0cd380 0x7fb0dc159140 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0cb570 tx=0x7fb0cc009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.271+0000 7fb0e2672700 1 -- 172.21.15.84:0/2954748885 shutdown_connections 2023-08-31T02:01:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.271+0000 7fb0e2672700 1 --2- 172.21.15.84:0/2954748885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0cd380 0x7fb0dc159140 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.271+0000 7fb0e2672700 1 --2- 172.21.15.84:0/2954748885 >> v2:172.21.15.170:3300/0 conn(0x7fb0dc15c930 0x7fb0dc0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.271+0000 7fb0e2672700 1 -- 172.21.15.84:0/2954748885 >> 172.21.15.84:0/2954748885 conn(0x7fb0dc0ca930 msgr2=0x7fb0dc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.271+0000 7fb0e2672700 1 -- 172.21.15.84:0/2954748885 shutdown_connections 2023-08-31T02:01:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.271+0000 7fb0e2672700 1 -- 172.21.15.84:0/2954748885 wait complete. 2023-08-31T02:01:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.272+0000 7fb0e2672700 1 Processor -- start 2023-08-31T02:01:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.272+0000 7fb0e2672700 1 -- start start 2023-08-31T02:01:06.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e2672700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0c9ef0 0x7fb0dc14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e2672700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0dc0cd380 0x7fb0dc06b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e2672700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0dc15c930 0x7fb0dc1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e2672700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc152d80 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e2672700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc14fc30 con 0x7fb0dc0cd380 2023-08-31T02:01:06.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e2672700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc1f25c0 con 0x7fb0dc15c930 2023-08-31T02:01:06.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0c9ef0 0x7fb0dc14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0c9ef0 0x7fb0dc14f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53368/0 (socket says 172.21.15.84:53368) 2023-08-31T02:01:06.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 -- 172.21.15.84:0/4126948923 learned_addr learned my addr 172.21.15.84:0/4126948923 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0db7fe700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0dc0cd380 0x7fb0dc06b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e0c0f700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0dc15c930 0x7fb0dc1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 -- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0dc15c930 msgr2=0x7fb0dc1502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0dc15c930 0x7fb0dc1502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 -- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0dc0cd380 msgr2=0x7fb0dc06b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0dc0cd380 0x7fb0dc06b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 -- 172.21.15.84:0/4126948923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0095f0 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e0c0f700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0dc15c930 0x7fb0dc1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0dbfff700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0c9ef0 0x7fb0dc14f6f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0098e0 tx=0x7fb0cc00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0d8ff9700 1 -- 172.21.15.84:0/4126948923 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc01d070 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0d8ff9700 1 -- 172.21.15.84:0/4126948923 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb0cc003890 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc1f28a0 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.273+0000 7fb0d8ff9700 1 -- 172.21.15.84:0/4126948923 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc003c80 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.274+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc1f2e60 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.275+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc1f2ff0 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.275+0000 7fb0d8ff9700 1 -- 172.21.15.84:0/4126948923 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb0cc00f460 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.275+0000 7fb0d8ff9700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb0c806a0e0 0x7fb0c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.275+0000 7fb0d8ff9700 1 -- 172.21.15.84:0/4126948923 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb0cc08a050 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.276+0000 7fb0db7fe700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb0c806a0e0 0x7fb0c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.276+0000 7fb0db7fe700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb0c806a0e0 0x7fb0c806c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0005950 tx=0x7fb0d00058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.280+0000 7fb0d8ff9700 1 -- 172.21.15.84:0/4126948923 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb0cc0555d0 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.468+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0dc04e7c0 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.468+0000 7fb0d8ff9700 1 -- 172.21.15.84:0/4126948923 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0cc0270a0 con 0x7fb0dc0c9ef0 2023-08-31T02:01:06.462 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:06.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb0c806a0e0 msgr2=0x7fb0c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb0c806a0e0 0x7fb0c806c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0005950 tx=0x7fb0d00058e0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0c9ef0 msgr2=0x7fb0dc14f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0c9ef0 0x7fb0dc14f6f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0098e0 tx=0x7fb0cc00beb0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 shutdown_connections 2023-08-31T02:01:06.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb0c806a0e0 0x7fb0c806c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0dc15c930 0x7fb0dc1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0dc0c9ef0 0x7fb0dc14f6f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 --2- 172.21.15.84:0/4126948923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0dc0cd380 0x7fb0dc06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.470+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 >> 172.21.15.84:0/4126948923 conn(0x7fb0dc0ca930 msgr2=0x7fb0dc0af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.471+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 shutdown_connections 2023-08-31T02:01:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.471+0000 7fb0e2672700 1 -- 172.21.15.84:0/4126948923 wait complete. 2023-08-31T02:01:06.476 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:01:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.609+0000 7f7415130700 1 -- 172.21.15.84:0/4238333723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 msgr2=0x7f74100b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.610+0000 7f7415130700 1 --2- 172.21.15.84:0/4238333723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 0x7f74100b27f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7410072430 tx=0x7f740800b330 comp rx=0 tx=0).stop 2023-08-31T02:01:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.610+0000 7f7415130700 1 -- 172.21.15.84:0/4238333723 shutdown_connections 2023-08-31T02:01:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.610+0000 7f7415130700 1 --2- 172.21.15.84:0/4238333723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 0x7f74100b27f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.610+0000 7f7415130700 1 --2- 172.21.15.84:0/4238333723 >> v2:172.21.15.170:3300/0 conn(0x7f741006db90 0x7f74100b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.610+0000 7f7415130700 1 -- 172.21.15.84:0/4238333723 >> 172.21.15.84:0/4238333723 conn(0x7f74100afb00 msgr2=0x7f74100aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.610+0000 7f7415130700 1 -- 172.21.15.84:0/4238333723 shutdown_connections 2023-08-31T02:01:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.610+0000 7f7415130700 1 -- 172.21.15.84:0/4238333723 wait complete. 2023-08-31T02:01:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.611+0000 7f7415130700 1 Processor -- start 2023-08-31T02:01:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.612+0000 7f7415130700 1 -- start start 2023-08-31T02:01:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.612+0000 7f7415130700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f741006db90 0x7f741006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.612+0000 7f7415130700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 0x7f7410157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.612+0000 7f7415130700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74101593b0 0x7f74100b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.612+0000 7f7415130700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741006ac40 con 0x7f74100b23e0 2023-08-31T02:01:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.612+0000 7f7415130700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741006af20 con 0x7f74101593b0 2023-08-31T02:01:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.612+0000 7f7415130700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741006b200 con 0x7f741006db90 2023-08-31T02:01:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 0x7f7410157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 0x7f7410157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53382/0 (socket says 172.21.15.84:53382) 2023-08-31T02:01:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 -- 172.21.15.84:0/2154806309 learned_addr learned my addr 172.21.15.84:0/2154806309 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740ed9d700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f741006db90 0x7f741006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740f59e700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74101593b0 0x7f74100b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 -- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f741006db90 msgr2=0x7f741006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f741006db90 0x7f741006bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 -- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74101593b0 msgr2=0x7f74100b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74101593b0 0x7f74100b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 -- 172.21.15.84:0/2154806309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408009c40 con 0x7f74100b23e0 2023-08-31T02:01:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740ed9d700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f741006db90 0x7f741006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740f59e700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74101593b0 0x7f74100b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f740e59c700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 0x7f7410157d30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f740400c920 tx=0x7f740400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f73f77fe700 1 -- 172.21.15.84:0/2154806309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404007b00 con 0x7f74100b23e0 2023-08-31T02:01:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f73f77fe700 1 -- 172.21.15.84:0/2154806309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7404007d50 con 0x7f74100b23e0 2023-08-31T02:01:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741006b4e0 con 0x7f74100b23e0 2023-08-31T02:01:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f73f77fe700 1 -- 172.21.15.84:0/2154806309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404004a90 con 0x7f74100b23e0 2023-08-31T02:01:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.613+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741006baa0 con 0x7f74100b23e0 2023-08-31T02:01:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.614+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7410070450 con 0x7f74100b23e0 2023-08-31T02:01:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.615+0000 7f73f77fe700 1 -- 172.21.15.84:0/2154806309 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7404004bf0 con 0x7f74100b23e0 2023-08-31T02:01:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.615+0000 7f73f77fe700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.615+0000 7f73f77fe700 1 -- 172.21.15.84:0/2154806309 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7404088f60 con 0x7f74100b23e0 2023-08-31T02:01:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.615+0000 7f740ed9d700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.616+0000 7f740ed9d700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7400000f60 tx=0x7f7400009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.619+0000 7f73f77fe700 1 -- 172.21.15.84:0/2154806309 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f74040544a0 con 0x7f74100b23e0 2023-08-31T02:01:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.808+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f741006bc90 con 0x7f74100b23e0 2023-08-31T02:01:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.808+0000 7f73f77fe700 1 -- 172.21.15.84:0/2154806309 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f740401d020 con 0x7f74100b23e0 2023-08-31T02:01:06.801 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:01:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f73fc06a0e0 msgr2=0x7f73fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7400000f60 tx=0x7f7400009040 comp rx=0 tx=0).stop 2023-08-31T02:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 msgr2=0x7f7410157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 0x7f7410157d30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f740400c920 tx=0x7f740400cce0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 shutdown_connections 2023-08-31T02:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f73fc06a0e0 0x7f73fc06c5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74101593b0 0x7f74100b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f741006db90 0x7f741006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 --2- 172.21.15.84:0/2154806309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100b23e0 0x7f7410157d30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 >> 172.21.15.84:0/2154806309 conn(0x7f74100afb00 msgr2=0x7f74100c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 shutdown_connections 2023-08-31T02:01:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.810+0000 7f7415130700 1 -- 172.21.15.84:0/2154806309 wait complete. 2023-08-31T02:01:06.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T02:01:06.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.949+0000 7fddffb49700 1 -- 172.21.15.84:0/440443809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdde4004850 msgr2=0x7fdde4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.949+0000 7fddffb49700 1 --2- 172.21.15.84:0/440443809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdde4004850 0x7fdde4004cd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c310 tx=0x7fdde4005880 comp rx=0 tx=0).stop 2023-08-31T02:01:06.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.949+0000 7fddffb49700 1 -- 172.21.15.84:0/440443809 shutdown_connections 2023-08-31T02:01:06.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.949+0000 7fddffb49700 1 --2- 172.21.15.84:0/440443809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdde4004850 0x7fdde4004cd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.949+0000 7fddffb49700 1 -- 172.21.15.84:0/440443809 >> 172.21.15.84:0/440443809 conn(0x7fddf80afb00 msgr2=0x7fddf80aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:06.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.949+0000 7fddffb49700 1 -- 172.21.15.84:0/440443809 shutdown_connections 2023-08-31T02:01:06.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.949+0000 7fddffb49700 1 -- 172.21.15.84:0/440443809 wait complete. 2023-08-31T02:01:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.951+0000 7fddffb49700 1 Processor -- start 2023-08-31T02:01:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.951+0000 7fddffb49700 1 -- start start 2023-08-31T02:01:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddffb49700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdde4004850 0x7fddf814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddffb49700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80c5520 0x7fddf80c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddffb49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf80c7110 0x7fddf806a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddffb49700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c7720 con 0x7fddf80c7110 2023-08-31T02:01:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddffb49700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c7a00 con 0x7fddf80c5520 2023-08-31T02:01:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddffb49700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c7ce0 con 0x7fdde4004850 2023-08-31T02:01:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf80c7110 0x7fddf806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf80c7110 0x7fddf806a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53404/0 (socket says 172.21.15.84:53404) 2023-08-31T02:01:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 -- 172.21.15.84:0/2975088397 learned_addr learned my addr 172.21.15.84:0/2975088397 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfd8e5700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdde4004850 0x7fddf814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfd0e4700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80c5520 0x7fddf80c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 -- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdde4004850 msgr2=0x7fddf814c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdde4004850 0x7fddf814c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 -- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80c5520 msgr2=0x7fddf80c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80c5520 0x7fddf80c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 -- 172.21.15.84:0/2975088397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80c7fc0 con 0x7fddf80c7110 2023-08-31T02:01:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfd0e4700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80c5520 0x7fddf80c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddfe0e6700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf80c7110 0x7fddf806a230 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fddf80702a0 tx=0x7fddf0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddee7fc700 1 -- 172.21.15.84:0/2975088397 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000e050 con 0x7fddf80c7110 2023-08-31T02:01:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddee7fc700 1 -- 172.21.15.84:0/2975088397 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fddf000f040 con 0x7fddf80c7110 2023-08-31T02:01:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf806a770 con 0x7fddf80c7110 2023-08-31T02:01:06.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.952+0000 7fddee7fc700 1 -- 172.21.15.84:0/2975088397 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0003e80 con 0x7fddf80c7110 2023-08-31T02:01:06.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.953+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80c23e0 con 0x7fddf80c7110 2023-08-31T02:01:06.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.953+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf806ac00 con 0x7fddf80c7110 2023-08-31T02:01:06.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.954+0000 7fddee7fc700 1 -- 172.21.15.84:0/2975088397 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fddf00109f0 con 0x7fddf80c7110 2023-08-31T02:01:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.954+0000 7fddee7fc700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdddc06a0e0 0x7fdddc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.954+0000 7fddee7fc700 1 -- 172.21.15.84:0/2975088397 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fddf0088fb0 con 0x7fddf80c7110 2023-08-31T02:01:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.954+0000 7fddfd8e5700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdddc06a0e0 0x7fdddc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.955+0000 7fddfd8e5700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdddc06a0e0 0x7fdddc06c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdde8000c00 tx=0x7fdde8006f40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:06.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:06.959+0000 7fddee7fc700 1 -- 172.21.15.84:0/2975088397 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fddf0054380 con 0x7fddf80c7110 2023-08-31T02:01:07.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.152+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fddf804e7c0 con 0x7fddf80c7110 2023-08-31T02:01:07.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.152+0000 7fddee7fc700 1 -- 172.21.15.84:0/2975088397 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fddf0013340 con 0x7fddf80c7110 2023-08-31T02:01:07.146 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:07.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdddc06a0e0 msgr2=0x7fdddc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdddc06a0e0 0x7fdddc06c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdde8000c00 tx=0x7fdde8006f40 comp rx=0 tx=0).stop 2023-08-31T02:01:07.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf80c7110 msgr2=0x7fddf806a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf80c7110 0x7fddf806a230 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fddf80702a0 tx=0x7fddf0007ea0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 shutdown_connections 2023-08-31T02:01:07.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdddc06a0e0 0x7fdddc06c5a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf80c7110 0x7fddf806a230 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdde4004850 0x7fddf814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 --2- 172.21.15.84:0/2975088397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80c5520 0x7fddf80c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 >> 172.21.15.84:0/2975088397 conn(0x7fddf80afb00 msgr2=0x7fddf814cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:07.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 shutdown_connections 2023-08-31T02:01:07.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.155+0000 7fddffb49700 1 -- 172.21.15.84:0/2975088397 wait complete. 2023-08-31T02:01:07.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:07.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.291+0000 7fb9ce563700 1 -- 172.21.15.84:0/1794274987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c80707c0 msgr2=0x7fb9c8070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.291+0000 7fb9ce563700 1 --2- 172.21.15.84:0/1794274987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c80707c0 0x7fb9c8070ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80c5000 tx=0x7fb9c000b380 comp rx=0 tx=0).stop 2023-08-31T02:01:07.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.291+0000 7fb9ce563700 1 -- 172.21.15.84:0/1794274987 shutdown_connections 2023-08-31T02:01:07.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.291+0000 7fb9ce563700 1 --2- 172.21.15.84:0/1794274987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c80707c0 0x7fb9c8070ba0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.291+0000 7fb9ce563700 1 --2- 172.21.15.84:0/1794274987 >> v2:172.21.15.170:3300/0 conn(0x7fb9c80cc920 0x7fb9c80c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.291+0000 7fb9ce563700 1 -- 172.21.15.84:0/1794274987 >> 172.21.15.84:0/1794274987 conn(0x7fb9c80caa20 msgr2=0x7fb9c80cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:07.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.292+0000 7fb9ce563700 1 -- 172.21.15.84:0/1794274987 shutdown_connections 2023-08-31T02:01:07.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.292+0000 7fb9ce563700 1 -- 172.21.15.84:0/1794274987 wait complete. 2023-08-31T02:01:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.293+0000 7fb9ce563700 1 Processor -- start 2023-08-31T02:01:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.293+0000 7fb9ce563700 1 -- start start 2023-08-31T02:01:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ce563700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9c80707c0 0x7fb9c8150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ce563700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9c80cc920 0x7fb9c80c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ce563700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c8158220 0x7fb9c80c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ce563700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c81eff00 con 0x7fb9c8158220 2023-08-31T02:01:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ce563700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8155430 con 0x7fb9c80707c0 2023-08-31T02:01:07.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ce563700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8155710 con 0x7fb9c80cc920 2023-08-31T02:01:07.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c8158220 0x7fb9c80c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:07.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c8158220 0x7fb9c80c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53418/0 (socket says 172.21.15.84:53418) 2023-08-31T02:01:07.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 -- 172.21.15.84:0/2415902195 learned_addr learned my addr 172.21.15.84:0/2415902195 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9c77fe700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9c80cc920 0x7fb9c80c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9c7fff700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9c80707c0 0x7fb9c8150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 -- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9c80cc920 msgr2=0x7fb9c80c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9c80cc920 0x7fb9c80c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 -- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9c80707c0 msgr2=0x7fb9c8150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9c80707c0 0x7fb9c8150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 -- 172.21.15.84:0/2415902195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0009d00 con 0x7fb9c8158220 2023-08-31T02:01:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9c7fff700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9c80707c0 0x7fb9c8150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9c77fe700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9c80cc920 0x7fb9c80c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ccb00700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c8158220 0x7fb9c80c41e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80cb860 tx=0x7fb9c0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9c4ff9700 1 -- 172.21.15.84:0/2415902195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000e040 con 0x7fb9c8158220 2023-08-31T02:01:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9c4ff9700 1 -- 172.21.15.84:0/2415902195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb9c001d690 con 0x7fb9c8158220 2023-08-31T02:01:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c81efb90 con 0x7fb9c8158220 2023-08-31T02:01:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9c4ff9700 1 -- 172.21.15.84:0/2415902195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c001daa0 con 0x7fb9c8158220 2023-08-31T02:01:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.294+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c8150ba0 con 0x7fb9c8158220 2023-08-31T02:01:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.295+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c806bb50 con 0x7fb9c8158220 2023-08-31T02:01:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.296+0000 7fb9c4ff9700 1 -- 172.21.15.84:0/2415902195 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb9c001dc00 con 0x7fb9c8158220 2023-08-31T02:01:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.296+0000 7fb9c4ff9700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb9b406a0e0 0x7fb9b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.296+0000 7fb9c4ff9700 1 -- 172.21.15.84:0/2415902195 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb9c008aa80 con 0x7fb9c8158220 2023-08-31T02:01:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.296+0000 7fb9c7fff700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb9b406a0e0 0x7fb9b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.296+0000 7fb9c7fff700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb9b406a0e0 0x7fb9b406c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0016e0 tx=0x7fb9bc009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:07.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.300+0000 7fb9c4ff9700 1 -- 172.21.15.84:0/2415902195 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb9c0055f10 con 0x7fb9c8158220 2023-08-31T02:01:07.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.536+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9c804e7c0 con 0x7fb9c8158220 2023-08-31T02:01:07.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.536+0000 7fb9c4ff9700 1 -- 172.21.15.84:0/2415902195 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fb9c0059530 con 0x7fb9c8158220 2023-08-31T02:01:07.529 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:07.530 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:16.191493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T02:01:07.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb9b406a0e0 msgr2=0x7fb9b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb9b406a0e0 0x7fb9b406c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0016e0 tx=0x7fb9bc009040 comp rx=0 tx=0).stop 2023-08-31T02:01:07.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c8158220 msgr2=0x7fb9c80c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c8158220 0x7fb9c80c41e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80cb860 tx=0x7fb9c0009c30 comp rx=0 tx=0).stop 2023-08-31T02:01:07.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 shutdown_connections 2023-08-31T02:01:07.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb9b406a0e0 0x7fb9b406c5a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9c8158220 0x7fb9c80c41e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9c80707c0 0x7fb9c8150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 --2- 172.21.15.84:0/2415902195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9c80cc920 0x7fb9c80c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 >> 172.21.15.84:0/2415902195 conn(0x7fb9c80caa20 msgr2=0x7fb9c806a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:07.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 shutdown_connections 2023-08-31T02:01:07.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.539+0000 7fb9ce563700 1 -- 172.21.15.84:0/2415902195 wait complete. 2023-08-31T02:01:07.534 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-08-31T02:01:07.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:07.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.673+0000 7f09f1a3d700 1 -- 172.21.15.84:0/2542758389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 msgr2=0x7f09ec069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.673+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/2542758389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 0x7f09ec069ee0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0098c0 tx=0x7f09dc009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.673+0000 7f09f1a3d700 1 -- 172.21.15.84:0/2542758389 shutdown_connections 2023-08-31T02:01:07.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.673+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/2542758389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09ec15eac0 0x7f09ec0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.673+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/2542758389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 0x7f09ec069ee0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.673+0000 7f09f1a3d700 1 -- 172.21.15.84:0/2542758389 >> 172.21.15.84:0/2542758389 conn(0x7f09ec0d11c0 msgr2=0x7f09ec0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:07.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.673+0000 7f09f1a3d700 1 -- 172.21.15.84:0/2542758389 shutdown_connections 2023-08-31T02:01:07.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.673+0000 7f09f1a3d700 1 -- 172.21.15.84:0/2542758389 wait complete. 2023-08-31T02:01:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.674+0000 7f09f1a3d700 1 Processor -- start 2023-08-31T02:01:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.675+0000 7f09f1a3d700 1 -- start start 2023-08-31T02:01:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.675+0000 7f09f1a3d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09ec06a420 0x7f09ec154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.675+0000 7f09f1a3d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 0x7f09ec1e6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.675+0000 7f09f1a3d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ec15eac0 0x7f09ec0b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.675+0000 7f09f1a3d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec155ff0 con 0x7f09ec0cba20 2023-08-31T02:01:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.675+0000 7f09f1a3d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec1562d0 con 0x7f09ec15eac0 2023-08-31T02:01:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.675+0000 7f09f1a3d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec1565b0 con 0x7f09ec06a420 2023-08-31T02:01:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.675+0000 7f09ea7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 0x7f09ec1e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09ea7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 0x7f09ec1e6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53430/0 (socket says 172.21.15.84:53430) 2023-08-31T02:01:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09ea7fc700 1 -- 172.21.15.84:0/1492036170 learned_addr learned my addr 172.21.15.84:0/1492036170 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09ea7fc700 1 -- 172.21.15.84:0/1492036170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09ec06a420 msgr2=0x7f09ec154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09ea7fc700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09ec06a420 0x7f09ec154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09ea7fc700 1 -- 172.21.15.84:0/1492036170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ec15eac0 msgr2=0x7f09ec0b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09ea7fc700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ec15eac0 0x7f09ec0b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09ea7fc700 1 -- 172.21.15.84:0/1492036170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009520 con 0x7f09ec0cba20 2023-08-31T02:01:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09ea7fc700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 0x7f09ec1e6530 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0b3db0 tx=0x7f09dc017750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09d3fff700 1 -- 172.21.15.84:0/1492036170 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc01c070 con 0x7f09ec0cba20 2023-08-31T02:01:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09d3fff700 1 -- 172.21.15.84:0/1492036170 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f09dc017d40 con 0x7f09ec0cba20 2023-08-31T02:01:07.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09d3fff700 1 -- 172.21.15.84:0/1492036170 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0042b0 con 0x7f09ec0cba20 2023-08-31T02:01:07.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec156890 con 0x7f09ec0cba20 2023-08-31T02:01:07.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.676+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec1e6a70 con 0x7f09ec0cba20 2023-08-31T02:01:07.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.677+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec04e7c0 con 0x7f09ec0cba20 2023-08-31T02:01:07.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.677+0000 7f09d3fff700 1 -- 172.21.15.84:0/1492036170 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f09dc004410 con 0x7f09ec0cba20 2023-08-31T02:01:07.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.678+0000 7f09d3fff700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09d806a0e0 0x7f09d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:07.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.678+0000 7f09d3fff700 1 -- 172.21.15.84:0/1492036170 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f09dc089f50 con 0x7f09ec0cba20 2023-08-31T02:01:07.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.678+0000 7f09eaffd700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09d806a0e0 0x7f09d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:07.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.678+0000 7f09eaffd700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09d806a0e0 0x7f09d806c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09e000a990 tx=0x7f09e0005c60 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:07.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.682+0000 7f09d3fff700 1 -- 172.21.15.84:0/1492036170 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f09dc0553b0 con 0x7f09ec0cba20 2023-08-31T02:01:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.872+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09ec06c720 con 0x7f09ec0cba20 2023-08-31T02:01:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.874+0000 7f09d3fff700 1 -- 172.21.15.84:0/1492036170 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f09dc0589d0 con 0x7f09ec0cba20 2023-08-31T02:01:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:07.867 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09d806a0e0 msgr2=0x7f09d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09d806a0e0 0x7f09d806c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09e000a990 tx=0x7f09e0005c60 comp rx=0 tx=0).stop 2023-08-31T02:01:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 msgr2=0x7f09ec1e6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 0x7f09ec1e6530 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0b3db0 tx=0x7f09dc017750 comp rx=0 tx=0).stop 2023-08-31T02:01:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 shutdown_connections 2023-08-31T02:01:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f09d806a0e0 0x7f09d806c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ec15eac0 0x7f09ec0b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09ec06a420 0x7f09ec154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 --2- 172.21.15.84:0/1492036170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09ec0cba20 0x7f09ec1e6530 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 >> 172.21.15.84:0/1492036170 conn(0x7f09ec0d11c0 msgr2=0x7f09ec065850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 shutdown_connections 2023-08-31T02:01:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:07.876+0000 7f09f1a3d700 1 -- 172.21.15.84:0/1492036170 wait complete. 2023-08-31T02:01:07.881 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T02:01:07.882 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.011+0000 7f1d123ed700 1 -- 172.21.15.84:0/1341021420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 msgr2=0x7f1cf4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.011+0000 7f1d123ed700 1 --2- 172.21.15.84:0/1341021420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 0x7f1cf4004cd0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009be0 tx=0x7f1cf4005880 comp rx=0 tx=0).stop 2023-08-31T02:01:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.012+0000 7f1d123ed700 1 -- 172.21.15.84:0/1341021420 shutdown_connections 2023-08-31T02:01:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.012+0000 7f1d123ed700 1 --2- 172.21.15.84:0/1341021420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 0x7f1cf4004cd0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.012+0000 7f1d123ed700 1 -- 172.21.15.84:0/1341021420 >> 172.21.15.84:0/1341021420 conn(0x7f1d0c0caa20 msgr2=0x7f1d0c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.012+0000 7f1d123ed700 1 -- 172.21.15.84:0/1341021420 shutdown_connections 2023-08-31T02:01:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.012+0000 7f1d123ed700 1 -- 172.21.15.84:0/1341021420 wait complete. 2023-08-31T02:01:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.013+0000 7f1d123ed700 1 Processor -- start 2023-08-31T02:01:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.013+0000 7f1d123ed700 1 -- start start 2023-08-31T02:01:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d123ed700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 0x7f1d0c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d123ed700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d0c0ae9d0 0x7f1d0c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d123ed700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c0aee50 0x7f1d0c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d123ed700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c144830 con 0x7f1cf4004850 2023-08-31T02:01:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d123ed700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c144b10 con 0x7f1d0c0aee50 2023-08-31T02:01:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d123ed700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c144df0 con 0x7f1d0c0ae9d0 2023-08-31T02:01:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 0x7f1d0c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 0x7f1d0c0c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53448/0 (socket says 172.21.15.84:53448) 2023-08-31T02:01:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 -- 172.21.15.84:0/1231555574 learned_addr learned my addr 172.21.15.84:0/1231555574 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0b7fe700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d0c0ae9d0 0x7f1d0c0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d1098a700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c0aee50 0x7f1d0c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 -- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d0c0ae9d0 msgr2=0x7f1d0c0c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d0c0ae9d0 0x7f1d0c0c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 -- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c0aee50 msgr2=0x7f1d0c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c0aee50 0x7f1d0c0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 -- 172.21.15.84:0/1231555574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c1450d0 con 0x7f1cf4004850 2023-08-31T02:01:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d1098a700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c0aee50 0x7f1d0c0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d0bfff700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 0x7f1d0c0c5860 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000e600 tx=0x7f1d0000e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d08ff9700 1 -- 172.21.15.84:0/1231555574 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00011870 con 0x7f1cf4004850 2023-08-31T02:01:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d08ff9700 1 -- 172.21.15.84:0/1231555574 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d00011ae0 con 0x7f1cf4004850 2023-08-31T02:01:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c1453b0 con 0x7f1cf4004850 2023-08-31T02:01:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d08ff9700 1 -- 172.21.15.84:0/1231555574 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d000103c0 con 0x7f1cf4004850 2023-08-31T02:01:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.014+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c146e20 con 0x7f1cf4004850 2023-08-31T02:01:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.016+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c1455f0 con 0x7f1cf4004850 2023-08-31T02:01:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.016+0000 7f1d08ff9700 1 -- 172.21.15.84:0/1231555574 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1d00010520 con 0x7f1cf4004850 2023-08-31T02:01:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.016+0000 7f1d08ff9700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.016+0000 7f1d08ff9700 1 -- 172.21.15.84:0/1231555574 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1d000892e0 con 0x7f1cf4004850 2023-08-31T02:01:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.016+0000 7f1d0b7fe700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.017+0000 7f1d0b7fe700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009be0 tx=0x7f1cfc004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.021+0000 7f1d08ff9700 1 -- 172.21.15.84:0/1231555574 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1d0c1455f0 con 0x7f1cf4004850 2023-08-31T02:01:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.252+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d0c1455f0 con 0x7f1cf4004850 2023-08-31T02:01:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.253+0000 7f1d08ff9700 1 -- 172.21.15.84:0/1231555574 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f1d0c1455f0 con 0x7f1cf4004850 2023-08-31T02:01:08.246 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:08.246 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:16.191493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T02:01:08.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1cf806a0e0 msgr2=0x7f1cf806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009be0 tx=0x7f1cfc004750 comp rx=0 tx=0).stop 2023-08-31T02:01:08.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 msgr2=0x7f1d0c0c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 0x7f1d0c0c5860 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000e600 tx=0x7f1d0000e910 comp rx=0 tx=0).stop 2023-08-31T02:01:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 shutdown_connections 2023-08-31T02:01:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c0aee50 0x7f1d0c0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf4004850 0x7f1d0c0c5860 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 --2- 172.21.15.84:0/1231555574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d0c0ae9d0 0x7f1d0c0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 >> 172.21.15.84:0/1231555574 conn(0x7f1d0c0caa20 msgr2=0x7f1d0c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 shutdown_connections 2023-08-31T02:01:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.255+0000 7f1d123ed700 1 -- 172.21.15.84:0/1231555574 wait complete. 2023-08-31T02:01:08.251 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-08-31T02:01:08.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.390+0000 7faf6c014700 1 -- 172.21.15.84:0/2973892080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf50004d90 msgr2=0x7faf50005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.390+0000 7faf6c014700 1 --2- 172.21.15.84:0/2973892080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf50004d90 0x7faf50005210 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faf5c001f90 tx=0x7faf50005880 comp rx=0 tx=0).stop 2023-08-31T02:01:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.390+0000 7faf6a5b1700 1 -- 172.21.15.84:0/2973892080 reap_dead start 2023-08-31T02:01:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.390+0000 7faf6c014700 1 -- 172.21.15.84:0/2973892080 shutdown_connections 2023-08-31T02:01:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.390+0000 7faf6c014700 1 -- 172.21.15.84:0/2973892080 >> 172.21.15.84:0/2973892080 conn(0x7faf640699a0 msgr2=0x7faf64069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.390+0000 7faf6c014700 1 -- 172.21.15.84:0/2973892080 shutdown_connections 2023-08-31T02:01:08.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.390+0000 7faf6c014700 1 -- 172.21.15.84:0/2973892080 wait complete. 2023-08-31T02:01:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.391+0000 7faf6c014700 1 Processor -- start 2023-08-31T02:01:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.391+0000 7faf6c014700 1 -- start start 2023-08-31T02:01:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6c014700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf50004d90 0x7faf640aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6c014700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf640a7040 0x7faf640a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6c014700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf641541a0 0x7faf64154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6c014700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640a7a00 con 0x7faf641541a0 2023-08-31T02:01:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6c014700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640a7f10 con 0x7faf50004d90 2023-08-31T02:01:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6c014700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640ab3b0 con 0x7faf640a7040 2023-08-31T02:01:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6a5b1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf641541a0 0x7faf64154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6a5b1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf641541a0 0x7faf64154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53472/0 (socket says 172.21.15.84:53472) 2023-08-31T02:01:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf6a5b1700 1 -- 172.21.15.84:0/4147593904 learned_addr learned my addr 172.21.15.84:0/4147593904 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf695af700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf640a7040 0x7faf640a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.392+0000 7faf69db0700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf50004d90 0x7faf640aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf6a5b1700 1 -- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf640a7040 msgr2=0x7faf640a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf6a5b1700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf640a7040 0x7faf640a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf6a5b1700 1 -- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf50004d90 msgr2=0x7faf640aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf6a5b1700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf50004d90 0x7faf640aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf6a5b1700 1 -- 172.21.15.84:0/4147593904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640ab650 con 0x7faf641541a0 2023-08-31T02:01:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf69db0700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf50004d90 0x7faf640aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf6a5b1700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf641541a0 0x7faf64154630 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faf5c006040 tx=0x7faf5c00c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf5a7fc700 1 -- 172.21.15.84:0/4147593904 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c015070 con 0x7faf641541a0 2023-08-31T02:01:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf5a7fc700 1 -- 172.21.15.84:0/4147593904 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faf5c003d20 con 0x7faf641541a0 2023-08-31T02:01:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf640ab930 con 0x7faf641541a0 2023-08-31T02:01:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf5a7fc700 1 -- 172.21.15.84:0/4147593904 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c006330 con 0x7faf641541a0 2023-08-31T02:01:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.393+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf640abef0 con 0x7faf641541a0 2023-08-31T02:01:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.394+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6404e7c0 con 0x7faf641541a0 2023-08-31T02:01:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.394+0000 7faf5a7fc700 1 -- 172.21.15.84:0/4147593904 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf5c006490 con 0x7faf641541a0 2023-08-31T02:01:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.395+0000 7faf5a7fc700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faf4806a0e0 0x7faf4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.395+0000 7faf5a7fc700 1 -- 172.21.15.84:0/4147593904 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7faf5c089a00 con 0x7faf641541a0 2023-08-31T02:01:08.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.395+0000 7faf69db0700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faf4806a0e0 0x7faf4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.395+0000 7faf69db0700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faf4806a0e0 0x7faf4806c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf64159930 tx=0x7faf60001e50 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:08.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.399+0000 7faf5a7fc700 1 -- 172.21.15.84:0/4147593904 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faf5c054f20 con 0x7faf641541a0 2023-08-31T02:01:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.632+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf6406e030 con 0x7faf641541a0 2023-08-31T02:01:08.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.632+0000 7faf5a7fc700 1 -- 172.21.15.84:0/4147593904 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7faf5c058540 con 0x7faf641541a0 2023-08-31T02:01:08.625 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:08.625 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1706486295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1706486295},{"type":"v1","addr":"172.21.15.170:6834","nonce":1706486295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3050703362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3050703362},{"type":"v1","addr":"172.21.15.84:6835","nonce":3050703362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1272356857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1272356857},{"type":"v1","addr":"172.21.15.84:6837","nonce":1272356857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T01:59:58.513035+0000","modified":"2023-08-31T02:00:16.191493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2233754260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2233754260},{"type":"v1","addr":"172.21.15.170:6835","nonce":2233754260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T02:01:08.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faf4806a0e0 msgr2=0x7faf4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faf4806a0e0 0x7faf4806c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf64159930 tx=0x7faf60001e50 comp rx=0 tx=0).stop 2023-08-31T02:01:08.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf641541a0 msgr2=0x7faf64154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf641541a0 0x7faf64154630 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faf5c006040 tx=0x7faf5c00c9d0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 shutdown_connections 2023-08-31T02:01:08.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faf4806a0e0 0x7faf4806c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf641541a0 0x7faf64154630 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf50004d90 0x7faf640aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 --2- 172.21.15.84:0/4147593904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf640a7040 0x7faf640a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 >> 172.21.15.84:0/4147593904 conn(0x7faf640699a0 msgr2=0x7faf64158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 shutdown_connections 2023-08-31T02:01:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.634+0000 7faf6c014700 1 -- 172.21.15.84:0/4147593904 wait complete. 2023-08-31T02:01:08.630 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-08-31T02:01:08.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:08.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.769+0000 7f75c3ab7700 1 -- 172.21.15.84:0/3209521031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc0707c0 msgr2=0x7f75bc070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.769+0000 7f75c3ab7700 1 --2- 172.21.15.84:0/3209521031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc0707c0 0x7f75bc070ba0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009fd0 tx=0x7f75b400b380 comp rx=0 tx=0).stop 2023-08-31T02:01:08.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.769+0000 7f75c3ab7700 1 -- 172.21.15.84:0/3209521031 shutdown_connections 2023-08-31T02:01:08.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.769+0000 7f75c3ab7700 1 --2- 172.21.15.84:0/3209521031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc0707c0 0x7f75bc070ba0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.769+0000 7f75c3ab7700 1 -- 172.21.15.84:0/3209521031 >> 172.21.15.84:0/3209521031 conn(0x7f75bc0caa20 msgr2=0x7f75bc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:08.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.769+0000 7f75c3ab7700 1 -- 172.21.15.84:0/3209521031 shutdown_connections 2023-08-31T02:01:08.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.769+0000 7f75c3ab7700 1 -- 172.21.15.84:0/3209521031 wait complete. 2023-08-31T02:01:08.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.770+0000 7f75c3ab7700 1 Processor -- start 2023-08-31T02:01:08.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.770+0000 7f75c3ab7700 1 -- start start 2023-08-31T02:01:08.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c3ab7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75bc0707c0 0x7f75bc0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c3ab7700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75bc0cc920 0x7f75bc154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c3ab7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc158220 0x7f75bc155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c3ab7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1e3290 con 0x7f75bc158220 2023-08-31T02:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c3ab7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0c4de0 con 0x7f75bc0707c0 2023-08-31T02:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c3ab7700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1e2610 con 0x7f75bc0cc920 2023-08-31T02:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc158220 0x7f75bc155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc158220 0x7f75bc155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53486/0 (socket says 172.21.15.84:53486) 2023-08-31T02:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 -- 172.21.15.84:0/353125792 learned_addr learned my addr 172.21.15.84:0/353125792 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 -- 172.21.15.84:0/353125792 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75bc0cc920 msgr2=0x7f75bc154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c1052700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75bc0cc920 0x7f75bc154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c1853700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75bc0707c0 0x7f75bc0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75bc0cc920 0x7f75bc154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 -- 172.21.15.84:0/353125792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75bc0707c0 msgr2=0x7f75bc0c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75bc0707c0 0x7f75bc0c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 -- 172.21.15.84:0/353125792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4009d00 con 0x7f75bc158220 2023-08-31T02:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c2054700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc158220 0x7f75bc155120 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f75b400b780 tx=0x7f75b4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75b27fc700 1 -- 172.21.15.84:0/353125792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400e050 con 0x7f75bc158220 2023-08-31T02:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75b27fc700 1 -- 172.21.15.84:0/353125792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f75b4008e00 con 0x7f75bc158220 2023-08-31T02:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc1e28f0 con 0x7f75bc158220 2023-08-31T02:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.771+0000 7f75b27fc700 1 -- 172.21.15.84:0/353125792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4004290 con 0x7f75bc158220 2023-08-31T02:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.772+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc1e2eb0 con 0x7f75bc158220 2023-08-31T02:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.772+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc04e7c0 con 0x7f75bc158220 2023-08-31T02:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.773+0000 7f75b27fc700 1 -- 172.21.15.84:0/353125792 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75b40043f0 con 0x7f75bc158220 2023-08-31T02:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.773+0000 7f75b27fc700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f75a006a0e0 0x7f75a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.773+0000 7f75b27fc700 1 -- 172.21.15.84:0/353125792 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f75b408be00 con 0x7f75bc158220 2023-08-31T02:01:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.773+0000 7f75c1853700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f75a006a0e0 0x7f75a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.774+0000 7f75c1853700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f75a006a0e0 0x7f75a006c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f75ac000f60 tx=0x7f75ac009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:08.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.778+0000 7f75b27fc700 1 -- 172.21.15.84:0/353125792 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75b4057260 con 0x7f75bc158220 2023-08-31T02:01:08.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.967+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75bc158650 con 0x7f75bc158220 2023-08-31T02:01:08.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.968+0000 7f75b27fc700 1 -- 172.21.15.84:0/353125792 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18849 (secure 0 0 0) 0x7f75b4017030 con 0x7f75bc158220 2023-08-31T02:01:08.961 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:08.961 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:00:40.295703+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T01:59:56.419467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T01:59:57.485752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T02:00:01.174373+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":4,"to":6}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:08.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f75a006a0e0 msgr2=0x7f75a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f75a006a0e0 0x7f75a006c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f75ac000f60 tx=0x7f75ac009040 comp rx=0 tx=0).stop 2023-08-31T02:01:08.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc158220 msgr2=0x7f75bc155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:08.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc158220 0x7f75bc155120 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f75b400b780 tx=0x7f75b4009580 comp rx=0 tx=0).stop 2023-08-31T02:01:08.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 shutdown_connections 2023-08-31T02:01:08.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f75a006a0e0 0x7f75a006c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75bc158220 0x7f75bc155120 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75bc0707c0 0x7f75bc0c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 --2- 172.21.15.84:0/353125792 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75bc0cc920 0x7f75bc154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:08.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 >> 172.21.15.84:0/353125792 conn(0x7f75bc0caa20 msgr2=0x7f75bc1e0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:08.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 shutdown_connections 2023-08-31T02:01:08.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:08.970+0000 7f75c3ab7700 1 -- 172.21.15.84:0/353125792 wait complete. 2023-08-31T02:01:08.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T02:01:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.107+0000 7f1e75543700 1 -- 172.21.15.84:0/43868473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e58003f80 msgr2=0x7f1e58004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.107+0000 7f1e75543700 1 --2- 172.21.15.84:0/43868473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e58003f80 0x7f1e58004850 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009be0 tx=0x7f1e58005880 comp rx=0 tx=0).stop 2023-08-31T02:01:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.107+0000 7f1e6f7fe700 1 -- 172.21.15.84:0/43868473 reap_dead start 2023-08-31T02:01:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.107+0000 7f1e75543700 1 -- 172.21.15.84:0/43868473 shutdown_connections 2023-08-31T02:01:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.107+0000 7f1e75543700 1 -- 172.21.15.84:0/43868473 >> 172.21.15.84:0/43868473 conn(0x7f1e700cdeb0 msgr2=0x7f1e700ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.107+0000 7f1e75543700 1 -- 172.21.15.84:0/43868473 shutdown_connections 2023-08-31T02:01:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.107+0000 7f1e75543700 1 -- 172.21.15.84:0/43868473 wait complete. 2023-08-31T02:01:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.108+0000 7f1e75543700 1 Processor -- start 2023-08-31T02:01:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.108+0000 7f1e75543700 1 -- start start 2023-08-31T02:01:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e75543700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e58003f80 0x7f1e70159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e75543700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e70150610 0x7f1e7015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e75543700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e700c39a0 0x7f1e700c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e75543700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7015b440 con 0x7f1e70150610 2023-08-31T02:01:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e75543700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e70158970 con 0x7f1e58003f80 2023-08-31T02:01:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e75543700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e700c3000 con 0x7f1e700c39a0 2023-08-31T02:01:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e6e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e70150610 0x7f1e7015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e6e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e70150610 0x7f1e7015a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53504/0 (socket says 172.21.15.84:53504) 2023-08-31T02:01:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.109+0000 7f1e6e7fc700 1 -- 172.21.15.84:0/352527635 learned_addr learned my addr 172.21.15.84:0/352527635 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e6e7fc700 1 -- 172.21.15.84:0/352527635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e700c39a0 msgr2=0x7f1e700c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e6effd700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e58003f80 0x7f1e70159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e6f7fe700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e700c39a0 0x7f1e700c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e6e7fc700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e700c39a0 0x7f1e700c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e6e7fc700 1 -- 172.21.15.84:0/352527635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e58003f80 msgr2=0x7f1e70159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e6e7fc700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e58003f80 0x7f1e70159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e6e7fc700 1 -- 172.21.15.84:0/352527635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7015aba0 con 0x7f1e70150610 2023-08-31T02:01:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e6e7fc700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e70150610 0x7f1e7015a330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1e60016000 tx=0x7f1e600058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e577fe700 1 -- 172.21.15.84:0/352527635 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60003880 con 0x7f1e70150610 2023-08-31T02:01:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e577fe700 1 -- 172.21.15.84:0/352527635 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1e600039e0 con 0x7f1e70150610 2023-08-31T02:01:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7015b440 con 0x7f1e70150610 2023-08-31T02:01:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e577fe700 1 -- 172.21.15.84:0/352527635 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60003df0 con 0x7f1e70150610 2023-08-31T02:01:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.110+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7015b160 con 0x7f1e70150610 2023-08-31T02:01:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.111+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7004e7c0 con 0x7f1e70150610 2023-08-31T02:01:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.111+0000 7f1e577fe700 1 -- 172.21.15.84:0/352527635 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1e6001f450 con 0x7f1e70150610 2023-08-31T02:01:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.112+0000 7f1e577fe700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.112+0000 7f1e577fe700 1 -- 172.21.15.84:0/352527635 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1e60014070 con 0x7f1e70150610 2023-08-31T02:01:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.112+0000 7f1e6effd700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.112+0000 7f1e6effd700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1e64001800 tx=0x7f1e64000bc0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.116+0000 7f1e577fe700 1 -- 172.21.15.84:0/352527635 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1e60057a20 con 0x7f1e70150610 2023-08-31T02:01:09.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.345+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1e700cd330 con 0x7f1e70150610 2023-08-31T02:01:09.339 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-08-31T02:01:09.346+0000 7f3b998f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T02:01:09.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.350+0000 7f1e577fe700 1 -- 172.21.15.84:0/352527635 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1e6005b040 con 0x7f1e70150610 2023-08-31T02:01:09.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e5c06a0e0 msgr2=0x7f1e5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1e64001800 tx=0x7f1e64000bc0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e70150610 msgr2=0x7f1e7015a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e70150610 0x7f1e7015a330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1e60016000 tx=0x7f1e600058e0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 shutdown_connections 2023-08-31T02:01:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f1e5c06a0e0 0x7f1e5c06c5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e700c39a0 0x7f1e700c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e58003f80 0x7f1e70159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 --2- 172.21.15.84:0/352527635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e70150610 0x7f1e7015a330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.352+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 >> 172.21.15.84:0/352527635 conn(0x7f1e700cdeb0 msgr2=0x7f1e7006b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:09.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.353+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 shutdown_connections 2023-08-31T02:01:09.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.353+0000 7f1e75543700 1 -- 172.21.15.84:0/352527635 wait complete. 2023-08-31T02:01:09.348 INFO:tasks.ceph.mds.d.smithi170.stderr: -5167> 2023-08-31T02:00:02.692+0000 7f04d894e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T02:01:09.349 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T02:01:09.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T02:01:09.377 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2023-08-31T02:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.490+0000 7f1194eb0700 1 -- 172.21.15.84:0/2774480267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117c005210 msgr2=0x7f117c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.490+0000 7f1194eb0700 1 --2- 172.21.15.84:0/2774480267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117c005210 0x7f117c00ba10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1188009be0 tx=0x7f117c005880 comp rx=0 tx=0).stop 2023-08-31T02:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.490+0000 7f1194eb0700 1 -- 172.21.15.84:0/2774480267 shutdown_connections 2023-08-31T02:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.490+0000 7f1194eb0700 1 --2- 172.21.15.84:0/2774480267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117c005210 0x7f117c00ba10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.490+0000 7f1194eb0700 1 -- 172.21.15.84:0/2774480267 >> 172.21.15.84:0/2774480267 conn(0x7f11900cd5d0 msgr2=0x7f11900cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.490+0000 7f1194eb0700 1 -- 172.21.15.84:0/2774480267 shutdown_connections 2023-08-31T02:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.490+0000 7f1194eb0700 1 -- 172.21.15.84:0/2774480267 wait complete. 2023-08-31T02:01:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.492+0000 7f1194eb0700 1 Processor -- start 2023-08-31T02:01:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.492+0000 7f1194eb0700 1 -- start start 2023-08-31T02:01:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.492+0000 7f1194eb0700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f117c005210 0x7f11901e4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.492+0000 7f1194eb0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11900c50f0 0x7f11900c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.492+0000 7f1194eb0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11900c5570 0x7f1190159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:09.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.492+0000 7f1194eb0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11901f2d50 con 0x7f11900c50f0 2023-08-31T02:01:09.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.492+0000 7f1194eb0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11901e46b0 con 0x7f11900c5570 2023-08-31T02:01:09.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.492+0000 7f1194eb0700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11900c1bd0 con 0x7f117c005210 2023-08-31T02:01:09.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11900c50f0 0x7f11900c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:09.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11900c50f0 0x7f11900c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53524/0 (socket says 172.21.15.84:53524) 2023-08-31T02:01:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 -- 172.21.15.84:0/3872945644 learned_addr learned my addr 172.21.15.84:0/3872945644 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118e59c700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f117c005210 0x7f11901e4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118ed9d700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11900c5570 0x7f1190159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 -- 172.21.15.84:0/3872945644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f117c005210 msgr2=0x7f11901e4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f117c005210 0x7f11901e4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 -- 172.21.15.84:0/3872945644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11900c5570 msgr2=0x7f1190159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11900c5570 0x7f1190159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 -- 172.21.15.84:0/3872945644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900c1eb0 con 0x7f11900c50f0 2023-08-31T02:01:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f118dd9b700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11900c50f0 0x7f11900c1090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1178003f50 tx=0x7f1178001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f1186ffd700 1 -- 172.21.15.84:0/3872945644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178011630 con 0x7f11900c50f0 2023-08-31T02:01:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f1186ffd700 1 -- 172.21.15.84:0/3872945644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1178011790 con 0x7f11900c50f0 2023-08-31T02:01:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11900c2190 con 0x7f11900c50f0 2023-08-31T02:01:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f1186ffd700 1 -- 172.21.15.84:0/3872945644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178011b80 con 0x7f11900c50f0 2023-08-31T02:01:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.493+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190149320 con 0x7f11900c50f0 2023-08-31T02:01:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.494+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900c26b0 con 0x7f11900c50f0 2023-08-31T02:01:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.495+0000 7f1186ffd700 1 -- 172.21.15.84:0/3872945644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1178011ce0 con 0x7f11900c50f0 2023-08-31T02:01:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.495+0000 7f1186ffd700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117006a0e0 0x7f117006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.495+0000 7f1186ffd700 1 -- 172.21.15.84:0/3872945644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f1178089420 con 0x7f11900c50f0 2023-08-31T02:01:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.495+0000 7f118e59c700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117006a0e0 0x7f117006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.496+0000 7f118e59c700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117006a0e0 0x7f117006c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1180001c50 tx=0x7f1180006040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.499+0000 7f1186ffd700 1 -- 172.21.15.84:0/3872945644 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f11900c26b0 con 0x7f11900c50f0 2023-08-31T02:01:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:09.734+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f11900c26b0 con 0x7f11900c50f0 2023-08-31T02:01:10.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.351+0000 7f1186ffd700 1 -- 172.21.15.84:0/3872945644 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f11900c26b0 con 0x7f11900c50f0 2023-08-31T02:01:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117006a0e0 msgr2=0x7f117006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117006a0e0 0x7f117006c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1180001c50 tx=0x7f1180006040 comp rx=0 tx=0).stop 2023-08-31T02:01:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11900c50f0 msgr2=0x7f11900c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11900c50f0 0x7f11900c1090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1178003f50 tx=0x7f1178001540 comp rx=0 tx=0).stop 2023-08-31T02:01:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 shutdown_connections 2023-08-31T02:01:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117006a0e0 0x7f117006c5a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11900c5570 0x7f1190159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f117c005210 0x7f11901e4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 --2- 172.21.15.84:0/3872945644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11900c50f0 0x7f11900c1090 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 >> 172.21.15.84:0/3872945644 conn(0x7f11900cd5d0 msgr2=0x7f1190156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:10.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 shutdown_connections 2023-08-31T02:01:10.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.354+0000 7f1194eb0700 1 -- 172.21.15.84:0/3872945644 wait complete. 2023-08-31T02:01:10.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T02:01:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.500+0000 7f8bf226d700 1 -- 172.21.15.84:0/3195253006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec069dd0 msgr2=0x7f8bec0ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.500+0000 7f8bf226d700 1 --2- 172.21.15.84:0/3195253006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec069dd0 0x7f8bec0ae5d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8bec06bee0 tx=0x7f8bd4009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.500+0000 7f8bf226d700 1 -- 172.21.15.84:0/3195253006 shutdown_connections 2023-08-31T02:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.500+0000 7f8bf226d700 1 --2- 172.21.15.84:0/3195253006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec069dd0 0x7f8bec0ae5d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.500+0000 7f8bf226d700 1 --2- 172.21.15.84:0/3195253006 >> v2:172.21.15.170:3300/0 conn(0x7f8bec0aeb10 0x7f8bec06a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.500+0000 7f8bf226d700 1 -- 172.21.15.84:0/3195253006 >> 172.21.15.84:0/3195253006 conn(0x7f8bec0cd740 msgr2=0x7f8bec0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.500+0000 7f8bf226d700 1 -- 172.21.15.84:0/3195253006 shutdown_connections 2023-08-31T02:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.500+0000 7f8bf226d700 1 -- 172.21.15.84:0/3195253006 wait complete. 2023-08-31T02:01:10.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.501+0000 7f8bf226d700 1 Processor -- start 2023-08-31T02:01:10.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8bf226d700 1 -- start start 2023-08-31T02:01:10.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8bf226d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bec069dd0 0x7f8bec0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:10.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8bf226d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec06a6f0 0x7f8bec0a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:10.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8bf226d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bec0aeb10 0x7f8bec0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:10.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8bf226d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0acab0 con 0x7f8bec06a6f0 2023-08-31T02:01:10.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8bf226d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0a90e0 con 0x7f8bec0aeb10 2023-08-31T02:01:10.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8bf226d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0ac730 con 0x7f8bec069dd0 2023-08-31T02:01:10.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8beb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec06a6f0 0x7f8bec0a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:10.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8beb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec06a6f0 0x7f8bec0a8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53536/0 (socket says 172.21.15.84:53536) 2023-08-31T02:01:10.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.502+0000 7f8beb7fe700 1 -- 172.21.15.84:0/2251498866 learned_addr learned my addr 172.21.15.84:0/2251498866 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:10.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8beb7fe700 1 -- 172.21.15.84:0/2251498866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bec069dd0 msgr2=0x7f8bec0aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:10.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8beb7fe700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bec069dd0 0x7f8bec0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:10.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8beb7fe700 1 -- 172.21.15.84:0/2251498866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bec0aeb10 msgr2=0x7f8bec0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:10.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8beb7fe700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bec0aeb10 0x7f8bec0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:10.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8beb7fe700 1 -- 172.21.15.84:0/2251498866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd40095f0 con 0x7f8bec06a6f0 2023-08-31T02:01:10.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8beb7fe700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec06a6f0 0x7f8bec0a8ba0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00d950 tx=0x7f8bdc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:10.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8be8ff9700 1 -- 172.21.15.84:0/2251498866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc009930 con 0x7f8bec06a6f0 2023-08-31T02:01:10.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8be8ff9700 1 -- 172.21.15.84:0/2251498866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8bdc009b80 con 0x7f8bec06a6f0 2023-08-31T02:01:10.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec0a9340 con 0x7f8bec06a6f0 2023-08-31T02:01:10.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8be8ff9700 1 -- 172.21.15.84:0/2251498866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc010460 con 0x7f8bec06a6f0 2023-08-31T02:01:10.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.503+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec0a9900 con 0x7f8bec06a6f0 2023-08-31T02:01:10.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.504+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec0a9b20 con 0x7f8bec06a6f0 2023-08-31T02:01:10.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.504+0000 7f8be8ff9700 1 -- 172.21.15.84:0/2251498866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8bdc0105c0 con 0x7f8bec06a6f0 2023-08-31T02:01:10.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.505+0000 7f8be8ff9700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:10.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.505+0000 7f8be8ff9700 1 -- 172.21.15.84:0/2251498866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f8bdc088c60 con 0x7f8bec06a6f0 2023-08-31T02:01:10.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.505+0000 7f8bebfff700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:10.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.505+0000 7f8bebfff700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4000c00 tx=0x7f8bd4004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:10.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.509+0000 7f8be8ff9700 1 -- 172.21.15.84:0/2251498866 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8bdc057a50 con 0x7f8bec06a6f0 2023-08-31T02:01:10.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:10.700+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8bec06bbd0 con 0x7f8bec06a6f0 2023-08-31T02:01:11.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.416+0000 7f8be8ff9700 1 -- 172.21.15.84:0/2251498866 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8bdc0170d0 con 0x7f8bec06a6f0 2023-08-31T02:01:11.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.419+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 msgr2=0x7f8bcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:11.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.419+0000 7f8bf226d700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4000c00 tx=0x7f8bd4004750 comp rx=0 tx=0).stop 2023-08-31T02:01:11.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.419+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec06a6f0 msgr2=0x7f8bec0a8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:11.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.419+0000 7f8bf226d700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec06a6f0 0x7f8bec0a8ba0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00d950 tx=0x7f8bdc00dd10 comp rx=0 tx=0).stop 2023-08-31T02:01:11.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.420+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 shutdown_connections 2023-08-31T02:01:11.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.420+0000 7f8bf226d700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.420+0000 7f8bf226d700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bec0aeb10 0x7f8bec0700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.420+0000 7f8bf226d700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bec069dd0 0x7f8bec0aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.420+0000 7f8bf226d700 1 --2- 172.21.15.84:0/2251498866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bec06a6f0 0x7f8bec0a8ba0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.420+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 >> 172.21.15.84:0/2251498866 conn(0x7f8bec0cd740 msgr2=0x7f8bec0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:11.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.420+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 shutdown_connections 2023-08-31T02:01:11.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.420+0000 7f8bf226d700 1 -- 172.21.15.84:0/2251498866 wait complete. 2023-08-31T02:01:11.415 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-08-31T02:01:11.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T02:01:11.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.564+0000 7f8beef0e700 1 -- 172.21.15.84:0/1903444374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be80c8280 msgr2=0x7f8be806a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:11.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.564+0000 7f8beef0e700 1 --2- 172.21.15.84:0/1903444374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be80c8280 0x7f8be806a420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40098c0 tx=0x7f8bd4009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.564+0000 7f8beef0e700 1 -- 172.21.15.84:0/1903444374 shutdown_connections 2023-08-31T02:01:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.564+0000 7f8beef0e700 1 --2- 172.21.15.84:0/1903444374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8be806a040 0x7f8be80ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.564+0000 7f8beef0e700 1 --2- 172.21.15.84:0/1903444374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be80c8280 0x7f8be806a420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.564+0000 7f8beef0e700 1 -- 172.21.15.84:0/1903444374 >> 172.21.15.84:0/1903444374 conn(0x7f8be80cd740 msgr2=0x7f8be80cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.564+0000 7f8beef0e700 1 -- 172.21.15.84:0/1903444374 shutdown_connections 2023-08-31T02:01:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.564+0000 7f8beef0e700 1 -- 172.21.15.84:0/1903444374 wait complete. 2023-08-31T02:01:11.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.565+0000 7f8beef0e700 1 Processor -- start 2023-08-31T02:01:11.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.565+0000 7f8beef0e700 1 -- start start 2023-08-31T02:01:11.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8beef0e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8be806a040 0x7f8be8149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:11.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8beef0e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be80aeb10 0x7f8be814b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:11.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8beef0e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8be80c8280 0x7f8be80c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:11.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8beef0e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be814bde0 con 0x7f8be80c8280 2023-08-31T02:01:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8beef0e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be814c0c0 con 0x7f8be80aeb10 2023-08-31T02:01:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8beef0e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be814c3a0 con 0x7f8be806a040 2023-08-31T02:01:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8be80c8280 0x7f8be80c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8be80c8280 0x7f8be80c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53552/0 (socket says 172.21.15.84:53552) 2023-08-31T02:01:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 -- 172.21.15.84:0/2116093208 learned_addr learned my addr 172.21.15.84:0/2116093208 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:11.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8beccaa700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8be806a040 0x7f8be8149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:11.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8be7fff700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be80aeb10 0x7f8be814b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:11.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 -- 172.21.15.84:0/2116093208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8be806a040 msgr2=0x7f8be8149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:11.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8be806a040 0x7f8be8149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 -- 172.21.15.84:0/2116093208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be80aeb10 msgr2=0x7f8be814b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:11.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be80aeb10 0x7f8be814b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:11.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 -- 172.21.15.84:0/2116093208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc009520 con 0x7f8be80c8280 2023-08-31T02:01:11.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.566+0000 7f8bed4ab700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8be80c8280 0x7f8be80c6c90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8be000cb10 tx=0x7f8be000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:11.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.567+0000 7f8be57fa700 1 -- 172.21.15.84:0/2116093208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0003c00 con 0x7f8be80c8280 2023-08-31T02:01:11.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.567+0000 7f8be57fa700 1 -- 172.21.15.84:0/2116093208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8be0003e50 con 0x7f8be80c8280 2023-08-31T02:01:11.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.567+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4009520 con 0x7f8be80c8280 2023-08-31T02:01:11.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.567+0000 7f8be57fa700 1 -- 172.21.15.84:0/2116093208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000a9e0 con 0x7f8be80c8280 2023-08-31T02:01:11.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.567+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be8158630 con 0x7f8be80c8280 2023-08-31T02:01:11.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.567+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be8158850 con 0x7f8be80c8280 2023-08-31T02:01:11.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.568+0000 7f8be57fa700 1 -- 172.21.15.84:0/2116093208 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8be000ab40 con 0x7f8be80c8280 2023-08-31T02:01:11.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.568+0000 7f8be57fa700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:11.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.568+0000 7f8be57fa700 1 -- 172.21.15.84:0/2116093208 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f8be0088da0 con 0x7f8be80c8280 2023-08-31T02:01:11.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.568+0000 7f8beccaa700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:11.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.569+0000 7f8beccaa700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8be80b2ad0 tx=0x7f8bdc009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:11.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.573+0000 7f8be57fa700 1 -- 172.21.15.84:0/2116093208 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8be00542d0 con 0x7f8be80c8280 2023-08-31T02:01:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:11.771+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8be8073a40 con 0x7f8be80c8280 2023-08-31T02:01:12.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.425+0000 7f8be57fa700 1 -- 172.21.15.84:0/2116093208 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8be00578f0 con 0x7f8be80c8280 2023-08-31T02:01:12.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.429+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 msgr2=0x7f8bcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.429+0000 7f8beef0e700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8be80b2ad0 tx=0x7f8bdc009260 comp rx=0 tx=0).stop 2023-08-31T02:01:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.429+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8be80c8280 msgr2=0x7f8be80c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:12.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.429+0000 7f8beef0e700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8be80c8280 0x7f8be80c6c90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8be000cb10 tx=0x7f8be000ce20 comp rx=0 tx=0).stop 2023-08-31T02:01:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.431+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 shutdown_connections 2023-08-31T02:01:12.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.431+0000 7f8beef0e700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8bcc06a0e0 0x7f8bcc06c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:12.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.431+0000 7f8beef0e700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8be80c8280 0x7f8be80c6c90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:12.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.431+0000 7f8beef0e700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8be806a040 0x7f8be8149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:12.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.431+0000 7f8beef0e700 1 --2- 172.21.15.84:0/2116093208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be80aeb10 0x7f8be814b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:12.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.431+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 >> 172.21.15.84:0/2116093208 conn(0x7f8be80cd740 msgr2=0x7f8be8154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:12.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.431+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 shutdown_connections 2023-08-31T02:01:12.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.432+0000 7f8beef0e700 1 -- 172.21.15.84:0/2116093208 wait complete. 2023-08-31T02:01:12.426 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-08-31T02:01:12.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-08-31T02:01:12.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.579+0000 7fb8abc0c700 1 -- 172.21.15.84:0/1144022446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb890004850 msgr2=0x7fb890004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:12.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.579+0000 7fb8abc0c700 1 --2- 172.21.15.84:0/1144022446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb890004850 0x7fb890004cd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009bd0 tx=0x7fb890005880 comp rx=0 tx=0).stop 2023-08-31T02:01:12.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.579+0000 7fb8abc0c700 1 -- 172.21.15.84:0/1144022446 shutdown_connections 2023-08-31T02:01:12.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.579+0000 7fb8abc0c700 1 --2- 172.21.15.84:0/1144022446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb890004850 0x7fb890004cd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:12.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.579+0000 7fb8abc0c700 1 -- 172.21.15.84:0/1144022446 >> 172.21.15.84:0/1144022446 conn(0x7fb8a40cef70 msgr2=0x7fb8a40cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:12.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.579+0000 7fb8abc0c700 1 -- 172.21.15.84:0/1144022446 shutdown_connections 2023-08-31T02:01:12.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.579+0000 7fb8abc0c700 1 -- 172.21.15.84:0/1144022446 wait complete. 2023-08-31T02:01:12.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.580+0000 7fb8abc0c700 1 Processor -- start 2023-08-31T02:01:12.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.580+0000 7fb8abc0c700 1 -- start start 2023-08-31T02:01:12.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8abc0c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb890004850 0x7fb8a406b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:12.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8abc0c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a406cae0 0x7fb8a41f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:12.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8abc0c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a41576d0 0x7fb8a41f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:12.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8abc0c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a406ba40 con 0x7fb8a41576d0 2023-08-31T02:01:12.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8abc0c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a406bd20 con 0x7fb890004850 2023-08-31T02:01:12.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8abc0c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a406c000 con 0x7fb8a406cae0 2023-08-31T02:01:12.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8aa1a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a41576d0 0x7fb8a41f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:12.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8aa1a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a41576d0 0x7fb8a41f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53572/0 (socket says 172.21.15.84:53572) 2023-08-31T02:01:12.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8aa1a9700 1 -- 172.21.15.84:0/804335859 learned_addr learned my addr 172.21.15.84:0/804335859 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:12.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8a99a8700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb890004850 0x7fb8a406b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:12.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8a91a7700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a406cae0 0x7fb8a41f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:12.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8aa1a9700 1 -- 172.21.15.84:0/804335859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a406cae0 msgr2=0x7fb8a41f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:12.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8aa1a9700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a406cae0 0x7fb8a41f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:12.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8aa1a9700 1 -- 172.21.15.84:0/804335859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb890004850 msgr2=0x7fb8a406b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:12.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8aa1a9700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb890004850 0x7fb8a406b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:12.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.581+0000 7fb8aa1a9700 1 -- 172.21.15.84:0/804335859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a406c2e0 con 0x7fb8a41576d0 2023-08-31T02:01:12.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.582+0000 7fb8aa1a9700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a41576d0 0x7fb8a41f21f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb89c000f80 tx=0x7fb89c0018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:12.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.582+0000 7fb89a7fc700 1 -- 172.21.15.84:0/804335859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011460 con 0x7fb8a41576d0 2023-08-31T02:01:12.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.582+0000 7fb89a7fc700 1 -- 172.21.15.84:0/804335859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb89c0116b0 con 0x7fb8a41576d0 2023-08-31T02:01:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.582+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a406c5c0 con 0x7fb8a41576d0 2023-08-31T02:01:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.582+0000 7fb89a7fc700 1 -- 172.21.15.84:0/804335859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011ac0 con 0x7fb8a41576d0 2023-08-31T02:01:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.582+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a4158940 con 0x7fb8a41576d0 2023-08-31T02:01:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.583+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a406c800 con 0x7fb8a41576d0 2023-08-31T02:01:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.583+0000 7fb89a7fc700 1 -- 172.21.15.84:0/804335859 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb89c011c20 con 0x7fb8a41576d0 2023-08-31T02:01:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.583+0000 7fb89a7fc700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.584+0000 7fb89a7fc700 1 -- 172.21.15.84:0/804335859 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fb89c088b50 con 0x7fb8a41576d0 2023-08-31T02:01:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.584+0000 7fb8a99a8700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.584+0000 7fb8a99a8700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40ae7c0 tx=0x7fb894006040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:12.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.588+0000 7fb89a7fc700 1 -- 172.21.15.84:0/804335859 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb89c0542e0 con 0x7fb8a41576d0 2023-08-31T02:01:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:12.777+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb8a4073a40 con 0x7fb8a41576d0 2023-08-31T02:01:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.438+0000 7fb89a7fc700 1 -- 172.21.15.84:0/804335859 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7fb89c057900 con 0x7fb8a41576d0 2023-08-31T02:01:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 msgr2=0x7fb88806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40ae7c0 tx=0x7fb894006040 comp rx=0 tx=0).stop 2023-08-31T02:01:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a41576d0 msgr2=0x7fb8a41f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a41576d0 0x7fb8a41f21f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb89c000f80 tx=0x7fb89c0018c0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 shutdown_connections 2023-08-31T02:01:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a41576d0 0x7fb8a41f21f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb890004850 0x7fb8a406b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 --2- 172.21.15.84:0/804335859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a406cae0 0x7fb8a41f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.445+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 >> 172.21.15.84:0/804335859 conn(0x7fb8a40cef70 msgr2=0x7fb8a41538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.446+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 shutdown_connections 2023-08-31T02:01:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.446+0000 7fb8abc0c700 1 -- 172.21.15.84:0/804335859 wait complete. 2023-08-31T02:01:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' removed 2023-08-31T02:01:13.452 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T02:01:13.452 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T02:01:13.453 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T02:01:13.453 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:01:13.453 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T02:01:13.454 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T02:01:13.454 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T02:01:13.454 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:01:13.455 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T02:01:13.455 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T02:01:13.455 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T02:01:13.455 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:01:13.456 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T02:01:13.456 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T02:01:13.456 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T02:01:13.457 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:01:13.462 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T02:01:13.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T02:01:13.463 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T02:01:13.464 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T02:01:13.466 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T02:01:13.466 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T02:01:13.467 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T02:01:13.467 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T02:01:13.505 INFO:tasks.ceph.mds.a:Started 2023-08-31T02:01:13.505 DEBUG:teuthology.parallel:result is None 2023-08-31T02:01:13.506 INFO:tasks.ceph.mds.c:Started 2023-08-31T02:01:13.506 DEBUG:teuthology.parallel:result is None 2023-08-31T02:01:13.509 INFO:tasks.ceph.mds.b:Started 2023-08-31T02:01:13.509 DEBUG:teuthology.parallel:result is None 2023-08-31T02:01:13.510 INFO:tasks.ceph.mds.d:Started 2023-08-31T02:01:13.511 DEBUG:teuthology.parallel:result is None 2023-08-31T02:01:13.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T02:01:13.586 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-08-31T02:01:13.586 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-08-31T02:01:13.592 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2023-08-31T02:01:13.593 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2023-08-31T02:01:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.650+0000 7ff36958a700 1 -- 172.21.15.84:0/1769125131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff364070fb0 msgr2=0x7ff3640b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:13.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.650+0000 7ff36958a700 1 --2- 172.21.15.84:0/1769125131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff364070fb0 0x7ff3640b0d00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff3540098c0 tx=0x7ff354009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.650+0000 7ff36958a700 1 -- 172.21.15.84:0/1769125131 shutdown_connections 2023-08-31T02:01:13.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.650+0000 7ff36958a700 1 --2- 172.21.15.84:0/1769125131 >> v2:172.21.15.170:3300/0 conn(0x7ff3640cd8f0 0x7ff3640c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.650+0000 7ff36958a700 1 --2- 172.21.15.84:0/1769125131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff364070fb0 0x7ff3640b0d00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.650+0000 7ff36958a700 1 -- 172.21.15.84:0/1769125131 >> 172.21.15.84:0/1769125131 conn(0x7ff3640cdeb0 msgr2=0x7ff3640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:13.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.650+0000 7ff36958a700 1 -- 172.21.15.84:0/1769125131 shutdown_connections 2023-08-31T02:01:13.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.650+0000 7ff36958a700 1 -- 172.21.15.84:0/1769125131 wait complete. 2023-08-31T02:01:13.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.652+0000 7ff36958a700 1 Processor -- start 2023-08-31T02:01:13.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.652+0000 7ff36958a700 1 -- start start 2023-08-31T02:01:13.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.652+0000 7ff36958a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff364070fb0 0x7ff364156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:13.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.652+0000 7ff36958a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3640cd8f0 0x7ff36406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:13.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.652+0000 7ff36958a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36415c830 0x7ff3640c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:13.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.652+0000 7ff36958a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3641568f0 con 0x7ff36415c830 2023-08-31T02:01:13.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.652+0000 7ff36958a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff364155c70 con 0x7ff3640cd8f0 2023-08-31T02:01:13.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.652+0000 7ff36958a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff364155f50 con 0x7ff364070fb0 2023-08-31T02:01:13.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36415c830 0x7ff3640c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:13.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36415c830 0x7ff3640c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53604/0 (socket says 172.21.15.84:53604) 2023-08-31T02:01:13.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 -- 172.21.15.84:0/694384785 learned_addr learned my addr 172.21.15.84:0/694384785 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:13.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff362ffd700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff364070fb0 0x7ff364156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:13.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3627fc700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3640cd8f0 0x7ff36406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:13.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 -- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff364070fb0 msgr2=0x7ff364156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:13.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff364070fb0 0x7ff364156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 -- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3640cd8f0 msgr2=0x7ff36406a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3640cd8f0 0x7ff36406a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 -- 172.21.15.84:0/694384785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff354009520 con 0x7ff36415c830 2023-08-31T02:01:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff362ffd700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff364070fb0 0x7ff364156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3627fc700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3640cd8f0 0x7ff36406a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff3637fe700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36415c830 0x7ff3640c3f40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00ef30 tx=0x7ff35c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:13.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff34b7fe700 1 -- 172.21.15.84:0/694384785 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c018070 con 0x7ff36415c830 2023-08-31T02:01:13.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff34b7fe700 1 -- 172.21.15.84:0/694384785 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff35c00f040 con 0x7ff36415c830 2023-08-31T02:01:13.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff364156230 con 0x7ff36415c830 2023-08-31T02:01:13.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff34b7fe700 1 -- 172.21.15.84:0/694384785 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c004bb0 con 0x7ff36415c830 2023-08-31T02:01:13.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.653+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff364157250 con 0x7ff36415c830 2023-08-31T02:01:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.654+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36404e7c0 con 0x7ff36415c830 2023-08-31T02:01:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.655+0000 7ff34b7fe700 1 -- 172.21.15.84:0/694384785 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff35c004d10 con 0x7ff36415c830 2023-08-31T02:01:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.655+0000 7ff34b7fe700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff35006a0e0 0x7ff35006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.655+0000 7ff34b7fe700 1 -- 172.21.15.84:0/694384785 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff35c088280 con 0x7ff36415c830 2023-08-31T02:01:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.655+0000 7ff362ffd700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff35006a0e0 0x7ff35006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:13.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.655+0000 7ff362ffd700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff35006a0e0 0x7ff35006c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff3580016e0 tx=0x7ff358009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:13.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.659+0000 7ff34b7fe700 1 -- 172.21.15.84:0/694384785 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff35c053cb0 con 0x7ff36415c830 2023-08-31T02:01:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:13.866+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff36406e0e0 con 0x7ff36415c830 2023-08-31T02:01:14.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.444+0000 7ff34b7fe700 1 -- 172.21.15.84:0/694384785 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff35c0572d0 con 0x7ff36415c830 2023-08-31T02:01:14.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.447+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff35006a0e0 msgr2=0x7ff35006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:14.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.447+0000 7ff36958a700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff35006a0e0 0x7ff35006c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff3580016e0 tx=0x7ff358009040 comp rx=0 tx=0).stop 2023-08-31T02:01:14.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36415c830 msgr2=0x7ff3640c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:14.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36415c830 0x7ff3640c3f40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00ef30 tx=0x7ff35c00c450 comp rx=0 tx=0).stop 2023-08-31T02:01:14.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 shutdown_connections 2023-08-31T02:01:14.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff35006a0e0 0x7ff35006c5a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36415c830 0x7ff3640c3f40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff364070fb0 0x7ff364156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 --2- 172.21.15.84:0/694384785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3640cd8f0 0x7ff36406a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 >> 172.21.15.84:0/694384785 conn(0x7ff3640cdeb0 msgr2=0x7ff3640ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:14.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 shutdown_connections 2023-08-31T02:01:14.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.448+0000 7ff36958a700 1 -- 172.21.15.84:0/694384785 wait complete. 2023-08-31T02:01:14.442 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-08-31T02:01:14.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T02:01:14.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.588+0000 7f65cd76a700 1 -- 172.21.15.84:0/1405379040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159610 msgr2=0x7f65c80b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:14.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.588+0000 7f65cd76a700 1 --2- 172.21.15.84:0/1405379040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159610 0x7f65c80b24f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f65b80098c0 tx=0x7f65b8009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.589+0000 7f65cd76a700 1 -- 172.21.15.84:0/1405379040 shutdown_connections 2023-08-31T02:01:14.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.589+0000 7f65cd76a700 1 --2- 172.21.15.84:0/1405379040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65c80b2a30 0x7f65c8162e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.589+0000 7f65cd76a700 1 --2- 172.21.15.84:0/1405379040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159610 0x7f65c80b24f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.589+0000 7f65cd76a700 1 -- 172.21.15.84:0/1405379040 >> 172.21.15.84:0/1405379040 conn(0x7f65c80caa20 msgr2=0x7f65c80cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.589+0000 7f65cd76a700 1 -- 172.21.15.84:0/1405379040 shutdown_connections 2023-08-31T02:01:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.589+0000 7f65cd76a700 1 -- 172.21.15.84:0/1405379040 wait complete. 2023-08-31T02:01:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.590+0000 7f65cd76a700 1 Processor -- start 2023-08-31T02:01:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.590+0000 7f65cd76a700 1 -- start start 2023-08-31T02:01:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65cd76a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c80b2a30 0x7f65c814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65cd76a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159230 0x7f65c8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:14.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65cd76a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65c8159610 0x7f65c81521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:14.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65cd76a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8156920 con 0x7f65c8159230 2023-08-31T02:01:14.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65cd76a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80c2be0 con 0x7f65c80b2a30 2023-08-31T02:01:14.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65cd76a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80c2ec0 con 0x7f65c8159610 2023-08-31T02:01:14.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159230 0x7f65c8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:14.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159230 0x7f65c8155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53620/0 (socket says 172.21.15.84:53620) 2023-08-31T02:01:14.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 -- 172.21.15.84:0/2128728938 learned_addr learned my addr 172.21.15.84:0/2128728938 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:14.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c6ffd700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c80b2a30 0x7f65c814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:14.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c77fe700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65c8159610 0x7f65c81521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:14.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 -- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65c8159610 msgr2=0x7f65c81521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:14.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65c8159610 0x7f65c81521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 -- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c80b2a30 msgr2=0x7f65c814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:14.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c80b2a30 0x7f65c814d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 -- 172.21.15.84:0/2128728938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b8009520 con 0x7f65c8159230 2023-08-31T02:01:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c77fe700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65c8159610 0x7f65c81521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65c67fc700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159230 0x7f65c8155140 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009fd0 tx=0x7f65b8010700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65af7fe700 1 -- 172.21.15.84:0/2128728938 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8004050 con 0x7f65c8159230 2023-08-31T02:01:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65af7fe700 1 -- 172.21.15.84:0/2128728938 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f65b80041b0 con 0x7f65c8159230 2023-08-31T02:01:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c80c31a0 con 0x7f65c8159230 2023-08-31T02:01:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65af7fe700 1 -- 172.21.15.84:0/2128728938 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8004580 con 0x7f65c8159230 2023-08-31T02:01:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.591+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c80c3760 con 0x7f65c8159230 2023-08-31T02:01:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.592+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c804e7c0 con 0x7f65c8159230 2023-08-31T02:01:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.593+0000 7f65af7fe700 1 -- 172.21.15.84:0/2128728938 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f65b8003680 con 0x7f65c8159230 2023-08-31T02:01:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.593+0000 7f65af7fe700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f65b406a0e0 0x7f65b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:14.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.593+0000 7f65af7fe700 1 -- 172.21.15.84:0/2128728938 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f65b8089e80 con 0x7f65c8159230 2023-08-31T02:01:14.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.593+0000 7f65c6ffd700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f65b406a0e0 0x7f65b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:14.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.594+0000 7f65c6ffd700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f65b406a0e0 0x7f65b406c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f65bc000f60 tx=0x7f65bc009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:14.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.598+0000 7f65af7fe700 1 -- 172.21.15.84:0/2128728938 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f65b8055900 con 0x7f65c8159230 2023-08-31T02:01:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.864+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f65c80711f0 con 0x7f65c8159230 2023-08-31T02:01:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.865+0000 7f65af7fe700 1 -- 172.21.15.84:0/2128728938 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f65b8058f20 con 0x7f65c8159230 2023-08-31T02:01:14.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:14.857 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:14.858 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-08-31T02:01:14.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.858 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-08-31T02:01:14.858 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9kcYqEGBAAT31yT0Two/HvnoRwqs1x7Q==", 2023-08-31T02:01:14.859 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.859 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-08-31T02:01:14.859 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-08-31T02:01:14.859 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-08-31T02:01:14.859 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.860 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.860 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-08-31T02:01:14.860 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9kgze0JBAAxPJ/5RcSMGxP62aghLVqzA==", 2023-08-31T02:01:14.861 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.861 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-08-31T02:01:14.861 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-08-31T02:01:14.861 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-08-31T02:01:14.861 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.861 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-08-31T02:01:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9k8azHHxAAbizcLL9oOOwyUybbQJdKTA==", 2023-08-31T02:01:14.863 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.863 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-08-31T02:01:14.863 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-08-31T02:01:14.863 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-08-31T02:01:14.863 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.864 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.865 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-08-31T02:01:14.865 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9kLFgcLBAABLVYfLl7yk/VPk676Opr1Q==", 2023-08-31T02:01:14.865 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.866 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-08-31T02:01:14.866 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-08-31T02:01:14.866 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-08-31T02:01:14.866 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.867 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-08-31T02:01:14.867 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDo8+9kpRAGChAArPBcizwhWLiV7r30xT7Wsg==", 2023-08-31T02:01:14.868 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.868 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-08-31T02:01:14.868 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-08-31T02:01:14.868 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.868 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.869 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-08-31T02:01:14.869 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDr8+9kmxvCCRAA8cJTfgrPkipt502IoSHe/A==", 2023-08-31T02:01:14.870 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.870 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-08-31T02:01:14.870 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-08-31T02:01:14.870 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.870 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.871 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-08-31T02:01:14.871 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDu8+9kTCbDCBAAwyTS7Y+kLpDhe74Tr9WTEg==", 2023-08-31T02:01:14.871 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.872 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-08-31T02:01:14.872 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-08-31T02:01:14.872 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.872 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.873 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-08-31T02:01:14.873 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDx8+9kOuH8BxAAYodBDGc1FFlgFAOzob2U8A==", 2023-08-31T02:01:14.873 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.873 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-08-31T02:01:14.874 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-08-31T02:01:14.874 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.874 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.875 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-08-31T02:01:14.875 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQD18+9koXUMGhAAUyNcLnNcZw4TNgr0NqaeDg==", 2023-08-31T02:01:14.875 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.875 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-08-31T02:01:14.875 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-08-31T02:01:14.876 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.876 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.876 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-08-31T02:01:14.877 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQD48+9kIHUqGRAAt17LBFy+cn6xp5QYNoNm9A==", 2023-08-31T02:01:14.877 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.877 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-08-31T02:01:14.877 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-08-31T02:01:14.878 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.878 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.878 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-08-31T02:01:14.879 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQD78+9kI+JqGBAA5vxoDOrG1W1/cK2Uu3QQ5Q==", 2023-08-31T02:01:14.879 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.879 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-08-31T02:01:14.879 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-08-31T02:01:14.879 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.880 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.880 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-08-31T02:01:14.880 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQD+8+9koaacFxAAp7WuLrhcIarkzCCl1tt+FA==", 2023-08-31T02:01:14.880 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.881 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-08-31T02:01:14.881 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-08-31T02:01:14.881 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.881 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.882 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-08-31T02:01:14.882 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9kFvODMBAAcqtqFr0KcUWEckdfvqYq2A==", 2023-08-31T02:01:14.882 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-08-31T02:01:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-08-31T02:01:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-08-31T02:01:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-08-31T02:01:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.884 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-08-31T02:01:14.884 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9kNcMuNxAAPFy0FCshTdGDjuDLhinO6w==", 2023-08-31T02:01:14.884 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.885 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-08-31T02:01:14.885 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-08-31T02:01:14.885 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-08-31T02:01:14.885 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-08-31T02:01:14.885 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.886 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-08-31T02:01:14.886 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9kbynZMxAAEOZAXuN51Sun4tDXgJHGlw==", 2023-08-31T02:01:14.886 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.887 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-08-31T02:01:14.887 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-08-31T02:01:14.887 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-08-31T02:01:14.887 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-08-31T02:01:14.887 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.888 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-08-31T02:01:14.888 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDl8+9k5RxMARAA42RvYMpm+oOwNO8ZV26DTg==", 2023-08-31T02:01:14.888 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.888 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-08-31T02:01:14.889 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-08-31T02:01:14.889 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-08-31T02:01:14.889 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-08-31T02:01:14.889 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.890 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-08-31T02:01:14.890 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDj8+9kTU4rNBAAqnI/ooNO60kIugS+K7wi0Q==", 2023-08-31T02:01:14.890 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.890 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-08-31T02:01:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-08-31T02:01:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-08-31T02:01:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mds", 2023-08-31T02:01:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAE9O9kdOw7FxAAGNpe3UlGFELmo7MDosOg2Q==", 2023-08-31T02:01:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mds" 2023-08-31T02:01:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mgr", 2023-08-31T02:01:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAE9O9kP/47FxAAnC7z2yUKtyGp6DE79GcBQA==", 2023-08-31T02:01:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-31T02:01:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-osd", 2023-08-31T02:01:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAE9O9kvQo8FxAA+fNGuOSBz5LlIoVBRXfVHw==", 2023-08-31T02:01:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-osd" 2023-08-31T02:01:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd", 2023-08-31T02:01:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAE9O9kYxY8FxAAcCTCOqbKngmBiBkkWJSyLg==", 2023-08-31T02:01:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-31T02:01:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-31T02:01:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAE9O9k7iI8FxAAHo2df0QG+Il2Vd2L/e96sA==", 2023-08-31T02:01:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-31T02:01:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rgw", 2023-08-31T02:01:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAE9O9kSC88FxAAwIoh8rfN3cGBbPOjSCww1w==", 2023-08-31T02:01:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-31T02:01:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-08-31T02:01:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9kkQYjFRAAty+GAiDnmbtlI/VK/K0Wmw==", 2023-08-31T02:01:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-08-31T02:01:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-08-31T02:01:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-08-31T02:01:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDk8+9kA1E3ERAAz9Pxqyp/TUMegLuyvj1+bg==", 2023-08-31T02:01:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-08-31T02:01:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-08-31T02:01:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-08-31T02:01:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-08-31T02:01:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-08-31T02:01:14.905 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f65b406a0e0 msgr2=0x7f65b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f65b406a0e0 0x7f65b406c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f65bc000f60 tx=0x7f65bc009040 comp rx=0 tx=0).stop 2023-08-31T02:01:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159230 msgr2=0x7f65c8155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159230 0x7f65c8155140 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009fd0 tx=0x7f65b8010700 comp rx=0 tx=0).stop 2023-08-31T02:01:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 shutdown_connections 2023-08-31T02:01:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f65b406a0e0 0x7f65b406c5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65c8159610 0x7f65c81521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c80b2a30 0x7f65c814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 --2- 172.21.15.84:0/2128728938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c8159230 0x7f65c8155140 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:14.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 >> 172.21.15.84:0/2128728938 conn(0x7f65c80caa20 msgr2=0x7f65c80c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:14.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 shutdown_connections 2023-08-31T02:01:14.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:14.867+0000 7f65cd76a700 1 -- 172.21.15.84:0/2128728938 wait complete. 2023-08-31T02:01:14.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-31T02:01:15.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.041+0000 7ff3890ca700 1 -- 172.21.15.84:0/2572790373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38406ff20 msgr2=0x7ff3840703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.041+0000 7ff3890ca700 1 --2- 172.21.15.84:0/2572790373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38406ff20 0x7ff3840703d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff3840cd010 tx=0x7ff37c00b380 comp rx=0 tx=0).stop 2023-08-31T02:01:15.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.041+0000 7ff3890ca700 1 -- 172.21.15.84:0/2572790373 shutdown_connections 2023-08-31T02:01:15.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.041+0000 7ff3890ca700 1 --2- 172.21.15.84:0/2572790373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38406ff20 0x7ff3840703d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.041+0000 7ff3890ca700 1 --2- 172.21.15.84:0/2572790373 >> v2:172.21.15.170:3300/0 conn(0x7ff3840b1ab0 0x7ff38415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.041+0000 7ff3890ca700 1 -- 172.21.15.84:0/2572790373 >> 172.21.15.84:0/2572790373 conn(0x7ff3840ca090 msgr2=0x7ff3840ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.041+0000 7ff3890ca700 1 -- 172.21.15.84:0/2572790373 shutdown_connections 2023-08-31T02:01:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.041+0000 7ff3890ca700 1 -- 172.21.15.84:0/2572790373 wait complete. 2023-08-31T02:01:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.043+0000 7ff3890ca700 1 Processor -- start 2023-08-31T02:01:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.043+0000 7ff3890ca700 1 -- start start 2023-08-31T02:01:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.043+0000 7ff3890ca700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff38406ff20 0x7ff38414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.043+0000 7ff3890ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3840b1ab0 0x7ff3841519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff3890ca700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3840b1f90 0x7ff384154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff3890ca700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841502a0 con 0x7ff3840b1ab0 2023-08-31T02:01:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff3890ca700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c7d50 con 0x7ff38406ff20 2023-08-31T02:01:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff3890ca700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c8030 con 0x7ff3840b1f90 2023-08-31T02:01:15.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3840b1ab0 0x7ff3841519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3840b1ab0 0x7ff3841519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53634/0 (socket says 172.21.15.84:53634) 2023-08-31T02:01:15.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 -- 172.21.15.84:0/3047893849 learned_addr learned my addr 172.21.15.84:0/3047893849 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:15.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 -- 172.21.15.84:0/3047893849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3840b1f90 msgr2=0x7ff384154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3840b1f90 0x7ff384154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff382d9d700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff38406ff20 0x7ff38414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 -- 172.21.15.84:0/3047893849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff38406ff20 msgr2=0x7ff38414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff38406ff20 0x7ff38414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 -- 172.21.15.84:0/3047893849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c009d00 con 0x7ff3840b1ab0 2023-08-31T02:01:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff382d9d700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff38406ff20 0x7ff38414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff38259c700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3840b1ab0 0x7ff3841519e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff37400b470 tx=0x7ff37400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff36b7fe700 1 -- 172.21.15.84:0/3047893849 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011830 con 0x7ff3840b1ab0 2023-08-31T02:01:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff36b7fe700 1 -- 172.21.15.84:0/3047893849 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff374011a80 con 0x7ff3840b1ab0 2023-08-31T02:01:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3840c8310 con 0x7ff3840b1ab0 2023-08-31T02:01:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff36b7fe700 1 -- 172.21.15.84:0/3047893849 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011e90 con 0x7ff3840b1ab0 2023-08-31T02:01:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.044+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff384153e20 con 0x7ff3840b1ab0 2023-08-31T02:01:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.045+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3840c8830 con 0x7ff3840b1ab0 2023-08-31T02:01:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.046+0000 7ff36b7fe700 1 -- 172.21.15.84:0/3047893849 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff37401a400 con 0x7ff3840b1ab0 2023-08-31T02:01:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.046+0000 7ff36b7fe700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff37006a0e0 0x7ff37006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.046+0000 7ff382d9d700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff37006a0e0 0x7ff37006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.046+0000 7ff36b7fe700 1 -- 172.21.15.84:0/3047893849 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff374088490 con 0x7ff3840b1ab0 2023-08-31T02:01:15.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.047+0000 7ff382d9d700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff37006a0e0 0x7ff37006c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff3780058f0 tx=0x7ff378005db0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:15.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.051+0000 7ff36b7fe700 1 -- 172.21.15.84:0/3047893849 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff3840c8830 con 0x7ff3840b1ab0 2023-08-31T02:01:15.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.321+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff3840c8830 con 0x7ff3840b1ab0 2023-08-31T02:01:15.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.325+0000 7ff36b7fe700 1 -- 172.21.15.84:0/3047893849 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff3840c8830 con 0x7ff3840b1ab0 2023-08-31T02:01:15.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff37006a0e0 msgr2=0x7ff37006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff37006a0e0 0x7ff37006c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff3780058f0 tx=0x7ff378005db0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3840b1ab0 msgr2=0x7ff3841519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3840b1ab0 0x7ff3841519e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff37400b470 tx=0x7ff37400b830 comp rx=0 tx=0).stop 2023-08-31T02:01:15.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 shutdown_connections 2023-08-31T02:01:15.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff37006a0e0 0x7ff37006c5a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3840b1f90 0x7ff384154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff38406ff20 0x7ff38414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 --2- 172.21.15.84:0/3047893849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3840b1ab0 0x7ff3841519e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 >> 172.21.15.84:0/3047893849 conn(0x7ff3840ca090 msgr2=0x7ff384158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:15.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 shutdown_connections 2023-08-31T02:01:15.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.327+0000 7ff3890ca700 1 -- 172.21.15.84:0/3047893849 wait complete. 2023-08-31T02:01:15.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-31T02:01:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.464+0000 7f9a502df700 1 -- 172.21.15.84:0/170456070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a480ccae0 msgr2=0x7f9a480ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.464+0000 7f9a502df700 1 --2- 172.21.15.84:0/170456070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a480ccae0 0x7f9a480ccef0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9a480c19e0 tx=0x7f9a4000b380 comp rx=0 tx=0).stop 2023-08-31T02:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.464+0000 7f9a502df700 1 -- 172.21.15.84:0/170456070 shutdown_connections 2023-08-31T02:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.464+0000 7f9a502df700 1 --2- 172.21.15.84:0/170456070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a480ccae0 0x7f9a480ccef0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.464+0000 7f9a502df700 1 --2- 172.21.15.84:0/170456070 >> v2:172.21.15.170:3300/0 conn(0x7f9a48158460 0x7f9a480b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.464+0000 7f9a502df700 1 -- 172.21.15.84:0/170456070 >> 172.21.15.84:0/170456070 conn(0x7f9a48070860 msgr2=0x7f9a48070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.464+0000 7f9a502df700 1 -- 172.21.15.84:0/170456070 shutdown_connections 2023-08-31T02:01:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.464+0000 7f9a502df700 1 -- 172.21.15.84:0/170456070 wait complete. 2023-08-31T02:01:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.465+0000 7f9a502df700 1 Processor -- start 2023-08-31T02:01:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.465+0000 7f9a502df700 1 -- start start 2023-08-31T02:01:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a502df700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a480ccae0 0x7f9a48150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a502df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a48158080 0x7f9a48159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a502df700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a48158460 0x7f9a4815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a502df700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a48158af0 con 0x7f9a48158080 2023-08-31T02:01:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a502df700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a48158dd0 con 0x7f9a48158460 2023-08-31T02:01:15.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a502df700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a481590b0 con 0x7f9a480ccae0 2023-08-31T02:01:15.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4d87a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a48158080 0x7f9a48159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4d87a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a48158080 0x7f9a48159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53650/0 (socket says 172.21.15.84:53650) 2023-08-31T02:01:15.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4d87a700 1 -- 172.21.15.84:0/244758652 learned_addr learned my addr 172.21.15.84:0/244758652 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:15.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4e07b700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a480ccae0 0x7f9a48150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4e87c700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a48158460 0x7f9a4815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4d87a700 1 -- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a480ccae0 msgr2=0x7f9a48150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4d87a700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a480ccae0 0x7f9a48150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4d87a700 1 -- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a48158460 msgr2=0x7f9a4815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4d87a700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a48158460 0x7f9a4815a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4d87a700 1 -- 172.21.15.84:0/244758652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40009d00 con 0x7f9a48158080 2023-08-31T02:01:15.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.466+0000 7f9a4e87c700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a48158460 0x7f9a4815a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:15.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.467+0000 7f9a4d87a700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a48158080 0x7f9a48159b90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400c970 tx=0x7f9a4400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:15.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.467+0000 7f9a3effd700 1 -- 172.21.15.84:0/244758652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44007b00 con 0x7f9a48158080 2023-08-31T02:01:15.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.467+0000 7f9a3effd700 1 -- 172.21.15.84:0/244758652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9a44007c60 con 0x7f9a48158080 2023-08-31T02:01:15.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.467+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a48159390 con 0x7f9a48158080 2023-08-31T02:01:15.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.467+0000 7f9a3effd700 1 -- 172.21.15.84:0/244758652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44004a90 con 0x7f9a48158080 2023-08-31T02:01:15.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.467+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a480c3560 con 0x7f9a48158080 2023-08-31T02:01:15.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.468+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a481598b0 con 0x7f9a48158080 2023-08-31T02:01:15.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.468+0000 7f9a3effd700 1 -- 172.21.15.84:0/244758652 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a44004bf0 con 0x7f9a48158080 2023-08-31T02:01:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.468+0000 7f9a3effd700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9a2c06a0e0 0x7f9a2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.469+0000 7f9a3effd700 1 -- 172.21.15.84:0/244758652 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9a440885a0 con 0x7f9a48158080 2023-08-31T02:01:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.469+0000 7f9a4e07b700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9a2c06a0e0 0x7f9a2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.469+0000 7f9a4e07b700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9a2c06a0e0 0x7f9a2c06c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9a38001730 tx=0x7f9a38009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:15.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.473+0000 7f9a3effd700 1 -- 172.21.15.84:0/244758652 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9a481598b0 con 0x7f9a48158080 2023-08-31T02:01:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.740+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9a481598b0 con 0x7f9a48158080 2023-08-31T02:01:15.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.743+0000 7f9a3effd700 1 -- 172.21.15.84:0/244758652 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9a481598b0 con 0x7f9a48158080 2023-08-31T02:01:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9a2c06a0e0 msgr2=0x7f9a2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9a2c06a0e0 0x7f9a2c06c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9a38001730 tx=0x7f9a38009040 comp rx=0 tx=0).stop 2023-08-31T02:01:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a48158080 msgr2=0x7f9a48159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a48158080 0x7f9a48159b90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400c970 tx=0x7f9a4400cd30 comp rx=0 tx=0).stop 2023-08-31T02:01:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 shutdown_connections 2023-08-31T02:01:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9a2c06a0e0 0x7f9a2c06c5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a48158460 0x7f9a4815a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a480ccae0 0x7f9a48150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 --2- 172.21.15.84:0/244758652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a48158080 0x7f9a48159b90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 >> 172.21.15.84:0/244758652 conn(0x7f9a48070860 msgr2=0x7f9a480c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 shutdown_connections 2023-08-31T02:01:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.746+0000 7f9a502df700 1 -- 172.21.15.84:0/244758652 wait complete. 2023-08-31T02:01:15.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-31T02:01:15.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.881+0000 7fe5c21ba700 1 -- 172.21.15.84:0/3263626146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4004850 msgr2=0x7fe5a4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.881+0000 7fe5c21ba700 1 --2- 172.21.15.84:0/3263626146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4004850 0x7fe5a4004cd0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac001870 tx=0x7fe5a4005880 comp rx=0 tx=0).stop 2023-08-31T02:01:15.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.881+0000 7fe5c21ba700 1 -- 172.21.15.84:0/3263626146 shutdown_connections 2023-08-31T02:01:15.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.881+0000 7fe5c21ba700 1 --2- 172.21.15.84:0/3263626146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4004850 0x7fe5a4004cd0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.881+0000 7fe5c21ba700 1 -- 172.21.15.84:0/3263626146 >> 172.21.15.84:0/3263626146 conn(0x7fe5bc0cdeb0 msgr2=0x7fe5bc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:15.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.881+0000 7fe5c21ba700 1 -- 172.21.15.84:0/3263626146 shutdown_connections 2023-08-31T02:01:15.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.881+0000 7fe5c21ba700 1 -- 172.21.15.84:0/3263626146 wait complete. 2023-08-31T02:01:15.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.882+0000 7fe5c21ba700 1 Processor -- start 2023-08-31T02:01:15.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.883+0000 7fe5c21ba700 1 -- start start 2023-08-31T02:01:15.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.883+0000 7fe5c21ba700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a4004850 0x7fe5bc06a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.883+0000 7fe5c21ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc158b90 0x7fe5bc156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.883+0000 7fe5c21ba700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc1ef2c0 0x7fe5bc0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.883+0000 7fe5c21ba700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc157fc0 con 0x7fe5bc158b90 2023-08-31T02:01:15.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.883+0000 7fe5c21ba700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc157720 con 0x7fe5a4004850 2023-08-31T02:01:15.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.883+0000 7fe5c21ba700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc157a00 con 0x7fe5bc1ef2c0 2023-08-31T02:01:15.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc158b90 0x7fe5bc156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc158b90 0x7fe5bc156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53670/0 (socket says 172.21.15.84:53670) 2023-08-31T02:01:15.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 -- 172.21.15.84:0/1084910217 learned_addr learned my addr 172.21.15.84:0/1084910217 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:15.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5bbfff700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc1ef2c0 0x7fe5bc0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5bb7fe700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a4004850 0x7fe5bc06a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 -- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc1ef2c0 msgr2=0x7fe5bc0c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc1ef2c0 0x7fe5bc0c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 -- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a4004850 msgr2=0x7fe5bc06a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:15.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a4004850 0x7fe5bc06a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:15.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 -- 172.21.15.84:0/1084910217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc157ce0 con 0x7fe5bc158b90 2023-08-31T02:01:15.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5bb7fe700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a4004850 0x7fe5bc06a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:15.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5baffd700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc158b90 0x7fe5bc156ef0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac000c00 tx=0x7fe5ac003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:15.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5a3fff700 1 -- 172.21.15.84:0/1084910217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac015070 con 0x7fe5bc158b90 2023-08-31T02:01:15.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5a3fff700 1 -- 172.21.15.84:0/1084910217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5ac003e50 con 0x7fe5bc158b90 2023-08-31T02:01:15.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc154700 con 0x7fe5bc158b90 2023-08-31T02:01:15.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5a3fff700 1 -- 172.21.15.84:0/1084910217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00c5a0 con 0x7fe5bc158b90 2023-08-31T02:01:15.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.884+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc1ef740 con 0x7fe5bc158b90 2023-08-31T02:01:15.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.885+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc154a70 con 0x7fe5bc158b90 2023-08-31T02:01:15.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.886+0000 7fe5a3fff700 1 -- 172.21.15.84:0/1084910217 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe5ac00c700 con 0x7fe5bc158b90 2023-08-31T02:01:15.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.886+0000 7fe5a3fff700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe5a806a0e0 0x7fe5a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:15.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.886+0000 7fe5a3fff700 1 -- 172.21.15.84:0/1084910217 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe5ac0895a0 con 0x7fe5bc158b90 2023-08-31T02:01:15.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.886+0000 7fe5bb7fe700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe5a806a0e0 0x7fe5a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:15.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.886+0000 7fe5bb7fe700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe5a806a0e0 0x7fe5a806c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009b90 tx=0x7fe5b0009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:15.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:15.890+0000 7fe5a3fff700 1 -- 172.21.15.84:0/1084910217 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe5ac055020 con 0x7fe5bc158b90 2023-08-31T02:01:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.159+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe5bc1ef960 con 0x7fe5bc158b90 2023-08-31T02:01:16.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.163+0000 7fe5a3fff700 1 -- 172.21.15.84:0/1084910217 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5ac058640 con 0x7fe5bc158b90 2023-08-31T02:01:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe5a806a0e0 msgr2=0x7fe5a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe5a806a0e0 0x7fe5a806c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009b90 tx=0x7fe5b0009260 comp rx=0 tx=0).stop 2023-08-31T02:01:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc158b90 msgr2=0x7fe5bc156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc158b90 0x7fe5bc156ef0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac000c00 tx=0x7fe5ac003930 comp rx=0 tx=0).stop 2023-08-31T02:01:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 shutdown_connections 2023-08-31T02:01:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe5a806a0e0 0x7fe5a806c5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5bc1ef2c0 0x7fe5bc0c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a4004850 0x7fe5bc06a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 --2- 172.21.15.84:0/1084910217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc158b90 0x7fe5bc156ef0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 >> 172.21.15.84:0/1084910217 conn(0x7fe5bc0cdeb0 msgr2=0x7fe5bc0c5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 shutdown_connections 2023-08-31T02:01:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.165+0000 7fe5c21ba700 1 -- 172.21.15.84:0/1084910217 wait complete. 2023-08-31T02:01:16.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-31T02:01:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.301+0000 7faa1a5bd700 1 -- 172.21.15.84:0/3181650052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9fc004850 msgr2=0x7fa9fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.301+0000 7faa1a5bd700 1 --2- 172.21.15.84:0/3181650052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9fc004850 0x7fa9fc004cd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faa04009be0 tx=0x7fa9fc005880 comp rx=0 tx=0).stop 2023-08-31T02:01:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.302+0000 7faa18b5a700 1 -- 172.21.15.84:0/3181650052 reap_dead start 2023-08-31T02:01:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.302+0000 7faa1a5bd700 1 -- 172.21.15.84:0/3181650052 shutdown_connections 2023-08-31T02:01:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.302+0000 7faa1a5bd700 1 -- 172.21.15.84:0/3181650052 >> 172.21.15.84:0/3181650052 conn(0x7faa14069b80 msgr2=0x7faa14069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:16.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.302+0000 7faa1a5bd700 1 -- 172.21.15.84:0/3181650052 shutdown_connections 2023-08-31T02:01:16.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.302+0000 7faa1a5bd700 1 -- 172.21.15.84:0/3181650052 wait complete. 2023-08-31T02:01:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.303+0000 7faa1a5bd700 1 Processor -- start 2023-08-31T02:01:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.303+0000 7faa1a5bd700 1 -- start start 2023-08-31T02:01:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa1a5bd700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9fc004850 0x7faa141e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa1a5bd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa140c89b0 0x7faa14153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa1a5bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa140c73f0 0x7faa140c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa1a5bd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140c6100 con 0x7faa140c73f0 2023-08-31T02:01:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa1a5bd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140c6350 con 0x7faa140c89b0 2023-08-31T02:01:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa1a5bd700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa140c6630 con 0x7fa9fc004850 2023-08-31T02:01:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa140c73f0 0x7faa140c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa140c73f0 0x7faa140c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53692/0 (socket says 172.21.15.84:53692) 2023-08-31T02:01:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 -- 172.21.15.84:0/160695585 learned_addr learned my addr 172.21.15.84:0/160695585 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa13fff700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9fc004850 0x7faa141e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa137fe700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa140c89b0 0x7faa14153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 -- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9fc004850 msgr2=0x7faa141e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9fc004850 0x7faa141e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 -- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa140c89b0 msgr2=0x7faa14153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa140c89b0 0x7faa14153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 -- 172.21.15.84:0/160695585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa140c6910 con 0x7faa140c73f0 2023-08-31T02:01:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa137fe700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa140c89b0 0x7faa14153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa18b5a700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa140c73f0 0x7faa140c7870 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faa140717e0 tx=0x7faa0c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa10ff9700 1 -- 172.21.15.84:0/160695585 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00e050 con 0x7faa140c73f0 2023-08-31T02:01:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa10ff9700 1 -- 172.21.15.84:0/160695585 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faa0c00f040 con 0x7faa140c73f0 2023-08-31T02:01:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa140c6bf0 con 0x7faa140c73f0 2023-08-31T02:01:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.304+0000 7faa10ff9700 1 -- 172.21.15.84:0/160695585 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c010cb0 con 0x7faa140c73f0 2023-08-31T02:01:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.305+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa14153c60 con 0x7faa140c73f0 2023-08-31T02:01:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.305+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1404e7c0 con 0x7faa140c73f0 2023-08-31T02:01:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.306+0000 7faa10ff9700 1 -- 172.21.15.84:0/160695585 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faa0c021460 con 0x7faa140c73f0 2023-08-31T02:01:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.306+0000 7faa10ff9700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faa0006a0e0 0x7faa0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.306+0000 7faa10ff9700 1 -- 172.21.15.84:0/160695585 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7faa0c0887f0 con 0x7faa140c73f0 2023-08-31T02:01:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.306+0000 7faa13fff700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faa0006a0e0 0x7faa0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.307+0000 7faa13fff700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faa0006a0e0 0x7faa0006c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa08006c00 tx=0x7faa080067b0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.311+0000 7faa10ff9700 1 -- 172.21.15.84:0/160695585 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faa0c0541e0 con 0x7faa140c73f0 2023-08-31T02:01:16.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.577+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7faa140b04a0 con 0x7faa140c73f0 2023-08-31T02:01:16.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.581+0000 7faa10ff9700 1 -- 172.21.15.84:0/160695585 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7faa0c057800 con 0x7faa140c73f0 2023-08-31T02:01:16.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.582+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faa0006a0e0 msgr2=0x7faa0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faa0006a0e0 0x7faa0006c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa08006c00 tx=0x7faa080067b0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa140c73f0 msgr2=0x7faa140c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa140c73f0 0x7faa140c7870 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faa140717e0 tx=0x7faa0c007d80 comp rx=0 tx=0).stop 2023-08-31T02:01:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 shutdown_connections 2023-08-31T02:01:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faa0006a0e0 0x7faa0006c5a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa140c73f0 0x7faa140c7870 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9fc004850 0x7faa141e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 --2- 172.21.15.84:0/160695585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa140c89b0 0x7faa14153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 >> 172.21.15.84:0/160695585 conn(0x7faa14069b80 msgr2=0x7faa14157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 shutdown_connections 2023-08-31T02:01:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.583+0000 7faa1a5bd700 1 -- 172.21.15.84:0/160695585 wait complete. 2023-08-31T02:01:16.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-31T02:01:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.718+0000 7fb6570ea700 1 -- 172.21.15.84:0/2259814092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb640003bc0 msgr2=0x7fb640003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.718+0000 7fb6570ea700 1 --2- 172.21.15.84:0/2259814092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb640003bc0 0x7fb640003fc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb644006f50 tx=0x7fb640005880 comp rx=0 tx=0).stop 2023-08-31T02:01:16.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.718+0000 7fb655687700 1 -- 172.21.15.84:0/2259814092 reap_dead start 2023-08-31T02:01:16.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.718+0000 7fb6570ea700 1 -- 172.21.15.84:0/2259814092 shutdown_connections 2023-08-31T02:01:16.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.718+0000 7fb6570ea700 1 -- 172.21.15.84:0/2259814092 >> 172.21.15.84:0/2259814092 conn(0x7fb650069b80 msgr2=0x7fb650069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:16.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.718+0000 7fb6570ea700 1 -- 172.21.15.84:0/2259814092 shutdown_connections 2023-08-31T02:01:16.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.718+0000 7fb6570ea700 1 -- 172.21.15.84:0/2259814092 wait complete. 2023-08-31T02:01:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.720+0000 7fb6570ea700 1 Processor -- start 2023-08-31T02:01:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.720+0000 7fb6570ea700 1 -- start start 2023-08-31T02:01:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb6570ea700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb640003bc0 0x7fb6501e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb6570ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6501e2fc0 0x7fb6500c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb6570ea700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6500c3080 0x7fb65013e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:16.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb6570ea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500c3530 con 0x7fb6501e2fc0 2023-08-31T02:01:16.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb6570ea700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65013a1b0 con 0x7fb640003bc0 2023-08-31T02:01:16.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb6570ea700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6501e3460 con 0x7fb6500c3080 2023-08-31T02:01:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb64ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6501e2fc0 0x7fb6500c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb64ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6501e2fc0 0x7fb6500c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53710/0 (socket says 172.21.15.84:53710) 2023-08-31T02:01:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb64ffff700 1 -- 172.21.15.84:0/2709325306 learned_addr learned my addr 172.21.15.84:0/2709325306 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb654e86700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb640003bc0 0x7fb6501e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb655687700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6500c3080 0x7fb65013e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb64ffff700 1 -- 172.21.15.84:0/2709325306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6500c3080 msgr2=0x7fb65013e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb64ffff700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6500c3080 0x7fb65013e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb64ffff700 1 -- 172.21.15.84:0/2709325306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb640003bc0 msgr2=0x7fb6501e2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.721+0000 7fb64ffff700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb640003bc0 0x7fb6501e2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.722+0000 7fb64ffff700 1 -- 172.21.15.84:0/2709325306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6501e3740 con 0x7fb6501e2fc0 2023-08-31T02:01:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.722+0000 7fb64ffff700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6501e2fc0 0x7fb6500c2b40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c001680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.722+0000 7fb64d7fa700 1 -- 172.21.15.84:0/2709325306 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c011630 con 0x7fb6501e2fc0 2023-08-31T02:01:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.722+0000 7fb64d7fa700 1 -- 172.21.15.84:0/2709325306 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb63c011790 con 0x7fb6501e2fc0 2023-08-31T02:01:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.722+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6501e3a20 con 0x7fb6501e2fc0 2023-08-31T02:01:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.722+0000 7fb64d7fa700 1 -- 172.21.15.84:0/2709325306 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c011ba0 con 0x7fb6501e2fc0 2023-08-31T02:01:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.722+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6501e3fe0 con 0x7fb6501e2fc0 2023-08-31T02:01:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.723+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65004e7c0 con 0x7fb6501e2fc0 2023-08-31T02:01:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.723+0000 7fb64d7fa700 1 -- 172.21.15.84:0/2709325306 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb63c011d00 con 0x7fb6501e2fc0 2023-08-31T02:01:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.723+0000 7fb64d7fa700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb63406a0e0 0x7fb63406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.724+0000 7fb64d7fa700 1 -- 172.21.15.84:0/2709325306 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb63c089000 con 0x7fb6501e2fc0 2023-08-31T02:01:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.724+0000 7fb654e86700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb63406a0e0 0x7fb63406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.724+0000 7fb654e86700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb63406a0e0 0x7fb63406c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb644012040 tx=0x7fb64400f000 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:16.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.728+0000 7fb64d7fa700 1 -- 172.21.15.84:0/2709325306 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb63c0549f0 con 0x7fb6501e2fc0 2023-08-31T02:01:16.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:16.997+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb6500c9fd0 con 0x7fb6501e2fc0 2023-08-31T02:01:16.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.000+0000 7fb64d7fa700 1 -- 172.21.15.84:0/2709325306 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb63c0150a0 con 0x7fb6501e2fc0 2023-08-31T02:01:16.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.002+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb63406a0e0 msgr2=0x7fb63406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.002+0000 7fb6570ea700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb63406a0e0 0x7fb63406c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb644012040 tx=0x7fb64400f000 comp rx=0 tx=0).stop 2023-08-31T02:01:16.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6501e2fc0 msgr2=0x7fb6500c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:16.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6501e2fc0 0x7fb6500c2b40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c001680 comp rx=0 tx=0).stop 2023-08-31T02:01:16.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 shutdown_connections 2023-08-31T02:01:16.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb63406a0e0 0x7fb63406c5a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6500c3080 0x7fb65013e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb640003bc0 0x7fb6501e2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 --2- 172.21.15.84:0/2709325306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6501e2fc0 0x7fb6500c2b40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:16.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 >> 172.21.15.84:0/2709325306 conn(0x7fb650069b80 msgr2=0x7fb650157130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:16.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 shutdown_connections 2023-08-31T02:01:16.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.003+0000 7fb6570ea700 1 -- 172.21.15.84:0/2709325306 wait complete. 2023-08-31T02:01:17.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-31T02:01:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 -- 172.21.15.84:0/1989093664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415eb90 msgr2=0x7fdda40699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 --2- 172.21.15.84:0/1989093664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415eb90 0x7fdda40699a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdda40b3cc0 tx=0x7fdd9c00b380 comp rx=0 tx=0).stop 2023-08-31T02:01:17.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 -- 172.21.15.84:0/1989093664 shutdown_connections 2023-08-31T02:01:17.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 --2- 172.21.15.84:0/1989093664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415eb90 0x7fdda40699a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 --2- 172.21.15.84:0/1989093664 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdda415f4b0 0x7fdda415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 --2- 172.21.15.84:0/1989093664 >> v2:172.21.15.170:3300/0 conn(0x7fdda415fdd0 0x7fdda415e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 -- 172.21.15.84:0/1989093664 >> 172.21.15.84:0/1989093664 conn(0x7fdda40d11c0 msgr2=0x7fdda40d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 -- 172.21.15.84:0/1989093664 shutdown_connections 2023-08-31T02:01:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.137+0000 7fdda9509700 1 -- 172.21.15.84:0/1989093664 wait complete. 2023-08-31T02:01:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.138+0000 7fdda9509700 1 Processor -- start 2023-08-31T02:01:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.138+0000 7fdda9509700 1 -- start start 2023-08-31T02:01:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda9509700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdda415eb90 0x7fdda4154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda9509700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415f4b0 0x7fdda4159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda9509700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda415fdd0 0x7fdda41f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda9509700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda4155190 con 0x7fdda415f4b0 2023-08-31T02:01:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda9509700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda415a300 con 0x7fdda415fdd0 2023-08-31T02:01:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda9509700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda415a5e0 con 0x7fdda415eb90 2023-08-31T02:01:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415f4b0 0x7fdda4159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415f4b0 0x7fdda4159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53724/0 (socket says 172.21.15.84:53724) 2023-08-31T02:01:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda27fc700 1 -- 172.21.15.84:0/1183608434 learned_addr learned my addr 172.21.15.84:0/1183608434 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.139+0000 7fdda2ffd700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdda415eb90 0x7fdda4154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda37fe700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda415fdd0 0x7fdda41f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda27fc700 1 -- 172.21.15.84:0/1183608434 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdda415eb90 msgr2=0x7fdda4154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda27fc700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdda415eb90 0x7fdda4154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda27fc700 1 -- 172.21.15.84:0/1183608434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda415fdd0 msgr2=0x7fdda41f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda27fc700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda415fdd0 0x7fdda41f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda27fc700 1 -- 172.21.15.84:0/1183608434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c009d00 con 0x7fdda415f4b0 2023-08-31T02:01:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda27fc700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415f4b0 0x7fdda4159ab0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400d950 tx=0x7fdd9400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdd8b7fe700 1 -- 172.21.15.84:0/1183608434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94009930 con 0x7fdda415f4b0 2023-08-31T02:01:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdd8b7fe700 1 -- 172.21.15.84:0/1183608434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdd94009b80 con 0x7fdda415f4b0 2023-08-31T02:01:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda415a8c0 con 0x7fdda415f4b0 2023-08-31T02:01:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdd8b7fe700 1 -- 172.21.15.84:0/1183608434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94010460 con 0x7fdda415f4b0 2023-08-31T02:01:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.140+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda415ae80 con 0x7fdda415f4b0 2023-08-31T02:01:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.141+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda415b040 con 0x7fdda415f4b0 2023-08-31T02:01:17.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.141+0000 7fdd8b7fe700 1 -- 172.21.15.84:0/1183608434 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdd940105c0 con 0x7fdda415f4b0 2023-08-31T02:01:17.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.142+0000 7fdd8b7fe700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdd9006a0e0 0x7fdd9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.142+0000 7fdd8b7fe700 1 -- 172.21.15.84:0/1183608434 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdd94088550 con 0x7fdda415f4b0 2023-08-31T02:01:17.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.142+0000 7fdda2ffd700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdd9006a0e0 0x7fdd9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.142+0000 7fdda2ffd700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdd9006a0e0 0x7fdd9006c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009b70 tx=0x7fdd98009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:17.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.146+0000 7fdd8b7fe700 1 -- 172.21.15.84:0/1183608434 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdd94057ad0 con 0x7fdda415f4b0 2023-08-31T02:01:17.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.416+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdda404e7c0 con 0x7fdda415f4b0 2023-08-31T02:01:17.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.419+0000 7fdd8b7fe700 1 -- 172.21.15.84:0/1183608434 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdd94057660 con 0x7fdda415f4b0 2023-08-31T02:01:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdd9006a0e0 msgr2=0x7fdd9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdd9006a0e0 0x7fdd9006c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009b70 tx=0x7fdd98009260 comp rx=0 tx=0).stop 2023-08-31T02:01:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415f4b0 msgr2=0x7fdda4159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415f4b0 0x7fdda4159ab0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400d950 tx=0x7fdd9400dd10 comp rx=0 tx=0).stop 2023-08-31T02:01:17.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 shutdown_connections 2023-08-31T02:01:17.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fdd9006a0e0 0x7fdd9006c5a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda415fdd0 0x7fdda41f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdda415eb90 0x7fdda4154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 --2- 172.21.15.84:0/1183608434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda415f4b0 0x7fdda4159ab0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 >> 172.21.15.84:0/1183608434 conn(0x7fdda40d11c0 msgr2=0x7fdda415d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:17.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 shutdown_connections 2023-08-31T02:01:17.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.422+0000 7fdda9509700 1 -- 172.21.15.84:0/1183608434 wait complete. 2023-08-31T02:01:17.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.556+0000 7fc8390dd700 1 -- 172.21.15.84:0/4136900679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 msgr2=0x7fc8340cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.556+0000 7fc8390dd700 1 --2- 172.21.15.84:0/4136900679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 0x7fc8340cc920 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc8340cd570 tx=0x7fc824009ba0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.556+0000 7fc8390dd700 1 -- 172.21.15.84:0/4136900679 shutdown_connections 2023-08-31T02:01:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.556+0000 7fc8390dd700 1 --2- 172.21.15.84:0/4136900679 >> v2:172.21.15.170:3300/0 conn(0x7fc8340707c0 0x7fc834070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.556+0000 7fc8390dd700 1 --2- 172.21.15.84:0/4136900679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 0x7fc8340cc920 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.556+0000 7fc8390dd700 1 -- 172.21.15.84:0/4136900679 >> 172.21.15.84:0/4136900679 conn(0x7fc8340caa20 msgr2=0x7fc8340cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.556+0000 7fc8390dd700 1 -- 172.21.15.84:0/4136900679 shutdown_connections 2023-08-31T02:01:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.556+0000 7fc8390dd700 1 -- 172.21.15.84:0/4136900679 wait complete. 2023-08-31T02:01:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.558+0000 7fc8390dd700 1 Processor -- start 2023-08-31T02:01:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.558+0000 7fc8390dd700 1 -- start start 2023-08-31T02:01:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc8390dd700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8340707c0 0x7fc8341567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc8390dd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340b0df0 0x7fc83406a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc8390dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 0x7fc83406a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc8390dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834151f40 con 0x7fc834158220 2023-08-31T02:01:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc8390dd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83413d250 con 0x7fc8340b0df0 2023-08-31T02:01:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc8390dd700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83413d530 con 0x7fc8340707c0 2023-08-31T02:01:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 0x7fc83406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 0x7fc83406a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53740/0 (socket says 172.21.15.84:53740) 2023-08-31T02:01:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 -- 172.21.15.84:0/2909757822 learned_addr learned my addr 172.21.15.84:0/2909757822 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc832d9d700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8340707c0 0x7fc8341567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83259c700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340b0df0 0x7fc83406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 -- 172.21.15.84:0/2909757822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8340707c0 msgr2=0x7fc8341567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8340707c0 0x7fc8341567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 -- 172.21.15.84:0/2909757822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340b0df0 msgr2=0x7fc83406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340b0df0 0x7fc83406a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 -- 172.21.15.84:0/2909757822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824009520 con 0x7fc834158220 2023-08-31T02:01:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc83359e700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 0x7fc83406a770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc82c007ee0 tx=0x7fc82c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc82b7fe700 1 -- 172.21.15.84:0/2909757822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c017070 con 0x7fc834158220 2023-08-31T02:01:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc82b7fe700 1 -- 172.21.15.84:0/2909757822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc82c00f040 con 0x7fc834158220 2023-08-31T02:01:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83413d810 con 0x7fc834158220 2023-08-31T02:01:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc82b7fe700 1 -- 172.21.15.84:0/2909757822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00de10 con 0x7fc834158220 2023-08-31T02:01:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.559+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc834151c30 con 0x7fc834158220 2023-08-31T02:01:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.560+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc834152140 con 0x7fc834158220 2023-08-31T02:01:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.561+0000 7fc82b7fe700 1 -- 172.21.15.84:0/2909757822 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc82c01c410 con 0x7fc834158220 2023-08-31T02:01:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.561+0000 7fc82b7fe700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc81406a0e0 0x7fc81406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.561+0000 7fc82b7fe700 1 -- 172.21.15.84:0/2909757822 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc82c088030 con 0x7fc834158220 2023-08-31T02:01:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.561+0000 7fc832d9d700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc81406a0e0 0x7fc81406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.562+0000 7fc832d9d700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc81406a0e0 0x7fc81406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc824000c00 tx=0x7fc82400b040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.566+0000 7fc82b7fe700 1 -- 172.21.15.84:0/2909757822 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc834152140 con 0x7fc834158220 2023-08-31T02:01:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.759+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc834152110 con 0x7fc834158220 2023-08-31T02:01:17.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.760+0000 7fc82b7fe700 1 -- 172.21.15.84:0/2909757822 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13038 (secure 0 0 0) 0x7fc82c057430 con 0x7fc834158220 2023-08-31T02:01:17.752 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:17.752 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:14.448905+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc81406a0e0 msgr2=0x7fc81406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc81406a0e0 0x7fc81406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc824000c00 tx=0x7fc82400b040 comp rx=0 tx=0).stop 2023-08-31T02:01:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 msgr2=0x7fc83406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 0x7fc83406a770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc82c007ee0 tx=0x7fc82c00d3b0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 shutdown_connections 2023-08-31T02:01:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc81406a0e0 0x7fc81406c5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc834158220 0x7fc83406a770 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8340707c0 0x7fc8341567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 --2- 172.21.15.84:0/2909757822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340b0df0 0x7fc83406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 >> 172.21.15.84:0/2909757822 conn(0x7fc8340caa20 msgr2=0x7fc8340b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 shutdown_connections 2023-08-31T02:01:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.762+0000 7fc8390dd700 1 -- 172.21.15.84:0/2909757822 wait complete. 2023-08-31T02:01:17.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T02:01:17.767 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:01:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.901+0000 7f94b0af3700 1 -- 172.21.15.84:0/953968100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ac1593b0 msgr2=0x7f94ac0b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.901+0000 7f94b0af3700 1 --2- 172.21.15.84:0/953968100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ac1593b0 0x7f94ac0b0620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f94a00098c0 tx=0x7f94a0009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.901+0000 7f94b0af3700 1 -- 172.21.15.84:0/953968100 shutdown_connections 2023-08-31T02:01:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.901+0000 7f94b0af3700 1 --2- 172.21.15.84:0/953968100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94ac0b23e0 0x7f94ac0b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.901+0000 7f94b0af3700 1 --2- 172.21.15.84:0/953968100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ac1593b0 0x7f94ac0b0620 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.901+0000 7f94b0af3700 1 -- 172.21.15.84:0/953968100 >> 172.21.15.84:0/953968100 conn(0x7f94ac0afb00 msgr2=0x7f94ac0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.901+0000 7f94b0af3700 1 -- 172.21.15.84:0/953968100 shutdown_connections 2023-08-31T02:01:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.901+0000 7f94b0af3700 1 -- 172.21.15.84:0/953968100 wait complete. 2023-08-31T02:01:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.902+0000 7f94b0af3700 1 Processor -- start 2023-08-31T02:01:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.902+0000 7f94b0af3700 1 -- start start 2023-08-31T02:01:17.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94b0af3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ac06db90 0x7f94ac06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94b0af3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94ac0b23e0 0x7f94ac1e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94b0af3700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94ac1593b0 0x7f94ac1e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94b0af3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac1e4ac0 con 0x7f94ac0b23e0 2023-08-31T02:01:17.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94b0af3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0ac590 con 0x7f94ac06db90 2023-08-31T02:01:17.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94b0af3700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0abfd0 con 0x7f94ac1593b0 2023-08-31T02:01:17.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94a9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94ac0b23e0 0x7f94ac1e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94a9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94ac0b23e0 0x7f94ac1e4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53750/0 (socket says 172.21.15.84:53750) 2023-08-31T02:01:17.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94a9d9b700 1 -- 172.21.15.84:0/2689992005 learned_addr learned my addr 172.21.15.84:0/2689992005 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:17.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94aad9d700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94ac1593b0 0x7f94ac1e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94aa59c700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ac06db90 0x7f94ac06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94a9d9b700 1 -- 172.21.15.84:0/2689992005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94ac1593b0 msgr2=0x7f94ac1e4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94a9d9b700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94ac1593b0 0x7f94ac1e4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94a9d9b700 1 -- 172.21.15.84:0/2689992005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ac06db90 msgr2=0x7f94ac06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:17.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94a9d9b700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ac06db90 0x7f94ac06c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:17.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.903+0000 7f94a9d9b700 1 -- 172.21.15.84:0/2689992005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4009d00 con 0x7f94ac0b23e0 2023-08-31T02:01:17.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.904+0000 7f94a9d9b700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94ac0b23e0 0x7f94ac1e4040 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c4e0 tx=0x7f949c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:17.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.904+0000 7f949affd700 1 -- 172.21.15.84:0/2689992005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0052d0 con 0x7f94ac0b23e0 2023-08-31T02:01:17.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.904+0000 7f949affd700 1 -- 172.21.15.84:0/2689992005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f949c005520 con 0x7f94ac0b23e0 2023-08-31T02:01:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.904+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a0009520 con 0x7f94ac0b23e0 2023-08-31T02:01:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.904+0000 7f949affd700 1 -- 172.21.15.84:0/2689992005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0038e0 con 0x7f94ac0b23e0 2023-08-31T02:01:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.904+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac0cbb70 con 0x7f94ac0b23e0 2023-08-31T02:01:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.905+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac070450 con 0x7f94ac0b23e0 2023-08-31T02:01:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.905+0000 7f949affd700 1 -- 172.21.15.84:0/2689992005 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f949c003a40 con 0x7f94ac0b23e0 2023-08-31T02:01:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.906+0000 7f949affd700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f948c06a0e0 0x7f948c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.906+0000 7f94aa59c700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f948c06a0e0 0x7f948c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.906+0000 7f949affd700 1 -- 172.21.15.84:0/2689992005 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f949c0876d0 con 0x7f94ac0b23e0 2023-08-31T02:01:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.906+0000 7f94aa59c700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f948c06a0e0 0x7f948c06c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f94a0000c00 tx=0x7f94a001a040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:17.910+0000 7f949affd700 1 -- 172.21.15.84:0/2689992005 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f949c0530c0 con 0x7f94ac0b23e0 2023-08-31T02:01:18.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.101+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94ac0b2d70 con 0x7f94ac0b23e0 2023-08-31T02:01:18.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.101+0000 7f949affd700 1 -- 172.21.15.84:0/2689992005 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94ac0b2d70 con 0x7f94ac0b23e0 2023-08-31T02:01:18.093 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:01:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f948c06a0e0 msgr2=0x7f948c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f948c06a0e0 0x7f948c06c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f94a0000c00 tx=0x7f94a001a040 comp rx=0 tx=0).stop 2023-08-31T02:01:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94ac0b23e0 msgr2=0x7f94ac1e4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94ac0b23e0 0x7f94ac1e4040 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c4e0 tx=0x7f949c00c7f0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 shutdown_connections 2023-08-31T02:01:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f948c06a0e0 0x7f948c06c5a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94ac1593b0 0x7f94ac1e4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ac06db90 0x7f94ac06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 --2- 172.21.15.84:0/2689992005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94ac0b23e0 0x7f94ac1e4040 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 >> 172.21.15.84:0/2689992005 conn(0x7f94ac0afb00 msgr2=0x7f94ac158230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:18.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 shutdown_connections 2023-08-31T02:01:18.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.103+0000 7f94b0af3700 1 -- 172.21.15.84:0/2689992005 wait complete. 2023-08-31T02:01:18.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T02:01:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.238+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2126667326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0a8004850 msgr2=0x7fa0a8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.238+0000 7fa0c3c48700 1 --2- 172.21.15.84:0/2126667326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0a8004850 0x7fa0a8004cd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c310 tx=0x7fa0a8005880 comp rx=0 tx=0).stop 2023-08-31T02:01:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.238+0000 7fa0c21e5700 1 -- 172.21.15.84:0/2126667326 reap_dead start 2023-08-31T02:01:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.238+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2126667326 shutdown_connections 2023-08-31T02:01:18.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.238+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2126667326 >> 172.21.15.84:0/2126667326 conn(0x7fa0bc0caa20 msgr2=0x7fa0bc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:18.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.238+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2126667326 shutdown_connections 2023-08-31T02:01:18.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.238+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2126667326 wait complete. 2023-08-31T02:01:18.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.239+0000 7fa0c3c48700 1 Processor -- start 2023-08-31T02:01:18.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.239+0000 7fa0c3c48700 1 -- start start 2023-08-31T02:01:18.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c3c48700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a8004850 0x7fa0bc14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:18.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c3c48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc14eb40 0x7fa0bc152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:18.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c3c48700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0bc1525c0 0x7fa0bc152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c3c48700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc14daa0 con 0x7fa0bc14eb40 2023-08-31T02:01:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c3c48700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc14dd80 con 0x7fa0a8004850 2023-08-31T02:01:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c3c48700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc14e060 con 0x7fa0bc1525c0 2023-08-31T02:01:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c11e3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc14eb40 0x7fa0bc152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c11e3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc14eb40 0x7fa0bc152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53772/0 (socket says 172.21.15.84:53772) 2023-08-31T02:01:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c11e3700 1 -- 172.21.15.84:0/2305255458 learned_addr learned my addr 172.21.15.84:0/2305255458 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.240+0000 7fa0c19e4700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a8004850 0x7fa0bc14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c21e5700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0bc1525c0 0x7fa0bc152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c11e3700 1 -- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0bc1525c0 msgr2=0x7fa0bc152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c11e3700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0bc1525c0 0x7fa0bc152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c11e3700 1 -- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a8004850 msgr2=0x7fa0bc14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c11e3700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a8004850 0x7fa0bc14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c11e3700 1 -- 172.21.15.84:0/2305255458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc14e340 con 0x7fa0bc14eb40 2023-08-31T02:01:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c21e5700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0bc1525c0 0x7fa0bc152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c11e3700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc14eb40 0x7fa0bc152080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80046a0 tx=0x7fa0ac00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0b27fc700 1 -- 172.21.15.84:0/2305255458 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac006650 con 0x7fa0bc14eb40 2023-08-31T02:01:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0b27fc700 1 -- 172.21.15.84:0/2305255458 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa0ac003680 con 0x7fa0bc14eb40 2023-08-31T02:01:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc14e620 con 0x7fa0bc14eb40 2023-08-31T02:01:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0b27fc700 1 -- 172.21.15.84:0/2305255458 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac003a90 con 0x7fa0bc14eb40 2023-08-31T02:01:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.241+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc14d6c0 con 0x7fa0bc14eb40 2023-08-31T02:01:18.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.242+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc14e990 con 0x7fa0bc14eb40 2023-08-31T02:01:18.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.242+0000 7fa0b27fc700 1 -- 172.21.15.84:0/2305255458 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0ac022070 con 0x7fa0bc14eb40 2023-08-31T02:01:18.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.243+0000 7fa0b27fc700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa0a006a0e0 0x7fa0a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:18.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.243+0000 7fa0b27fc700 1 -- 172.21.15.84:0/2305255458 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa0ac08a1d0 con 0x7fa0bc14eb40 2023-08-31T02:01:18.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.243+0000 7fa0c19e4700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa0a006a0e0 0x7fa0a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:18.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.243+0000 7fa0c19e4700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa0a006a0e0 0x7fa0a006c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0aeb60 tx=0x7fa0b8013040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:18.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.247+0000 7fa0b27fc700 1 -- 172.21.15.84:0/2305255458 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa0ac055c50 con 0x7fa0bc14eb40 2023-08-31T02:01:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.440+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa0bc04e7c0 con 0x7fa0bc14eb40 2023-08-31T02:01:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.441+0000 7fa0b27fc700 1 -- 172.21.15.84:0/2305255458 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa0ac059270 con 0x7fa0bc14eb40 2023-08-31T02:01:18.433 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:18.433 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-08-31T02:01:18.433 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-08-31T02:01:18.434 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-08-31T02:01:18.434 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-08-31T02:01:18.434 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:18.434 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-08-31T02:01:18.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa0a006a0e0 msgr2=0x7fa0a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa0a006a0e0 0x7fa0a006c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0aeb60 tx=0x7fa0b8013040 comp rx=0 tx=0).stop 2023-08-31T02:01:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc14eb40 msgr2=0x7fa0bc152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc14eb40 0x7fa0bc152080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80046a0 tx=0x7fa0ac00cd30 comp rx=0 tx=0).stop 2023-08-31T02:01:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 shutdown_connections 2023-08-31T02:01:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fa0a006a0e0 0x7fa0a006c5a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0bc1525c0 0x7fa0bc152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a8004850 0x7fa0bc14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 --2- 172.21.15.84:0/2305255458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc14eb40 0x7fa0bc152080 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 >> 172.21.15.84:0/2305255458 conn(0x7fa0bc0caa20 msgr2=0x7fa0bc0ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 shutdown_connections 2023-08-31T02:01:18.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.443+0000 7fa0c3c48700 1 -- 172.21.15.84:0/2305255458 wait complete. 2023-08-31T02:01:18.447 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T02:01:18.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-31T02:01:18.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.582+0000 7f1640859700 1 -- 172.21.15.84:0/2885865408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c0c9d00 msgr2=0x7f163c0b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.582+0000 7f1640859700 1 --2- 172.21.15.84:0/2885865408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c0c9d00 0x7f163c0b0e00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1630005fd0 tx=0x7f1630009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:18.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.582+0000 7f1640859700 1 -- 172.21.15.84:0/2885865408 shutdown_connections 2023-08-31T02:01:18.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.582+0000 7f1640859700 1 --2- 172.21.15.84:0/2885865408 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f163c1590f0 0x7f163c0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.582+0000 7f1640859700 1 --2- 172.21.15.84:0/2885865408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c0c9d00 0x7f163c0b0e00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.582+0000 7f1640859700 1 -- 172.21.15.84:0/2885865408 >> 172.21.15.84:0/2885865408 conn(0x7f163c0caa30 msgr2=0x7f163c0cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:18.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.582+0000 7f1640859700 1 -- 172.21.15.84:0/2885865408 shutdown_connections 2023-08-31T02:01:18.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.582+0000 7f1640859700 1 -- 172.21.15.84:0/2885865408 wait complete. 2023-08-31T02:01:18.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.584+0000 7f1640859700 1 Processor -- start 2023-08-31T02:01:18.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.584+0000 7f1640859700 1 -- start start 2023-08-31T02:01:18.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.584+0000 7f1640859700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f163c0c9d00 0x7f163c153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:18.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.584+0000 7f1640859700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f163c1590f0 0x7f163c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:18.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.584+0000 7f1640859700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c15c8c0 0x7f163c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:18.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f1640859700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c5080 con 0x7f163c15c8c0 2023-08-31T02:01:18.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f1640859700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c1f4fc0 con 0x7f163c0c9d00 2023-08-31T02:01:18.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f1640859700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c1f5260 con 0x7f163c1590f0 2023-08-31T02:01:18.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c15c8c0 0x7f163c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:18.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c15c8c0 0x7f163c0af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53788/0 (socket says 172.21.15.84:53788) 2023-08-31T02:01:18.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 -- 172.21.15.84:0/2931746578 learned_addr learned my addr 172.21.15.84:0/2931746578 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:18.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163a59c700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f163c0c9d00 0x7f163c153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:18.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f1639d9b700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f163c1590f0 0x7f163c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:18.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 -- 172.21.15.84:0/2931746578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f163c1590f0 msgr2=0x7f163c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f163c1590f0 0x7f163c0aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 -- 172.21.15.84:0/2931746578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f163c0c9d00 msgr2=0x7f163c153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:18.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f163c0c9d00 0x7f163c153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 -- 172.21.15.84:0/2931746578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16300095f0 con 0x7f163c15c8c0 2023-08-31T02:01:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f163ad9d700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c15c8c0 0x7f163c0af420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f163400ada0 tx=0x7f163400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f162affd700 1 -- 172.21.15.84:0/2931746578 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163400f070 con 0x7f163c15c8c0 2023-08-31T02:01:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f162affd700 1 -- 172.21.15.84:0/2931746578 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1634007e60 con 0x7f163c15c8c0 2023-08-31T02:01:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c1f5540 con 0x7f163c15c8c0 2023-08-31T02:01:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f162affd700 1 -- 172.21.15.84:0/2931746578 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634004df0 con 0x7f163c15c8c0 2023-08-31T02:01:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.585+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c1f5b00 con 0x7f163c15c8c0 2023-08-31T02:01:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.586+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c1f5c90 con 0x7f163c15c8c0 2023-08-31T02:01:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.587+0000 7f162affd700 1 -- 172.21.15.84:0/2931746578 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f163400c980 con 0x7f163c15c8c0 2023-08-31T02:01:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.587+0000 7f162affd700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f161c06a0e0 0x7f161c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.587+0000 7f162affd700 1 -- 172.21.15.84:0/2931746578 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1634087f20 con 0x7f163c15c8c0 2023-08-31T02:01:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.587+0000 7f163a59c700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f161c06a0e0 0x7f161c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.587+0000 7f163a59c700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f161c06a0e0 0x7f161c06c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1630000c00 tx=0x7f16300047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:18.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.591+0000 7f162affd700 1 -- 172.21.15.84:0/2931746578 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f16340539a0 con 0x7f163c15c8c0 2023-08-31T02:01:18.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:18.781+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f163c1595f0 con 0x7f163c15c8c0 2023-08-31T02:01:19.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.454+0000 7f162affd700 1 -- 172.21.15.84:0/2931746578 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1634056fc0 con 0x7f163c15c8c0 2023-08-31T02:01:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.457+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f161c06a0e0 msgr2=0x7f161c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:19.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.457+0000 7f1640859700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f161c06a0e0 0x7f161c06c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1630000c00 tx=0x7f16300047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.457+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c15c8c0 msgr2=0x7f163c0af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:19.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.457+0000 7f1640859700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c15c8c0 0x7f163c0af420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f163400ada0 tx=0x7f163400c330 comp rx=0 tx=0).stop 2023-08-31T02:01:19.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.458+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 shutdown_connections 2023-08-31T02:01:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.458+0000 7f1640859700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f161c06a0e0 0x7f161c06c5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.458+0000 7f1640859700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163c15c8c0 0x7f163c0af420 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.458+0000 7f1640859700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f163c0c9d00 0x7f163c153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.458+0000 7f1640859700 1 --2- 172.21.15.84:0/2931746578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f163c1590f0 0x7f163c0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.458+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 >> 172.21.15.84:0/2931746578 conn(0x7f163c0caa30 msgr2=0x7f163c155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:19.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.458+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 shutdown_connections 2023-08-31T02:01:19.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.458+0000 7f1640859700 1 -- 172.21.15.84:0/2931746578 wait complete. 2023-08-31T02:01:19.453 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-08-31T02:01:19.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T02:01:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.608+0000 7f06d8a7c700 1 -- 172.21.15.84:0/1325705289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d415d750 msgr2=0x7f06d40ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.608+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/1325705289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d415d750 0x7f06d40ccce0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f06d40b1cc0 tx=0x7f06c4009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.608+0000 7f06d8a7c700 1 -- 172.21.15.84:0/1325705289 shutdown_connections 2023-08-31T02:01:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.608+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/1325705289 >> v2:172.21.15.170:3300/0 conn(0x7f06d4159320 0x7f06d40b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.608+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/1325705289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d415d750 0x7f06d40ccce0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.608+0000 7f06d8a7c700 1 -- 172.21.15.84:0/1325705289 >> 172.21.15.84:0/1325705289 conn(0x7f06d40b0c40 msgr2=0x7f06d40b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.608+0000 7f06d8a7c700 1 -- 172.21.15.84:0/1325705289 shutdown_connections 2023-08-31T02:01:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.608+0000 7f06d8a7c700 1 -- 172.21.15.84:0/1325705289 wait complete. 2023-08-31T02:01:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.609+0000 7f06d8a7c700 1 Processor -- start 2023-08-31T02:01:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.609+0000 7f06d8a7c700 1 -- start start 2023-08-31T02:01:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d8a7c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d40cd220 0x7f06d40aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d8a7c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06d4159320 0x7f06d40c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d8a7c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d415d750 0x7f06d414ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d8a7c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d415ac20 con 0x7f06d40cd220 2023-08-31T02:01:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d8a7c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c70e0 con 0x7f06d415d750 2023-08-31T02:01:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d8a7c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c73b0 con 0x7f06d4159320 2023-08-31T02:01:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d40cd220 0x7f06d40aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d40cd220 0x7f06d40aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53798/0 (socket says 172.21.15.84:53798) 2023-08-31T02:01:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 -- 172.21.15.84:0/2114176365 learned_addr learned my addr 172.21.15.84:0/2114176365 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 -- 172.21.15.84:0/2114176365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06d4159320 msgr2=0x7f06d40c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06d4159320 0x7f06d40c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 -- 172.21.15.84:0/2114176365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d415d750 msgr2=0x7f06d414ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d415d750 0x7f06d414ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 -- 172.21.15.84:0/2114176365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c40095f0 con 0x7f06d40cd220 2023-08-31T02:01:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d259c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d40cd220 0x7f06d40aec10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c920 tx=0x7f06c800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06c2ffd700 1 -- 172.21.15.84:0/2114176365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8007b00 con 0x7f06d40cd220 2023-08-31T02:01:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d40c7690 con 0x7f06d40cd220 2023-08-31T02:01:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.610+0000 7f06c2ffd700 1 -- 172.21.15.84:0/2114176365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f06c8007d50 con 0x7f06d40cd220 2023-08-31T02:01:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.611+0000 7f06c2ffd700 1 -- 172.21.15.84:0/2114176365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8004a90 con 0x7f06d40cd220 2023-08-31T02:01:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.611+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d40c7970 con 0x7f06d40cd220 2023-08-31T02:01:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.612+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d415b100 con 0x7f06d40cd220 2023-08-31T02:01:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.612+0000 7f06c2ffd700 1 -- 172.21.15.84:0/2114176365 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f06c8004bf0 con 0x7f06d40cd220 2023-08-31T02:01:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.612+0000 7f06c2ffd700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f06b406a0e0 0x7f06b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.613+0000 7f06c2ffd700 1 -- 172.21.15.84:0/2114176365 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f06c80887a0 con 0x7f06d40cd220 2023-08-31T02:01:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.613+0000 7f06d1d9b700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f06b406a0e0 0x7f06b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.613+0000 7f06d1d9b700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f06b406a0e0 0x7f06b406c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06d40c5820 tx=0x7f06c4004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.617+0000 7f06c2ffd700 1 -- 172.21.15.84:0/2114176365 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f06d415b100 con 0x7f06d40cd220 2023-08-31T02:01:19.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:19.806+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f06d415b100 con 0x7f06d40cd220 2023-08-31T02:01:20.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.457+0000 7f06c2ffd700 1 -- 172.21.15.84:0/2114176365 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f06d415b100 con 0x7f06d40cd220 2023-08-31T02:01:20.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.463+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f06b406a0e0 msgr2=0x7f06b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:20.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.463+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f06b406a0e0 0x7f06b406c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06d40c5820 tx=0x7f06c4004750 comp rx=0 tx=0).stop 2023-08-31T02:01:20.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.463+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d40cd220 msgr2=0x7f06d40aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:20.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.463+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d40cd220 0x7f06d40aec10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c920 tx=0x7f06c800cce0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.467+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 shutdown_connections 2023-08-31T02:01:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.467+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f06b406a0e0 0x7f06b406c5a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.467+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d415d750 0x7f06d414ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.467+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d40cd220 0x7f06d40aec10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.467+0000 7f06d8a7c700 1 --2- 172.21.15.84:0/2114176365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06d4159320 0x7f06d40c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.467+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 >> 172.21.15.84:0/2114176365 conn(0x7f06d40b0c40 msgr2=0x7f06d406ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:20.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.473+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 shutdown_connections 2023-08-31T02:01:20.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.474+0000 7f06d8a7c700 1 -- 172.21.15.84:0/2114176365 wait complete. 2023-08-31T02:01:20.469 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-08-31T02:01:20.483 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T02:01:20.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.619+0000 7f9f08c1f700 1 -- 172.21.15.84:0/2763303187 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f0415b790 msgr2=0x7f9f0406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:20.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.619+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/2763303187 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f0415b790 0x7f9f0406c720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40098c0 tx=0x7f9ef4009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.620+0000 7f9f08c1f700 1 -- 172.21.15.84:0/2763303187 shutdown_connections 2023-08-31T02:01:20.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.620+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/2763303187 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f0415b790 0x7f9f0406c720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.620+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/2763303187 >> v2:172.21.15.170:3300/0 conn(0x7f9f0415bce0 0x7f9f040c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.620+0000 7f9f08c1f700 1 -- 172.21.15.84:0/2763303187 >> 172.21.15.84:0/2763303187 conn(0x7f9f040afb00 msgr2=0x7f9f040aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:20.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.620+0000 7f9f08c1f700 1 -- 172.21.15.84:0/2763303187 shutdown_connections 2023-08-31T02:01:20.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.620+0000 7f9f08c1f700 1 -- 172.21.15.84:0/2763303187 wait complete. 2023-08-31T02:01:20.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.621+0000 7f9f08c1f700 1 Processor -- start 2023-08-31T02:01:20.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.621+0000 7f9f08c1f700 1 -- start start 2023-08-31T02:01:20.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f08c1f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f040ca100 0x7f9f04152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:20.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f08c1f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f0415b790 0x7f9f04156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:20.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f08c1f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f0415bce0 0x7f9f040c1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:20.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f08c1f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f04151f20 con 0x7f9f0415b790 2023-08-31T02:01:20.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f08c1f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f04152200 con 0x7f9f0415bce0 2023-08-31T02:01:20.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f08c1f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f041524e0 con 0x7f9f040ca100 2023-08-31T02:01:20.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f0415b790 0x7f9f04156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:20.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f0415b790 0x7f9f04156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53814/0 (socket says 172.21.15.84:53814) 2023-08-31T02:01:20.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 -- 172.21.15.84:0/1340112712 learned_addr learned my addr 172.21.15.84:0/1340112712 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:20.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f0259c700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f040ca100 0x7f9f04152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:20.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f02d9d700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f0415bce0 0x7f9f040c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:20.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 -- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f040ca100 msgr2=0x7f9f04152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:20.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f040ca100 0x7f9f04152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 -- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f0415bce0 msgr2=0x7f9f040c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:20.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f0415bce0 0x7f9f040c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:20.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 -- 172.21.15.84:0/1340112712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80095f0 con 0x7f9f0415b790 2023-08-31T02:01:20.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f0259c700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f040ca100 0x7f9f04152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:20.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f02d9d700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f0415bce0 0x7f9f040c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:20.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f01d9b700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f0415b790 0x7f9f04156400 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800eb70 tx=0x7f9ef800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:20.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9ef2ffd700 1 -- 172.21.15.84:0/1340112712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8009970 con 0x7f9f0415b790 2023-08-31T02:01:20.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9ef2ffd700 1 -- 172.21.15.84:0/1340112712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ef800cd40 con 0x7f9f0415b790 2023-08-31T02:01:20.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef4009520 con 0x7f9f0415b790 2023-08-31T02:01:20.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9ef2ffd700 1 -- 172.21.15.84:0/1340112712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8004280 con 0x7f9f0415b790 2023-08-31T02:01:20.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.622+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f04152aa0 con 0x7f9f0415b790 2023-08-31T02:01:20.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.623+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f04152cc0 con 0x7f9f0415b790 2023-08-31T02:01:20.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.624+0000 7f9ef2ffd700 1 -- 172.21.15.84:0/1340112712 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ef80043e0 con 0x7f9f0415b790 2023-08-31T02:01:20.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.624+0000 7f9ef2ffd700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ee406a0e0 0x7f9ee406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:20.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.624+0000 7f9ef2ffd700 1 -- 172.21.15.84:0/1340112712 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f9ef8014070 con 0x7f9f0415b790 2023-08-31T02:01:20.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.624+0000 7f9f0259c700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ee406a0e0 0x7f9ee406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:20.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.625+0000 7f9f0259c700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ee406a0e0 0x7f9ee406c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4000c00 tx=0x7f9ef40047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:20.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.629+0000 7f9ef2ffd700 1 -- 172.21.15.84:0/1340112712 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9ef8054800 con 0x7f9f0415b790 2023-08-31T02:01:20.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:20.868+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9f0404e7c0 con 0x7f9f0415b790 2023-08-31T02:01:21.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.484+0000 7f9ef2ffd700 1 -- 172.21.15.84:0/1340112712 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9ef8057e20 con 0x7f9f0415b790 2023-08-31T02:01:21.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ee406a0e0 msgr2=0x7f9ee406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ee406a0e0 0x7f9ee406c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4000c00 tx=0x7f9ef40047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f0415b790 msgr2=0x7f9f04156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f0415b790 0x7f9f04156400 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800eb70 tx=0x7f9ef800ef30 comp rx=0 tx=0).stop 2023-08-31T02:01:21.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 shutdown_connections 2023-08-31T02:01:21.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f9ee406a0e0 0x7f9ee406c5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f0415bce0 0x7f9f040c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f040ca100 0x7f9f04152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 --2- 172.21.15.84:0/1340112712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f0415b790 0x7f9f04156400 secure :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800eb70 tx=0x7f9ef800ef30 comp rx=0 tx=0).stop 2023-08-31T02:01:21.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.490+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 >> 172.21.15.84:0/1340112712 conn(0x7f9f040afb00 msgr2=0x7f9f040ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:21.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.492+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 shutdown_connections 2023-08-31T02:01:21.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.492+0000 7f9f08c1f700 1 -- 172.21.15.84:0/1340112712 wait complete. 2023-08-31T02:01:21.488 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 5 and data pool 6 2023-08-31T02:01:21.503 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.635+0000 7f3162ce7700 1 -- 172.21.15.84:0/2110272568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c0cc920 msgr2=0x7f315c0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.635+0000 7f3162ce7700 1 --2- 172.21.15.84:0/2110272568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c0cc920 0x7f315c0c9ac0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b40e0 tx=0x7f3148009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.635+0000 7f3162ce7700 1 -- 172.21.15.84:0/2110272568 shutdown_connections 2023-08-31T02:01:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.635+0000 7f3162ce7700 1 --2- 172.21.15.84:0/2110272568 >> v2:172.21.15.170:3300/0 conn(0x7f315c0707c0 0x7f315c070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.635+0000 7f3162ce7700 1 --2- 172.21.15.84:0/2110272568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c0cc920 0x7f315c0c9ac0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.635+0000 7f3162ce7700 1 -- 172.21.15.84:0/2110272568 >> 172.21.15.84:0/2110272568 conn(0x7f315c0caa20 msgr2=0x7f315c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.635+0000 7f3162ce7700 1 -- 172.21.15.84:0/2110272568 shutdown_connections 2023-08-31T02:01:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.635+0000 7f3162ce7700 1 -- 172.21.15.84:0/2110272568 wait complete. 2023-08-31T02:01:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.636+0000 7f3162ce7700 1 Processor -- start 2023-08-31T02:01:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.636+0000 7f3162ce7700 1 -- start start 2023-08-31T02:01:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3162ce7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f315c0707c0 0x7f315c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3162ce7700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315c0cc920 0x7f315c1f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3162ce7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c158220 0x7f315c0b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3162ce7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c6410 con 0x7f315c158220 2023-08-31T02:01:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3162ce7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c5a40 con 0x7f315c0707c0 2023-08-31T02:01:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3162ce7700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c7ec0 con 0x7f315c0cc920 2023-08-31T02:01:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3161284700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c158220 0x7f315c0b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3161284700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c158220 0x7f315c0b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53844/0 (socket says 172.21.15.84:53844) 2023-08-31T02:01:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3161284700 1 -- 172.21.15.84:0/181474524 learned_addr learned my addr 172.21.15.84:0/181474524 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3160a83700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f315c0707c0 0x7f315c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f315bfff700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315c0cc920 0x7f315c1f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3161284700 1 -- 172.21.15.84:0/181474524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315c0cc920 msgr2=0x7f315c1f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3161284700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315c0cc920 0x7f315c1f2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3161284700 1 -- 172.21.15.84:0/181474524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f315c0707c0 msgr2=0x7f315c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3161284700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f315c0707c0 0x7f315c0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.637+0000 7f3161284700 1 -- 172.21.15.84:0/181474524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31480095f0 con 0x7f315c158220 2023-08-31T02:01:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.638+0000 7f3161284700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c158220 0x7f315c0b1a10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f315400b970 tx=0x7f315400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.638+0000 7f31597fa700 1 -- 172.21.15.84:0/181474524 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400c9b0 con 0x7f315c158220 2023-08-31T02:01:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.638+0000 7f31597fa700 1 -- 172.21.15.84:0/181474524 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f315400cc20 con 0x7f315c158220 2023-08-31T02:01:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.638+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c0c5110 con 0x7f315c158220 2023-08-31T02:01:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.638+0000 7f31597fa700 1 -- 172.21.15.84:0/181474524 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154014440 con 0x7f315c158220 2023-08-31T02:01:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.638+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c0c56d0 con 0x7f315c158220 2023-08-31T02:01:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.639+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0c5bb0 con 0x7f315c158220 2023-08-31T02:01:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.639+0000 7f31597fa700 1 -- 172.21.15.84:0/181474524 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f315401d3b0 con 0x7f315c158220 2023-08-31T02:01:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.640+0000 7f31597fa700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f314006a0e0 0x7f314006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.640+0000 7f3160a83700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f314006a0e0 0x7f314006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.640+0000 7f31597fa700 1 -- 172.21.15.84:0/181474524 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3154006e40 con 0x7f315c158220 2023-08-31T02:01:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.640+0000 7f3160a83700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f314006a0e0 0x7f314006c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b26e0 tx=0x7f3150008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.644+0000 7f31597fa700 1 -- 172.21.15.84:0/181474524 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3154053c20 con 0x7f315c158220 2023-08-31T02:01:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.834+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f315c04e7c0 con 0x7f315c158220 2023-08-31T02:01:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.835+0000 7f31597fa700 1 -- 172.21.15.84:0/181474524 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f3154057240 con 0x7f315c158220 2023-08-31T02:01:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:21.828 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:20.869894+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T02:01:18.799026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T02:01:19.825366+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:21.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f314006a0e0 msgr2=0x7f314006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f314006a0e0 0x7f314006c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b26e0 tx=0x7f3150008040 comp rx=0 tx=0).stop 2023-08-31T02:01:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c158220 msgr2=0x7f315c0b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c158220 0x7f315c0b1a10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f315400b970 tx=0x7f315400bd30 comp rx=0 tx=0).stop 2023-08-31T02:01:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 shutdown_connections 2023-08-31T02:01:21.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f314006a0e0 0x7f314006c5a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f315c158220 0x7f315c0b1a10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f315c0707c0 0x7f315c0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 --2- 172.21.15.84:0/181474524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315c0cc920 0x7f315c1f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 >> 172.21.15.84:0/181474524 conn(0x7f315c0caa20 msgr2=0x7f315c0af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 shutdown_connections 2023-08-31T02:01:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.837+0000 7f3162ce7700 1 -- 172.21.15.84:0/181474524 wait complete. 2023-08-31T02:01:21.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.971+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/1631017242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0003a30 msgr2=0x7fe1b0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.971+0000 7fe1cb4d4700 1 --2- 172.21.15.84:0/1631017242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0003a30 0x7fe1b0003e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00016f0 tx=0x7fe1b0005880 comp rx=0 tx=0).stop 2023-08-31T02:01:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.971+0000 7fe1c9a71700 1 -- 172.21.15.84:0/1631017242 reap_dead start 2023-08-31T02:01:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.971+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/1631017242 shutdown_connections 2023-08-31T02:01:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.971+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/1631017242 >> 172.21.15.84:0/1631017242 conn(0x7fe1c40caa20 msgr2=0x7fe1c40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:21.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.972+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/1631017242 shutdown_connections 2023-08-31T02:01:21.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.972+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/1631017242 wait complete. 2023-08-31T02:01:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1cb4d4700 1 Processor -- start 2023-08-31T02:01:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1cb4d4700 1 -- start start 2023-08-31T02:01:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1cb4d4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0003a30 0x7fe1c40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1cb4d4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1c406a160 0x7fe1c406a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1cb4d4700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1c4156770 0x7fe1c4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1cb4d4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c41578d0 con 0x7fe1c406a160 2023-08-31T02:01:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1cb4d4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c406ab20 con 0x7fe1b0003a30 2023-08-31T02:01:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1cb4d4700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c41575f0 con 0x7fe1c4156770 2023-08-31T02:01:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1c8a6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1c406a160 0x7fe1c406a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1c8a6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1c406a160 0x7fe1c406a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53862/0 (socket says 172.21.15.84:53862) 2023-08-31T02:01:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.973+0000 7fe1c8a6f700 1 -- 172.21.15.84:0/672129426 learned_addr learned my addr 172.21.15.84:0/672129426 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1c9270700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0003a30 0x7fe1c40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1c9a71700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1c4156770 0x7fe1c4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1c8a6f700 1 -- 172.21.15.84:0/672129426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1c4156770 msgr2=0x7fe1c4156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1c8a6f700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1c4156770 0x7fe1c4156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1c8a6f700 1 -- 172.21.15.84:0/672129426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0003a30 msgr2=0x7fe1c40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1c8a6f700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0003a30 0x7fe1c40c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1c8a6f700 1 -- 172.21.15.84:0/672129426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40c23f0 con 0x7fe1c406a160 2023-08-31T02:01:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1c8a6f700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1c406a160 0x7fe1c406a5e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400e650 tx=0x7fe1b400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1b9ffb700 1 -- 172.21.15.84:0/672129426 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4010890 con 0x7fe1c406a160 2023-08-31T02:01:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1b9ffb700 1 -- 172.21.15.84:0/672129426 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1b4010ae0 con 0x7fe1c406a160 2023-08-31T02:01:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c40c26d0 con 0x7fe1c406a160 2023-08-31T02:01:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1b9ffb700 1 -- 172.21.15.84:0/672129426 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4011460 con 0x7fe1c406a160 2023-08-31T02:01:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.974+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c4157160 con 0x7fe1c406a160 2023-08-31T02:01:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.975+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c40c2250 con 0x7fe1c406a160 2023-08-31T02:01:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.975+0000 7fe1b9ffb700 1 -- 172.21.15.84:0/672129426 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe1b40115c0 con 0x7fe1c406a160 2023-08-31T02:01:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.976+0000 7fe1b9ffb700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.976+0000 7fe1b9ffb700 1 -- 172.21.15.84:0/672129426 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe1b4088d20 con 0x7fe1c406a160 2023-08-31T02:01:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.976+0000 7fe1c9270700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.976+0000 7fe1c9270700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0001eb0 tx=0x7fe1c0001190 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:21.980+0000 7fe1b9ffb700 1 -- 172.21.15.84:0/672129426 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe1c40c2250 con 0x7fe1c406a160 2023-08-31T02:01:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.172+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1c40c2bf0 con 0x7fe1c406a160 2023-08-31T02:01:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.173+0000 7fe1b9ffb700 1 -- 172.21.15.84:0/672129426 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16763 (secure 0 0 0) 0x7fe1c40c2bf0 con 0x7fe1c406a160 2023-08-31T02:01:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:22.166 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:20.869894+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T02:01:18.799026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T02:01:19.825366+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe1a806a0e0 msgr2=0x7fe1a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0001eb0 tx=0x7fe1c0001190 comp rx=0 tx=0).stop 2023-08-31T02:01:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1c406a160 msgr2=0x7fe1c406a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:22.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1c406a160 0x7fe1c406a5e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400e650 tx=0x7fe1b400ea10 comp rx=0 tx=0).stop 2023-08-31T02:01:22.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 shutdown_connections 2023-08-31T02:01:22.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe1a806a0e0 0x7fe1a806c5a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:22.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1c4156770 0x7fe1c4156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0003a30 0x7fe1c40c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 --2- 172.21.15.84:0/672129426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1c406a160 0x7fe1c406a5e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 >> 172.21.15.84:0/672129426 conn(0x7fe1c40caa20 msgr2=0x7fe1c415c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 shutdown_connections 2023-08-31T02:01:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.175+0000 7fe1cb4d4700 1 -- 172.21.15.84:0/672129426 wait complete. 2023-08-31T02:01:22.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T02:01:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.313+0000 7fec27b4e700 1 -- 172.21.15.84:0/1114242852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec0c003a00 msgr2=0x7fec0c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.313+0000 7fec27b4e700 1 --2- 172.21.15.84:0/1114242852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec0c003a00 0x7fec0c003e20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fec1c001720 tx=0x7fec0c005880 comp rx=0 tx=0).stop 2023-08-31T02:01:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.313+0000 7fec27b4e700 1 -- 172.21.15.84:0/1114242852 shutdown_connections 2023-08-31T02:01:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.313+0000 7fec27b4e700 1 --2- 172.21.15.84:0/1114242852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec0c003a00 0x7fec0c003e20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.313+0000 7fec27b4e700 1 -- 172.21.15.84:0/1114242852 >> 172.21.15.84:0/1114242852 conn(0x7fec200afb00 msgr2=0x7fec200aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.313+0000 7fec27b4e700 1 -- 172.21.15.84:0/1114242852 shutdown_connections 2023-08-31T02:01:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.313+0000 7fec27b4e700 1 -- 172.21.15.84:0/1114242852 wait complete. 2023-08-31T02:01:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.314+0000 7fec27b4e700 1 Processor -- start 2023-08-31T02:01:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.314+0000 7fec27b4e700 1 -- start start 2023-08-31T02:01:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec27b4e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec0c003a00 0x7fec2014f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec27b4e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec200c62f0 0x7fec201f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec27b4e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec200c6770 0x7fec201f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec27b4e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200c78c0 con 0x7fec200c6770 2023-08-31T02:01:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec27b4e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec201e1b40 con 0x7fec200c62f0 2023-08-31T02:01:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec27b4e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec200c6d40 con 0x7fec0c003a00 2023-08-31T02:01:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec200c6770 0x7fec201f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec200c6770 0x7fec201f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53884/0 (socket says 172.21.15.84:53884) 2023-08-31T02:01:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 -- 172.21.15.84:0/3554817293 learned_addr learned my addr 172.21.15.84:0/3554817293 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec250e9700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec200c62f0 0x7fec201f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec258ea700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec0c003a00 0x7fec2014f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 -- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec0c003a00 msgr2=0x7fec2014f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec0c003a00 0x7fec2014f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 -- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec200c62f0 msgr2=0x7fec201f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec200c62f0 0x7fec201f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 -- 172.21.15.84:0/3554817293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200c7020 con 0x7fec200c6770 2023-08-31T02:01:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec250e9700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec200c62f0 0x7fec201f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec260eb700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec200c6770 0x7fec201f2ff0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fec200702a0 tx=0x7fec18007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec167fc700 1 -- 172.21.15.84:0/3554817293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18019070 con 0x7fec200c6770 2023-08-31T02:01:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec167fc700 1 -- 172.21.15.84:0/3554817293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fec1800f040 con 0x7fec200c6770 2023-08-31T02:01:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec167fc700 1 -- 172.21.15.84:0/3554817293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1800e070 con 0x7fec200c6770 2023-08-31T02:01:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec200c7300 con 0x7fec200c6770 2023-08-31T02:01:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.315+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2014fa60 con 0x7fec200c6770 2023-08-31T02:01:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.316+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2014fbf0 con 0x7fec200c6770 2023-08-31T02:01:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.317+0000 7fec167fc700 1 -- 172.21.15.84:0/3554817293 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fec18010720 con 0x7fec200c6770 2023-08-31T02:01:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.317+0000 7fec167fc700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fec0406a0e0 0x7fec0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.317+0000 7fec258ea700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fec0406a0e0 0x7fec0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.317+0000 7fec167fc700 1 -- 172.21.15.84:0/3554817293 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fec18088100 con 0x7fec200c6770 2023-08-31T02:01:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.318+0000 7fec258ea700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fec0406a0e0 0x7fec0406c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fec1c001720 tx=0x7fec1c001190 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.321+0000 7fec167fc700 1 -- 172.21.15.84:0/3554817293 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fec2014fbf0 con 0x7fec200c6770 2023-08-31T02:01:22.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:22.557+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fec2014fbf0 con 0x7fec200c6770 2023-08-31T02:01:23.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.485+0000 7fec167fc700 1 -- 172.21.15.84:0/3554817293 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fec2014fbf0 con 0x7fec200c6770 2023-08-31T02:01:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fec0406a0e0 msgr2=0x7fec0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fec0406a0e0 0x7fec0406c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fec1c001720 tx=0x7fec1c001190 comp rx=0 tx=0).stop 2023-08-31T02:01:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec200c6770 msgr2=0x7fec201f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec200c6770 0x7fec201f2ff0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fec200702a0 tx=0x7fec18007ea0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 shutdown_connections 2023-08-31T02:01:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fec0406a0e0 0x7fec0406c5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec200c6770 0x7fec201f2ff0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec0c003a00 0x7fec2014f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 --2- 172.21.15.84:0/3554817293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec200c62f0 0x7fec201f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 >> 172.21.15.84:0/3554817293 conn(0x7fec200afb00 msgr2=0x7fec2006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 shutdown_connections 2023-08-31T02:01:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.488+0000 7fec27b4e700 1 -- 172.21.15.84:0/3554817293 wait complete. 2023-08-31T02:01:23.496 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T02:01:23.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T02:01:23.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 -- 172.21.15.84:0/1579765627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b406db90 msgr2=0x7f16b40c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:23.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/1579765627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b406db90 0x7f16b40c9a40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f16b406e7d0 tx=0x7f16a8009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:23.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 -- 172.21.15.84:0/1579765627 shutdown_connections 2023-08-31T02:01:23.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/1579765627 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16b40b23e0 0x7f16b40b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/1579765627 >> v2:172.21.15.170:3300/0 conn(0x7f16b41593b0 0x7f16b40b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/1579765627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b406db90 0x7f16b40c9a40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 -- 172.21.15.84:0/1579765627 >> 172.21.15.84:0/1579765627 conn(0x7f16b40afb00 msgr2=0x7f16b40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:23.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 -- 172.21.15.84:0/1579765627 shutdown_connections 2023-08-31T02:01:23.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.637+0000 7f16b8ec8700 1 -- 172.21.15.84:0/1579765627 wait complete. 2023-08-31T02:01:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.638+0000 7f16b8ec8700 1 Processor -- start 2023-08-31T02:01:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.638+0000 7f16b8ec8700 1 -- start start 2023-08-31T02:01:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b8ec8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16b406db90 0x7f16b4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b8ec8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16b40b23e0 0x7f16b40ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b8ec8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b41593b0 0x7f16b40afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b8ec8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40aca80 con 0x7f16b41593b0 2023-08-31T02:01:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b8ec8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b4152a40 con 0x7f16b40b23e0 2023-08-31T02:01:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b8ec8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40abe90 con 0x7f16b406db90 2023-08-31T02:01:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b41593b0 0x7f16b40afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b41593b0 0x7f16b40afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53898/0 (socket says 172.21.15.84:53898) 2023-08-31T02:01:23.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b2d9d700 1 -- 172.21.15.84:0/151962468 learned_addr learned my addr 172.21.15.84:0/151962468 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:23.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b259c700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16b406db90 0x7f16b4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:23.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.639+0000 7f16b1d9b700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16b40b23e0 0x7f16b40ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:23.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16b2d9d700 1 -- 172.21.15.84:0/151962468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16b406db90 msgr2=0x7f16b4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:23.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16b2d9d700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16b406db90 0x7f16b4152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16b2d9d700 1 -- 172.21.15.84:0/151962468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16b40b23e0 msgr2=0x7f16b40ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:23.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16b2d9d700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16b40b23e0 0x7f16b40ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:23.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16b2d9d700 1 -- 172.21.15.84:0/151962468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80095f0 con 0x7f16b41593b0 2023-08-31T02:01:23.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16b2d9d700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b41593b0 0x7f16b40afee0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00ab90 tx=0x7f16ac00af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:23.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16a2ffd700 1 -- 172.21.15.84:0/151962468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00f070 con 0x7f16b41593b0 2023-08-31T02:01:23.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16a2ffd700 1 -- 172.21.15.84:0/151962468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f16ac004bb0 con 0x7f16b41593b0 2023-08-31T02:01:23.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b40ca100 con 0x7f16b41593b0 2023-08-31T02:01:23.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16a2ffd700 1 -- 172.21.15.84:0/151962468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00c710 con 0x7f16b41593b0 2023-08-31T02:01:23.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.640+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b40ac430 con 0x7f16b41593b0 2023-08-31T02:01:23.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.641+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b4070450 con 0x7f16b41593b0 2023-08-31T02:01:23.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.641+0000 7f16a2ffd700 1 -- 172.21.15.84:0/151962468 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f16ac00c870 con 0x7f16b41593b0 2023-08-31T02:01:23.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.642+0000 7f16a2ffd700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f169406a0e0 0x7f169406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:23.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.642+0000 7f16a2ffd700 1 -- 172.21.15.84:0/151962468 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f16ac088180 con 0x7f16b41593b0 2023-08-31T02:01:23.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.642+0000 7f16b259c700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f169406a0e0 0x7f169406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:23.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.642+0000 7f16b259c700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f169406a0e0 0x7f169406c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f16a4005950 tx=0x7f16a4005e30 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:23.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.646+0000 7f16a2ffd700 1 -- 172.21.15.84:0/151962468 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f16ac0538b0 con 0x7f16b41593b0 2023-08-31T02:01:23.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:23.878+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f16b40c92d0 con 0x7f16b41593b0 2023-08-31T02:01:24.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.486+0000 7f16a2ffd700 1 -- 172.21.15.84:0/151962468 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f16ac056ed0 con 0x7f16b41593b0 2023-08-31T02:01:24.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f169406a0e0 msgr2=0x7f169406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:24.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f169406a0e0 0x7f169406c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f16a4005950 tx=0x7f16a4005e30 comp rx=0 tx=0).stop 2023-08-31T02:01:24.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b41593b0 msgr2=0x7f16b40afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b41593b0 0x7f16b40afee0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00ab90 tx=0x7f16ac00af50 comp rx=0 tx=0).stop 2023-08-31T02:01:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 shutdown_connections 2023-08-31T02:01:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f169406a0e0 0x7f169406c5a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16b41593b0 0x7f16b40afee0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16b406db90 0x7f16b4152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 --2- 172.21.15.84:0/151962468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16b40b23e0 0x7f16b40ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 >> 172.21.15.84:0/151962468 conn(0x7f16b40afb00 msgr2=0x7f16b40af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 shutdown_connections 2023-08-31T02:01:24.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.489+0000 7f16b8ec8700 1 -- 172.21.15.84:0/151962468 wait complete. 2023-08-31T02:01:24.496 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T02:01:24.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.638+0000 7fc3118b6700 1 -- 172.21.15.84:0/1286310679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c0cd4f0 msgr2=0x7fc30c0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.638+0000 7fc3118b6700 1 --2- 172.21.15.84:0/1286310679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c0cd4f0 0x7fc30c0b1250 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0b2ab0 tx=0x7fc30400b380 comp rx=0 tx=0).stop 2023-08-31T02:01:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.638+0000 7fc3118b6700 1 -- 172.21.15.84:0/1286310679 shutdown_connections 2023-08-31T02:01:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.638+0000 7fc3118b6700 1 --2- 172.21.15.84:0/1286310679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c0cd4f0 0x7fc30c0b1250 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.638+0000 7fc3118b6700 1 --2- 172.21.15.84:0/1286310679 >> v2:172.21.15.170:3300/0 conn(0x7fc30c15c2b0 0x7fc30c06b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.638+0000 7fc3118b6700 1 -- 172.21.15.84:0/1286310679 >> 172.21.15.84:0/1286310679 conn(0x7fc30c0cdf00 msgr2=0x7fc30c0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.638+0000 7fc3118b6700 1 -- 172.21.15.84:0/1286310679 shutdown_connections 2023-08-31T02:01:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.638+0000 7fc3118b6700 1 -- 172.21.15.84:0/1286310679 wait complete. 2023-08-31T02:01:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.639+0000 7fc3118b6700 1 Processor -- start 2023-08-31T02:01:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.640+0000 7fc3118b6700 1 -- start start 2023-08-31T02:01:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.640+0000 7fc3118b6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc30c0cd4f0 0x7fc30c14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.640+0000 7fc3118b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c152600 0x7fc30c147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.640+0000 7fc3118b6700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc30c15c2b0 0x7fc30c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.640+0000 7fc3118b6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c147cb0 con 0x7fc30c152600 2023-08-31T02:01:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.640+0000 7fc3118b6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c149fb0 con 0x7fc30c0cd4f0 2023-08-31T02:01:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.640+0000 7fc3118b6700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c14a290 con 0x7fc30c15c2b0 2023-08-31T02:01:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c152600 0x7fc30c147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c152600 0x7fc30c147770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53908/0 (socket says 172.21.15.84:53908) 2023-08-31T02:01:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 -- 172.21.15.84:0/3871372966 learned_addr learned my addr 172.21.15.84:0/3871372966 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30affd700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc30c0cd4f0 0x7fc30c14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30b7fe700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc30c15c2b0 0x7fc30c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 -- 172.21.15.84:0/3871372966 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc30c15c2b0 msgr2=0x7fc30c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc30c15c2b0 0x7fc30c14dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 -- 172.21.15.84:0/3871372966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc30c0cd4f0 msgr2=0x7fc30c14b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc30c0cd4f0 0x7fc30c14b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 -- 172.21.15.84:0/3871372966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009d00 con 0x7fc30c152600 2023-08-31T02:01:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc30a7fc700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c152600 0x7fc30c147770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc007b50 tx=0x7fc2fc007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc2f3fff700 1 -- 172.21.15.84:0/3871372966 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc011070 con 0x7fc30c152600 2023-08-31T02:01:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc2f3fff700 1 -- 172.21.15.84:0/3871372966 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc2fc00c2e0 con 0x7fc30c152600 2023-08-31T02:01:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc2f3fff700 1 -- 172.21.15.84:0/3871372966 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00e820 con 0x7fc30c152600 2023-08-31T02:01:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c0cda10 con 0x7fc30c152600 2023-08-31T02:01:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.641+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c14a850 con 0x7fc30c152600 2023-08-31T02:01:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.642+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c04e7c0 con 0x7fc30c152600 2023-08-31T02:01:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.643+0000 7fc2f3fff700 1 -- 172.21.15.84:0/3871372966 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc2fc00e980 con 0x7fc30c152600 2023-08-31T02:01:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.643+0000 7fc2f3fff700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc2f806a0e0 0x7fc2f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.643+0000 7fc2f3fff700 1 -- 172.21.15.84:0/3871372966 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc2fc08a280 con 0x7fc30c152600 2023-08-31T02:01:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.643+0000 7fc30affd700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc2f806a0e0 0x7fc2f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.643+0000 7fc30affd700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc2f806a0e0 0x7fc2f806c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc30c06f010 tx=0x7fc300009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.647+0000 7fc2f3fff700 1 -- 172.21.15.84:0/3871372966 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc2fc055930 con 0x7fc30c152600 2023-08-31T02:01:24.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.880+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc30c0cae80 con 0x7fc30c152600 2023-08-31T02:01:24.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.880+0000 7fc2f3fff700 1 -- 172.21.15.84:0/3871372966 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7fc2fc058f50 con 0x7fc30c152600 2023-08-31T02:01:24.873 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:24.874 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5009,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3211732680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3211732680},{"type":"v1","addr":"172.21.15.170:6834","nonce":3211732680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5012,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2965794759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2965794759},{"type":"v1","addr":"172.21.15.170:6835","nonce":2965794759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2457559549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2457559549},{"type":"v1","addr":"172.21.15.84:6837","nonce":2457559549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T02:01:20.870197+0000","modified":"2023-08-31T02:01:24.485132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/915893970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":915893970},{"type":"v1","addr":"172.21.15.84:6836","nonce":915893970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T02:01:24.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc2f806a0e0 msgr2=0x7fc2f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:24.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc2f806a0e0 0x7fc2f806c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc30c06f010 tx=0x7fc300009040 comp rx=0 tx=0).stop 2023-08-31T02:01:24.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c152600 msgr2=0x7fc30c147770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:24.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c152600 0x7fc30c147770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc007b50 tx=0x7fc2fc007f10 comp rx=0 tx=0).stop 2023-08-31T02:01:24.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 shutdown_connections 2023-08-31T02:01:24.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc2f806a0e0 0x7fc2f806c5a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc30c15c2b0 0x7fc30c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc30c0cd4f0 0x7fc30c14b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 --2- 172.21.15.84:0/3871372966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc30c152600 0x7fc30c147770 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:24.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 >> 172.21.15.84:0/3871372966 conn(0x7fc30c0cdf00 msgr2=0x7fc30c1598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:24.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 shutdown_connections 2023-08-31T02:01:24.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:24.882+0000 7fc3118b6700 1 -- 172.21.15.84:0/3871372966 wait complete. 2023-08-31T02:01:24.878 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-08-31T02:01:24.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:25.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.018+0000 7f0ff9f28700 1 -- 172.21.15.84:0/4183367507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff40cc170 msgr2=0x7f0ff406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.018+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/4183367507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff40cc170 0x7f0ff406d600 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40099c0 tx=0x7f0fe4009cd0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.018+0000 7f0ff9f28700 1 -- 172.21.15.84:0/4183367507 shutdown_connections 2023-08-31T02:01:25.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.018+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/4183367507 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ff4157a20 0x7f0ff40c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.018+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/4183367507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff40cc170 0x7f0ff406d600 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.018+0000 7f0ff9f28700 1 -- 172.21.15.84:0/4183367507 >> 172.21.15.84:0/4183367507 conn(0x7f0ff40ca090 msgr2=0x7f0ff40ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:25.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.018+0000 7f0ff9f28700 1 -- 172.21.15.84:0/4183367507 shutdown_connections 2023-08-31T02:01:25.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.018+0000 7f0ff9f28700 1 -- 172.21.15.84:0/4183367507 wait complete. 2023-08-31T02:01:25.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.020+0000 7f0ff9f28700 1 Processor -- start 2023-08-31T02:01:25.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.020+0000 7f0ff9f28700 1 -- start start 2023-08-31T02:01:25.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff9f28700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff406ff20 0x7f0ff4145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff9f28700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ff40cc170 0x7f0ff40abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff9f28700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff4157a20 0x7f0ff40c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff9f28700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff406c640 con 0x7f0ff4157a20 2023-08-31T02:01:25.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff9f28700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff406ba80 con 0x7f0ff406ff20 2023-08-31T02:01:25.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff9f28700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4146460 con 0x7f0ff40cc170 2023-08-31T02:01:25.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff4157a20 0x7f0ff40c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff4157a20 0x7f0ff40c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53924/0 (socket says 172.21.15.84:53924) 2023-08-31T02:01:25.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 -- 172.21.15.84:0/2071348122 learned_addr learned my addr 172.21.15.84:0/2071348122 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:25.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 -- 172.21.15.84:0/2071348122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ff40cc170 msgr2=0x7f0ff40abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ff40cc170 0x7f0ff40abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff37fe700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff406ff20 0x7f0ff4145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 -- 172.21.15.84:0/2071348122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff406ff20 msgr2=0x7f0ff4145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff406ff20 0x7f0ff4145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 -- 172.21.15.84:0/2071348122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe40095f0 con 0x7f0ff4157a20 2023-08-31T02:01:25.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff3fff700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff4157a20 0x7f0ff40c6900 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00cae0 tx=0x7f0fec00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:25.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0fdbfff700 1 -- 172.21.15.84:0/2071348122 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec003c50 con 0x7f0ff4157a20 2023-08-31T02:01:25.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0fdbfff700 1 -- 172.21.15.84:0/2071348122 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0fec003dd0 con 0x7f0ff4157a20 2023-08-31T02:01:25.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff406af00 con 0x7f0ff4157a20 2023-08-31T02:01:25.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.021+0000 7f0fdbfff700 1 -- 172.21.15.84:0/2071348122 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00ab20 con 0x7f0ff4157a20 2023-08-31T02:01:25.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.022+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff406b4c0 con 0x7f0ff4157a20 2023-08-31T02:01:25.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.022+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff4143510 con 0x7f0ff4157a20 2023-08-31T02:01:25.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.023+0000 7f0fdbfff700 1 -- 172.21.15.84:0/2071348122 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0fec00ac80 con 0x7f0ff4157a20 2023-08-31T02:01:25.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.023+0000 7f0fdbfff700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fe006a0e0 0x7f0fe006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.023+0000 7f0fdbfff700 1 -- 172.21.15.84:0/2071348122 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fec0887d0 con 0x7f0ff4157a20 2023-08-31T02:01:25.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.023+0000 7f0ff37fe700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fe006a0e0 0x7f0fe006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.024+0000 7f0ff37fe700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fe006a0e0 0x7f0fe006c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800ab90 tx=0x7f0fe800a2f0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:25.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.028+0000 7f0fdbfff700 1 -- 172.21.15.84:0/2071348122 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0fec053de0 con 0x7f0ff4157a20 2023-08-31T02:01:25.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.219+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ff404e7c0 con 0x7f0ff4157a20 2023-08-31T02:01:25.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.220+0000 7f0fdbfff700 1 -- 172.21.15.84:0/2071348122 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f0fec00d150 con 0x7f0ff4157a20 2023-08-31T02:01:25.214 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:25.214 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:22.468991+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T02:01:18.799026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T02:01:19.825366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:25.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fe006a0e0 msgr2=0x7f0fe006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fe006a0e0 0x7f0fe006c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800ab90 tx=0x7f0fe800a2f0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff4157a20 msgr2=0x7f0ff40c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff4157a20 0x7f0ff40c6900 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00cae0 tx=0x7f0fec00cea0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 shutdown_connections 2023-08-31T02:01:25.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0fe006a0e0 0x7f0fe006c5a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff4157a20 0x7f0ff40c6900 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff406ff20 0x7f0ff4145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 --2- 172.21.15.84:0/2071348122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ff40cc170 0x7f0ff40abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 >> 172.21.15.84:0/2071348122 conn(0x7f0ff40ca090 msgr2=0x7f0ff4157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:25.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 shutdown_connections 2023-08-31T02:01:25.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.222+0000 7f0ff9f28700 1 -- 172.21.15.84:0/2071348122 wait complete. 2023-08-31T02:01:25.227 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T02:01:25.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.357+0000 7fc626b8c700 1 -- 172.21.15.84:0/1759738065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc610003f80 msgr2=0x7fc610004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.357+0000 7fc626b8c700 1 --2- 172.21.15.84:0/1759738065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc610003f80 0x7fc610004850 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009d80 tx=0x7fc610005880 comp rx=0 tx=0).stop 2023-08-31T02:01:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.357+0000 7fc625129700 1 -- 172.21.15.84:0/1759738065 reap_dead start 2023-08-31T02:01:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.357+0000 7fc626b8c700 1 -- 172.21.15.84:0/1759738065 shutdown_connections 2023-08-31T02:01:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.357+0000 7fc626b8c700 1 -- 172.21.15.84:0/1759738065 >> 172.21.15.84:0/1759738065 conn(0x7fc6200cd740 msgr2=0x7fc6200cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.357+0000 7fc626b8c700 1 -- 172.21.15.84:0/1759738065 shutdown_connections 2023-08-31T02:01:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.357+0000 7fc626b8c700 1 -- 172.21.15.84:0/1759738065 wait complete. 2023-08-31T02:01:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.358+0000 7fc626b8c700 1 Processor -- start 2023-08-31T02:01:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.358+0000 7fc626b8c700 1 -- start start 2023-08-31T02:01:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc626b8c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc610003f80 0x7fc62014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc626b8c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc62014a1f0 0x7fc620154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc626b8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc620155130 0x7fc620070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc626b8c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620158bb0 con 0x7fc620155130 2023-08-31T02:01:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc626b8c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6201555d0 con 0x7fc610003f80 2023-08-31T02:01:25.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc626b8c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6201558b0 con 0x7fc62014a1f0 2023-08-31T02:01:25.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc620155130 0x7fc620070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc620155130 0x7fc620070040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53944/0 (socket says 172.21.15.84:53944) 2023-08-31T02:01:25.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 -- 172.21.15.84:0/631257270 learned_addr learned my addr 172.21.15.84:0/631257270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:25.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc624928700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc610003f80 0x7fc62014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc61ffff700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc62014a1f0 0x7fc620154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 -- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc62014a1f0 msgr2=0x7fc620154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc62014a1f0 0x7fc620154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 -- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc610003f80 msgr2=0x7fc62014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc610003f80 0x7fc62014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 -- 172.21.15.84:0/631257270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620155b90 con 0x7fc620155130 2023-08-31T02:01:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc624928700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc610003f80 0x7fc62014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.359+0000 7fc625129700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc620155130 0x7fc620070040 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc6200ccff0 tx=0x7fc618011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.360+0000 7fc61d7fa700 1 -- 172.21.15.84:0/631257270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618019070 con 0x7fc620155130 2023-08-31T02:01:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.360+0000 7fc61d7fa700 1 -- 172.21.15.84:0/631257270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc61800f040 con 0x7fc620155130 2023-08-31T02:01:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.360+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc620158840 con 0x7fc620155130 2023-08-31T02:01:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.360+0000 7fc61d7fa700 1 -- 172.21.15.84:0/631257270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800e040 con 0x7fc620155130 2023-08-31T02:01:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.360+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6201566b0 con 0x7fc620155130 2023-08-31T02:01:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.361+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62004e7c0 con 0x7fc620155130 2023-08-31T02:01:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.361+0000 7fc61d7fa700 1 -- 172.21.15.84:0/631257270 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc618003a50 con 0x7fc620155130 2023-08-31T02:01:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.362+0000 7fc61d7fa700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc60406a0e0 0x7fc60406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.362+0000 7fc624928700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc60406a0e0 0x7fc60406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.362+0000 7fc61d7fa700 1 -- 172.21.15.84:0/631257270 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6180883e0 con 0x7fc620155130 2023-08-31T02:01:25.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.362+0000 7fc624928700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc60406a0e0 0x7fc60406c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc614000c00 tx=0x7fc614001e70 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:25.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.366+0000 7fc61d7fa700 1 -- 172.21.15.84:0/631257270 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc618053a80 con 0x7fc620155130 2023-08-31T02:01:25.441 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-08-31T02:01:25.448+0000 7ff966480700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T02:01:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.555+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc620066130 con 0x7fc60406a0e0 2023-08-31T02:01:25.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.563+0000 7fc61d7fa700 1 -- 172.21.15.84:0/631257270 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288250 (secure 0 0 0) 0x7fc620066130 con 0x7fc60406a0e0 2023-08-31T02:01:25.560 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:25.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc60406a0e0 msgr2=0x7fc60406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc60406a0e0 0x7fc60406c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc614000c00 tx=0x7fc614001e70 comp rx=0 tx=0).stop 2023-08-31T02:01:25.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc620155130 msgr2=0x7fc620070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc620155130 0x7fc620070040 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc6200ccff0 tx=0x7fc618011e20 comp rx=0 tx=0).stop 2023-08-31T02:01:25.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 shutdown_connections 2023-08-31T02:01:25.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc60406a0e0 0x7fc60406c5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc620155130 0x7fc620070040 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc610003f80 0x7fc62014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 --2- 172.21.15.84:0/631257270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc62014a1f0 0x7fc620154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 >> 172.21.15.84:0/631257270 conn(0x7fc6200cd740 msgr2=0x7fc620153ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 shutdown_connections 2023-08-31T02:01:25.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.567+0000 7fc626b8c700 1 -- 172.21.15.84:0/631257270 wait complete. 2023-08-31T02:01:25.565 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:25.571 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-08-31T02:01:25.067979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220932,"kb_used_data":4756,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753788,"statfs":{"total":773094113280,"available":772867878912,"internally_reserved":0,"allocated":4870144,"data_stored":2739344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.615040"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472865+0000","last_change":"2023-08-31T02:01:21.483607+0000","last_active":"2023-08-31T02:01:22.472865+0000","last_peered":"2023-08-31T02:01:22.472865+0000","last_clean":"2023-08-31T02:01:22.472865+0000","last_became_active":"2023-08-31T02:01:21.483386+0000","last_became_peered":"2023-08-31T02:01:21.483386+0000","last_unstale":"2023-08-31T02:01:22.472865+0000","last_undegraded":"2023-08-31T02:01:22.472865+0000","last_fullsized":"2023-08-31T02:01:22.472865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472940+0000","last_change":"2023-08-31T02:01:21.479696+0000","last_active":"2023-08-31T02:01:22.472940+0000","last_peered":"2023-08-31T02:01:22.472940+0000","last_clean":"2023-08-31T02:01:22.472940+0000","last_became_active":"2023-08-31T02:01:21.479422+0000","last_became_peered":"2023-08-31T02:01:21.479422+0000","last_unstale":"2023-08-31T02:01:22.472940+0000","last_undegraded":"2023-08-31T02:01:22.472940+0000","last_fullsized":"2023-08-31T02:01:22.472940+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154224+0000","last_change":"2023-08-31T02:01:21.487277+0000","last_active":"2023-08-31T02:01:23.154224+0000","last_peered":"2023-08-31T02:01:23.154224+0000","last_clean":"2023-08-31T02:01:23.154224+0000","last_became_active":"2023-08-31T02:01:21.486976+0000","last_became_peered":"2023-08-31T02:01:21.486976+0000","last_unstale":"2023-08-31T02:01:23.154224+0000","last_undegraded":"2023-08-31T02:01:23.154224+0000","last_fullsized":"2023-08-31T02:01:23.154224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154614+0000","last_change":"2023-08-31T02:01:21.494288+0000","last_active":"2023-08-31T02:01:23.154614+0000","last_peered":"2023-08-31T02:01:23.154614+0000","last_clean":"2023-08-31T02:01:23.154614+0000","last_became_active":"2023-08-31T02:01:21.493886+0000","last_became_peered":"2023-08-31T02:01:21.493886+0000","last_unstale":"2023-08-31T02:01:23.154614+0000","last_undegraded":"2023-08-31T02:01:23.154614+0000","last_fullsized":"2023-08-31T02:01:23.154614+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:40:06.925751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154293+0000","last_change":"2023-08-31T02:01:21.490804+0000","last_active":"2023-08-31T02:01:23.154293+0000","last_peered":"2023-08-31T02:01:23.154293+0000","last_clean":"2023-08-31T02:01:23.154293+0000","last_became_active":"2023-08-31T02:01:21.490531+0000","last_became_peered":"2023-08-31T02:01:21.490531+0000","last_unstale":"2023-08-31T02:01:23.154293+0000","last_undegraded":"2023-08-31T02:01:23.154293+0000","last_fullsized":"2023-08-31T02:01:23.154293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:16:12.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474162+0000","last_change":"2023-08-31T02:01:21.477335+0000","last_active":"2023-08-31T02:01:22.474162+0000","last_peered":"2023-08-31T02:01:22.474162+0000","last_clean":"2023-08-31T02:01:22.474162+0000","last_became_active":"2023-08-31T02:01:21.476978+0000","last_became_peered":"2023-08-31T02:01:21.476978+0000","last_unstale":"2023-08-31T02:01:22.474162+0000","last_undegraded":"2023-08-31T02:01:22.474162+0000","last_fullsized":"2023-08-31T02:01:22.474162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472523+0000","last_change":"2023-08-31T02:01:21.479618+0000","last_active":"2023-08-31T02:01:22.472523+0000","last_peered":"2023-08-31T02:01:22.472523+0000","last_clean":"2023-08-31T02:01:22.472523+0000","last_became_active":"2023-08-31T02:01:21.479344+0000","last_became_peered":"2023-08-31T02:01:21.479344+0000","last_unstale":"2023-08-31T02:01:22.472523+0000","last_undegraded":"2023-08-31T02:01:22.472523+0000","last_fullsized":"2023-08-31T02:01:22.472523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154346+0000","last_change":"2023-08-31T02:01:21.487087+0000","last_active":"2023-08-31T02:01:23.154346+0000","last_peered":"2023-08-31T02:01:23.154346+0000","last_clean":"2023-08-31T02:01:23.154346+0000","last_became_active":"2023-08-31T02:01:21.486783+0000","last_became_peered":"2023-08-31T02:01:21.486783+0000","last_unstale":"2023-08-31T02:01:23.154346+0000","last_undegraded":"2023-08-31T02:01:23.154346+0000","last_fullsized":"2023-08-31T02:01:23.154346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474348+0000","last_change":"2023-08-31T02:01:21.485931+0000","last_active":"2023-08-31T02:01:22.474348+0000","last_peered":"2023-08-31T02:01:22.474348+0000","last_clean":"2023-08-31T02:01:22.474348+0000","last_became_active":"2023-08-31T02:01:21.485666+0000","last_became_peered":"2023-08-31T02:01:21.485666+0000","last_unstale":"2023-08-31T02:01:22.474348+0000","last_undegraded":"2023-08-31T02:01:22.474348+0000","last_fullsized":"2023-08-31T02:01:22.474348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474466+0000","last_change":"2023-08-31T02:01:21.481313+0000","last_active":"2023-08-31T02:01:22.474466+0000","last_peered":"2023-08-31T02:01:22.474466+0000","last_clean":"2023-08-31T02:01:22.474466+0000","last_became_active":"2023-08-31T02:01:21.481052+0000","last_became_peered":"2023-08-31T02:01:21.481052+0000","last_unstale":"2023-08-31T02:01:22.474466+0000","last_undegraded":"2023-08-31T02:01:22.474466+0000","last_fullsized":"2023-08-31T02:01:22.474466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154140+0000","last_change":"2023-08-31T02:01:21.487451+0000","last_active":"2023-08-31T02:01:23.154140+0000","last_peered":"2023-08-31T02:01:23.154140+0000","last_clean":"2023-08-31T02:01:23.154140+0000","last_became_active":"2023-08-31T02:01:21.486899+0000","last_became_peered":"2023-08-31T02:01:21.486899+0000","last_unstale":"2023-08-31T02:01:23.154140+0000","last_undegraded":"2023-08-31T02:01:23.154140+0000","last_fullsized":"2023-08-31T02:01:23.154140+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474198+0000","last_change":"2023-08-31T02:01:21.490530+0000","last_active":"2023-08-31T02:01:22.474198+0000","last_peered":"2023-08-31T02:01:22.474198+0000","last_clean":"2023-08-31T02:01:22.474198+0000","last_became_active":"2023-08-31T02:01:21.490216+0000","last_became_peered":"2023-08-31T02:01:21.490216+0000","last_unstale":"2023-08-31T02:01:22.474198+0000","last_undegraded":"2023-08-31T02:01:22.474198+0000","last_fullsized":"2023-08-31T02:01:22.474198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473438+0000","last_change":"2023-08-31T02:01:21.486405+0000","last_active":"2023-08-31T02:01:22.473438+0000","last_peered":"2023-08-31T02:01:22.473438+0000","last_clean":"2023-08-31T02:01:22.473438+0000","last_became_active":"2023-08-31T02:01:21.485996+0000","last_became_peered":"2023-08-31T02:01:21.485996+0000","last_unstale":"2023-08-31T02:01:22.473438+0000","last_undegraded":"2023-08-31T02:01:22.473438+0000","last_fullsized":"2023-08-31T02:01:22.473438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473444+0000","last_change":"2023-08-31T02:01:21.485585+0000","last_active":"2023-08-31T02:01:22.473444+0000","last_peered":"2023-08-31T02:01:22.473444+0000","last_clean":"2023-08-31T02:01:22.473444+0000","last_became_active":"2023-08-31T02:01:21.484565+0000","last_became_peered":"2023-08-31T02:01:21.484565+0000","last_unstale":"2023-08-31T02:01:22.473444+0000","last_undegraded":"2023-08-31T02:01:22.473444+0000","last_fullsized":"2023-08-31T02:01:22.473444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:22:22.347703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154531+0000","last_change":"2023-08-31T02:01:21.486621+0000","last_active":"2023-08-31T02:01:23.154531+0000","last_peered":"2023-08-31T02:01:23.154531+0000","last_clean":"2023-08-31T02:01:23.154531+0000","last_became_active":"2023-08-31T02:01:21.486282+0000","last_became_peered":"2023-08-31T02:01:21.486282+0000","last_unstale":"2023-08-31T02:01:23.154531+0000","last_undegraded":"2023-08-31T02:01:23.154531+0000","last_fullsized":"2023-08-31T02:01:23.154531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155145+0000","last_change":"2023-08-31T02:01:21.490357+0000","last_active":"2023-08-31T02:01:23.155145+0000","last_peered":"2023-08-31T02:01:23.155145+0000","last_clean":"2023-08-31T02:01:23.155145+0000","last_became_active":"2023-08-31T02:01:21.487866+0000","last_became_peered":"2023-08-31T02:01:21.487866+0000","last_unstale":"2023-08-31T02:01:23.155145+0000","last_undegraded":"2023-08-31T02:01:23.155145+0000","last_fullsized":"2023-08-31T02:01:23.155145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154508+0000","last_change":"2023-08-31T02:01:21.495399+0000","last_active":"2023-08-31T02:01:23.154508+0000","last_peered":"2023-08-31T02:01:23.154508+0000","last_clean":"2023-08-31T02:01:23.154508+0000","last_became_active":"2023-08-31T02:01:21.495110+0000","last_became_peered":"2023-08-31T02:01:21.495110+0000","last_unstale":"2023-08-31T02:01:23.154508+0000","last_undegraded":"2023-08-31T02:01:23.154508+0000","last_fullsized":"2023-08-31T02:01:23.154508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:17.307517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154441+0000","last_change":"2023-08-31T02:01:21.488517+0000","last_active":"2023-08-31T02:01:23.154441+0000","last_peered":"2023-08-31T02:01:23.154441+0000","last_clean":"2023-08-31T02:01:23.154441+0000","last_became_active":"2023-08-31T02:01:21.488239+0000","last_became_peered":"2023-08-31T02:01:21.488239+0000","last_unstale":"2023-08-31T02:01:23.154441+0000","last_undegraded":"2023-08-31T02:01:23.154441+0000","last_fullsized":"2023-08-31T02:01:23.154441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:33.898751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154306+0000","last_change":"2023-08-31T02:01:21.490976+0000","last_active":"2023-08-31T02:01:23.154306+0000","last_peered":"2023-08-31T02:01:23.154306+0000","last_clean":"2023-08-31T02:01:23.154306+0000","last_became_active":"2023-08-31T02:01:21.490707+0000","last_became_peered":"2023-08-31T02:01:21.490707+0000","last_unstale":"2023-08-31T02:01:23.154306+0000","last_undegraded":"2023-08-31T02:01:23.154306+0000","last_fullsized":"2023-08-31T02:01:23.154306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:21:01.584279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474281+0000","last_change":"2023-08-31T02:01:21.487315+0000","last_active":"2023-08-31T02:01:22.474281+0000","last_peered":"2023-08-31T02:01:22.474281+0000","last_clean":"2023-08-31T02:01:22.474281+0000","last_became_active":"2023-08-31T02:01:21.487028+0000","last_became_peered":"2023-08-31T02:01:21.487028+0000","last_unstale":"2023-08-31T02:01:22.474281+0000","last_undegraded":"2023-08-31T02:01:22.474281+0000","last_fullsized":"2023-08-31T02:01:22.474281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473190+0000","last_change":"2023-08-31T02:01:21.486242+0000","last_active":"2023-08-31T02:01:22.473190+0000","last_peered":"2023-08-31T02:01:22.473190+0000","last_clean":"2023-08-31T02:01:22.473190+0000","last_became_active":"2023-08-31T02:01:21.485620+0000","last_became_peered":"2023-08-31T02:01:21.485620+0000","last_unstale":"2023-08-31T02:01:22.473190+0000","last_undegraded":"2023-08-31T02:01:22.473190+0000","last_fullsized":"2023-08-31T02:01:22.473190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154800+0000","last_change":"2023-08-31T02:01:21.495072+0000","last_active":"2023-08-31T02:01:23.154800+0000","last_peered":"2023-08-31T02:01:23.154800+0000","last_clean":"2023-08-31T02:01:23.154800+0000","last_became_active":"2023-08-31T02:01:21.494263+0000","last_became_peered":"2023-08-31T02:01:21.494263+0000","last_unstale":"2023-08-31T02:01:23.154800+0000","last_undegraded":"2023-08-31T02:01:23.154800+0000","last_fullsized":"2023-08-31T02:01:23.154800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153910+0000","last_change":"2023-08-31T02:01:21.494001+0000","last_active":"2023-08-31T02:01:23.153910+0000","last_peered":"2023-08-31T02:01:23.153910+0000","last_clean":"2023-08-31T02:01:23.153910+0000","last_became_active":"2023-08-31T02:01:21.493742+0000","last_became_peered":"2023-08-31T02:01:21.493742+0000","last_unstale":"2023-08-31T02:01:23.153910+0000","last_undegraded":"2023-08-31T02:01:23.153910+0000","last_fullsized":"2023-08-31T02:01:23.153910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:53:45.076676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154521+0000","last_change":"2023-08-31T02:01:21.491466+0000","last_active":"2023-08-31T02:01:23.154521+0000","last_peered":"2023-08-31T02:01:23.154521+0000","last_clean":"2023-08-31T02:01:23.154521+0000","last_became_active":"2023-08-31T02:01:21.488906+0000","last_became_peered":"2023-08-31T02:01:21.488906+0000","last_unstale":"2023-08-31T02:01:23.154521+0000","last_undegraded":"2023-08-31T02:01:23.154521+0000","last_fullsized":"2023-08-31T02:01:23.154521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:53.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154435+0000","last_change":"2023-08-31T02:01:21.495374+0000","last_active":"2023-08-31T02:01:23.154435+0000","last_peered":"2023-08-31T02:01:23.154435+0000","last_clean":"2023-08-31T02:01:23.154435+0000","last_became_active":"2023-08-31T02:01:21.494511+0000","last_became_peered":"2023-08-31T02:01:21.494511+0000","last_unstale":"2023-08-31T02:01:23.154435+0000","last_undegraded":"2023-08-31T02:01:23.154435+0000","last_fullsized":"2023-08-31T02:01:23.154435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:37.313340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474483+0000","last_change":"2023-08-31T02:01:21.486431+0000","last_active":"2023-08-31T02:01:22.474483+0000","last_peered":"2023-08-31T02:01:22.474483+0000","last_clean":"2023-08-31T02:01:22.474483+0000","last_became_active":"2023-08-31T02:01:21.486138+0000","last_became_peered":"2023-08-31T02:01:21.486138+0000","last_unstale":"2023-08-31T02:01:22.474483+0000","last_undegraded":"2023-08-31T02:01:22.474483+0000","last_fullsized":"2023-08-31T02:01:22.474483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154708+0000","last_change":"2023-08-31T02:01:21.492203+0000","last_active":"2023-08-31T02:01:23.154708+0000","last_peered":"2023-08-31T02:01:23.154708+0000","last_clean":"2023-08-31T02:01:23.154708+0000","last_became_active":"2023-08-31T02:01:21.491853+0000","last_became_peered":"2023-08-31T02:01:21.491853+0000","last_unstale":"2023-08-31T02:01:23.154708+0000","last_undegraded":"2023-08-31T02:01:23.154708+0000","last_fullsized":"2023-08-31T02:01:23.154708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:12.582057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155112+0000","last_change":"2023-08-31T02:01:21.489782+0000","last_active":"2023-08-31T02:01:23.155112+0000","last_peered":"2023-08-31T02:01:23.155112+0000","last_clean":"2023-08-31T02:01:23.155112+0000","last_became_active":"2023-08-31T02:01:21.489511+0000","last_became_peered":"2023-08-31T02:01:21.489511+0000","last_unstale":"2023-08-31T02:01:23.155112+0000","last_undegraded":"2023-08-31T02:01:23.155112+0000","last_fullsized":"2023-08-31T02:01:23.155112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:29.822747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154808+0000","last_change":"2023-08-31T02:01:21.494310+0000","last_active":"2023-08-31T02:01:23.154808+0000","last_peered":"2023-08-31T02:01:23.154808+0000","last_clean":"2023-08-31T02:01:23.154808+0000","last_became_active":"2023-08-31T02:01:21.493693+0000","last_became_peered":"2023-08-31T02:01:21.493693+0000","last_unstale":"2023-08-31T02:01:23.154808+0000","last_undegraded":"2023-08-31T02:01:23.154808+0000","last_fullsized":"2023-08-31T02:01:23.154808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154938+0000","last_change":"2023-08-31T02:01:21.488296+0000","last_active":"2023-08-31T02:01:23.154938+0000","last_peered":"2023-08-31T02:01:23.154938+0000","last_clean":"2023-08-31T02:01:23.154938+0000","last_became_active":"2023-08-31T02:01:21.487819+0000","last_became_peered":"2023-08-31T02:01:21.487819+0000","last_unstale":"2023-08-31T02:01:23.154938+0000","last_undegraded":"2023-08-31T02:01:23.154938+0000","last_fullsized":"2023-08-31T02:01:23.154938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:25:18.019269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154497+0000","last_change":"2023-08-31T02:01:20.465896+0000","last_active":"2023-08-31T02:01:23.154497+0000","last_peered":"2023-08-31T02:01:23.154497+0000","last_clean":"2023-08-31T02:01:23.154497+0000","last_became_active":"2023-08-31T02:01:20.465615+0000","last_became_peered":"2023-08-31T02:01:20.465615+0000","last_unstale":"2023-08-31T02:01:23.154497+0000","last_undegraded":"2023-08-31T02:01:23.154497+0000","last_fullsized":"2023-08-31T02:01:23.154497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154252+0000","last_change":"2023-08-31T02:01:20.473610+0000","last_active":"2023-08-31T02:01:23.154252+0000","last_peered":"2023-08-31T02:01:23.154252+0000","last_clean":"2023-08-31T02:01:23.154252+0000","last_became_active":"2023-08-31T02:01:20.473370+0000","last_became_peered":"2023-08-31T02:01:20.473370+0000","last_unstale":"2023-08-31T02:01:23.154252+0000","last_undegraded":"2023-08-31T02:01:23.154252+0000","last_fullsized":"2023-08-31T02:01:23.154252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473534+0000","last_change":"2023-08-31T02:01:21.489900+0000","last_active":"2023-08-31T02:01:22.473534+0000","last_peered":"2023-08-31T02:01:22.473534+0000","last_clean":"2023-08-31T02:01:22.473534+0000","last_became_active":"2023-08-31T02:01:21.489618+0000","last_became_peered":"2023-08-31T02:01:21.489618+0000","last_unstale":"2023-08-31T02:01:22.473534+0000","last_undegraded":"2023-08-31T02:01:22.473534+0000","last_fullsized":"2023-08-31T02:01:22.473534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454626+0000","last_change":"2023-08-31T02:01:19.454626+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454626+0000","last_undegraded":"2023-08-31T02:01:19.454626+0000","last_fullsized":"2023-08-31T02:01:19.454626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473009+0000","last_change":"2023-08-31T02:01:21.494971+0000","last_active":"2023-08-31T02:01:22.473009+0000","last_peered":"2023-08-31T02:01:22.473009+0000","last_clean":"2023-08-31T02:01:22.473009+0000","last_became_active":"2023-08-31T02:01:21.494720+0000","last_became_peered":"2023-08-31T02:01:21.494720+0000","last_unstale":"2023-08-31T02:01:22.473009+0000","last_undegraded":"2023-08-31T02:01:22.473009+0000","last_fullsized":"2023-08-31T02:01:22.473009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473465+0000","last_change":"2023-08-31T02:01:20.473405+0000","last_active":"2023-08-31T02:01:22.473465+0000","last_peered":"2023-08-31T02:01:22.473465+0000","last_clean":"2023-08-31T02:01:22.473465+0000","last_became_active":"2023-08-31T02:01:20.473136+0000","last_became_peered":"2023-08-31T02:01:20.473136+0000","last_unstale":"2023-08-31T02:01:22.473465+0000","last_undegraded":"2023-08-31T02:01:22.473465+0000","last_fullsized":"2023-08-31T02:01:22.473465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:52.204278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154011+0000","last_change":"2023-08-31T02:01:21.492984+0000","last_active":"2023-08-31T02:01:23.154011+0000","last_peered":"2023-08-31T02:01:23.154011+0000","last_clean":"2023-08-31T02:01:23.154011+0000","last_became_active":"2023-08-31T02:01:21.492715+0000","last_became_peered":"2023-08-31T02:01:21.492715+0000","last_unstale":"2023-08-31T02:01:23.154011+0000","last_undegraded":"2023-08-31T02:01:23.154011+0000","last_fullsized":"2023-08-31T02:01:23.154011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474381+0000","last_change":"2023-08-31T02:01:20.473298+0000","last_active":"2023-08-31T02:01:22.474381+0000","last_peered":"2023-08-31T02:01:22.474381+0000","last_clean":"2023-08-31T02:01:22.474381+0000","last_became_active":"2023-08-31T02:01:20.473015+0000","last_became_peered":"2023-08-31T02:01:20.473015+0000","last_unstale":"2023-08-31T02:01:22.474381+0000","last_undegraded":"2023-08-31T02:01:22.474381+0000","last_fullsized":"2023-08-31T02:01:22.474381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:30:14.876894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474030+0000","last_change":"2023-08-31T02:01:21.490644+0000","last_active":"2023-08-31T02:01:22.474030+0000","last_peered":"2023-08-31T02:01:22.474030+0000","last_clean":"2023-08-31T02:01:22.474030+0000","last_became_active":"2023-08-31T02:01:21.490332+0000","last_became_peered":"2023-08-31T02:01:21.490332+0000","last_unstale":"2023-08-31T02:01:22.474030+0000","last_undegraded":"2023-08-31T02:01:22.474030+0000","last_fullsized":"2023-08-31T02:01:22.474030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154648+0000","last_change":"2023-08-31T02:01:20.477111+0000","last_active":"2023-08-31T02:01:23.154648+0000","last_peered":"2023-08-31T02:01:23.154648+0000","last_clean":"2023-08-31T02:01:23.154648+0000","last_became_active":"2023-08-31T02:01:20.476863+0000","last_became_peered":"2023-08-31T02:01:20.476863+0000","last_unstale":"2023-08-31T02:01:23.154648+0000","last_undegraded":"2023-08-31T02:01:23.154648+0000","last_fullsized":"2023-08-31T02:01:23.154648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473095+0000","last_change":"2023-08-31T02:01:21.487297+0000","last_active":"2023-08-31T02:01:22.473095+0000","last_peered":"2023-08-31T02:01:22.473095+0000","last_clean":"2023-08-31T02:01:22.473095+0000","last_became_active":"2023-08-31T02:01:21.487044+0000","last_became_peered":"2023-08-31T02:01:21.487044+0000","last_unstale":"2023-08-31T02:01:22.473095+0000","last_undegraded":"2023-08-31T02:01:22.473095+0000","last_fullsized":"2023-08-31T02:01:22.473095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454640+0000","last_change":"2023-08-31T02:01:19.454640+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454640+0000","last_undegraded":"2023-08-31T02:01:19.454640+0000","last_fullsized":"2023-08-31T02:01:19.454640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473036+0000","last_change":"2023-08-31T02:01:21.488464+0000","last_active":"2023-08-31T02:01:22.473036+0000","last_peered":"2023-08-31T02:01:22.473036+0000","last_clean":"2023-08-31T02:01:22.473036+0000","last_became_active":"2023-08-31T02:01:21.487547+0000","last_became_peered":"2023-08-31T02:01:21.487547+0000","last_unstale":"2023-08-31T02:01:22.473036+0000","last_undegraded":"2023-08-31T02:01:22.473036+0000","last_fullsized":"2023-08-31T02:01:22.473036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472884+0000","last_change":"2023-08-31T02:01:20.463335+0000","last_active":"2023-08-31T02:01:22.472884+0000","last_peered":"2023-08-31T02:01:22.472884+0000","last_clean":"2023-08-31T02:01:22.472884+0000","last_became_active":"2023-08-31T02:01:20.463073+0000","last_became_peered":"2023-08-31T02:01:20.463073+0000","last_unstale":"2023-08-31T02:01:22.472884+0000","last_undegraded":"2023-08-31T02:01:22.472884+0000","last_fullsized":"2023-08-31T02:01:22.472884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:35:51.541453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154755+0000","last_change":"2023-08-31T02:01:21.494127+0000","last_active":"2023-08-31T02:01:23.154755+0000","last_peered":"2023-08-31T02:01:23.154755+0000","last_clean":"2023-08-31T02:01:23.154755+0000","last_became_active":"2023-08-31T02:01:21.491465+0000","last_became_peered":"2023-08-31T02:01:21.491465+0000","last_unstale":"2023-08-31T02:01:23.154755+0000","last_undegraded":"2023-08-31T02:01:23.154755+0000","last_fullsized":"2023-08-31T02:01:23.154755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:36:48.080941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473047+0000","last_change":"2023-08-31T02:01:20.472411+0000","last_active":"2023-08-31T02:01:22.473047+0000","last_peered":"2023-08-31T02:01:22.473047+0000","last_clean":"2023-08-31T02:01:22.473047+0000","last_became_active":"2023-08-31T02:01:20.472124+0000","last_became_peered":"2023-08-31T02:01:20.472124+0000","last_unstale":"2023-08-31T02:01:22.473047+0000","last_undegraded":"2023-08-31T02:01:22.473047+0000","last_fullsized":"2023-08-31T02:01:22.473047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154748+0000","last_change":"2023-08-31T02:01:21.494040+0000","last_active":"2023-08-31T02:01:23.154748+0000","last_peered":"2023-08-31T02:01:23.154748+0000","last_clean":"2023-08-31T02:01:23.154748+0000","last_became_active":"2023-08-31T02:01:21.493350+0000","last_became_peered":"2023-08-31T02:01:21.493350+0000","last_unstale":"2023-08-31T02:01:23.154748+0000","last_undegraded":"2023-08-31T02:01:23.154748+0000","last_fullsized":"2023-08-31T02:01:23.154748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474606+0000","last_change":"2023-08-31T02:01:20.475643+0000","last_active":"2023-08-31T02:01:22.474606+0000","last_peered":"2023-08-31T02:01:22.474606+0000","last_clean":"2023-08-31T02:01:22.474606+0000","last_became_active":"2023-08-31T02:01:20.475359+0000","last_became_peered":"2023-08-31T02:01:20.475359+0000","last_unstale":"2023-08-31T02:01:22.474606+0000","last_undegraded":"2023-08-31T02:01:22.474606+0000","last_fullsized":"2023-08-31T02:01:22.474606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154159+0000","last_change":"2023-08-31T02:01:21.486994+0000","last_active":"2023-08-31T02:01:23.154159+0000","last_peered":"2023-08-31T02:01:23.154159+0000","last_clean":"2023-08-31T02:01:23.154159+0000","last_became_active":"2023-08-31T02:01:21.485891+0000","last_became_peered":"2023-08-31T02:01:21.485891+0000","last_unstale":"2023-08-31T02:01:23.154159+0000","last_undegraded":"2023-08-31T02:01:23.154159+0000","last_fullsized":"2023-08-31T02:01:23.154159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474693+0000","last_change":"2023-08-31T02:01:20.474688+0000","last_active":"2023-08-31T02:01:22.474693+0000","last_peered":"2023-08-31T02:01:22.474693+0000","last_clean":"2023-08-31T02:01:22.474693+0000","last_became_active":"2023-08-31T02:01:20.474417+0000","last_became_peered":"2023-08-31T02:01:20.474417+0000","last_unstale":"2023-08-31T02:01:22.474693+0000","last_undegraded":"2023-08-31T02:01:22.474693+0000","last_fullsized":"2023-08-31T02:01:22.474693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473576+0000","last_change":"2023-08-31T02:01:21.481153+0000","last_active":"2023-08-31T02:01:22.473576+0000","last_peered":"2023-08-31T02:01:22.473576+0000","last_clean":"2023-08-31T02:01:22.473576+0000","last_became_active":"2023-08-31T02:01:21.480678+0000","last_became_peered":"2023-08-31T02:01:21.480678+0000","last_unstale":"2023-08-31T02:01:22.473576+0000","last_undegraded":"2023-08-31T02:01:22.473576+0000","last_fullsized":"2023-08-31T02:01:22.473576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472919+0000","last_change":"2023-08-31T02:01:20.474897+0000","last_active":"2023-08-31T02:01:22.472919+0000","last_peered":"2023-08-31T02:01:22.472919+0000","last_clean":"2023-08-31T02:01:22.472919+0000","last_became_active":"2023-08-31T02:01:20.474227+0000","last_became_peered":"2023-08-31T02:01:20.474227+0000","last_unstale":"2023-08-31T02:01:22.472919+0000","last_undegraded":"2023-08-31T02:01:22.472919+0000","last_fullsized":"2023-08-31T02:01:22.472919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153851+0000","last_change":"2023-08-31T02:01:21.487392+0000","last_active":"2023-08-31T02:01:23.153851+0000","last_peered":"2023-08-31T02:01:23.153851+0000","last_clean":"2023-08-31T02:01:23.153851+0000","last_became_active":"2023-08-31T02:01:21.487162+0000","last_became_peered":"2023-08-31T02:01:21.487162+0000","last_unstale":"2023-08-31T02:01:23.153851+0000","last_undegraded":"2023-08-31T02:01:23.153851+0000","last_fullsized":"2023-08-31T02:01:23.153851+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472807+0000","last_change":"2023-08-31T02:01:20.480632+0000","last_active":"2023-08-31T02:01:22.472807+0000","last_peered":"2023-08-31T02:01:22.472807+0000","last_clean":"2023-08-31T02:01:22.472807+0000","last_became_active":"2023-08-31T02:01:20.480307+0000","last_became_peered":"2023-08-31T02:01:20.480307+0000","last_unstale":"2023-08-31T02:01:22.472807+0000","last_undegraded":"2023-08-31T02:01:22.472807+0000","last_fullsized":"2023-08-31T02:01:22.472807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:27:43.975042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472537+0000","last_change":"2023-08-31T02:01:21.492360+0000","last_active":"2023-08-31T02:01:22.472537+0000","last_peered":"2023-08-31T02:01:22.472537+0000","last_clean":"2023-08-31T02:01:22.472537+0000","last_became_active":"2023-08-31T02:01:21.492055+0000","last_became_peered":"2023-08-31T02:01:21.492055+0000","last_unstale":"2023-08-31T02:01:22.472537+0000","last_undegraded":"2023-08-31T02:01:22.472537+0000","last_fullsized":"2023-08-31T02:01:22.472537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454580+0000","last_change":"2023-08-31T02:01:19.454580+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454580+0000","last_undegraded":"2023-08-31T02:01:19.454580+0000","last_fullsized":"2023-08-31T02:01:19.454580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154659+0000","last_change":"2023-08-31T02:01:21.494582+0000","last_active":"2023-08-31T02:01:23.154659+0000","last_peered":"2023-08-31T02:01:23.154659+0000","last_clean":"2023-08-31T02:01:23.154659+0000","last_became_active":"2023-08-31T02:01:21.494273+0000","last_became_peered":"2023-08-31T02:01:21.494273+0000","last_unstale":"2023-08-31T02:01:23.154659+0000","last_undegraded":"2023-08-31T02:01:23.154659+0000","last_fullsized":"2023-08-31T02:01:23.154659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154231+0000","last_change":"2023-08-31T02:01:20.466640+0000","last_active":"2023-08-31T02:01:23.154231+0000","last_peered":"2023-08-31T02:01:23.154231+0000","last_clean":"2023-08-31T02:01:23.154231+0000","last_became_active":"2023-08-31T02:01:20.466315+0000","last_became_peered":"2023-08-31T02:01:20.466315+0000","last_unstale":"2023-08-31T02:01:23.154231+0000","last_undegraded":"2023-08-31T02:01:23.154231+0000","last_fullsized":"2023-08-31T02:01:23.154231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472600+0000","last_change":"2023-08-31T02:01:21.488792+0000","last_active":"2023-08-31T02:01:22.472600+0000","last_peered":"2023-08-31T02:01:22.472600+0000","last_clean":"2023-08-31T02:01:22.472600+0000","last_became_active":"2023-08-31T02:01:21.488218+0000","last_became_peered":"2023-08-31T02:01:21.488218+0000","last_unstale":"2023-08-31T02:01:22.472600+0000","last_undegraded":"2023-08-31T02:01:22.472600+0000","last_fullsized":"2023-08-31T02:01:22.472600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155040+0000","last_change":"2023-08-31T02:01:20.476965+0000","last_active":"2023-08-31T02:01:23.155040+0000","last_peered":"2023-08-31T02:01:23.155040+0000","last_clean":"2023-08-31T02:01:23.155040+0000","last_became_active":"2023-08-31T02:01:20.476698+0000","last_became_peered":"2023-08-31T02:01:20.476698+0000","last_unstale":"2023-08-31T02:01:23.155040+0000","last_undegraded":"2023-08-31T02:01:23.155040+0000","last_fullsized":"2023-08-31T02:01:23.155040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472783+0000","last_change":"2023-08-31T02:01:21.493915+0000","last_active":"2023-08-31T02:01:22.472783+0000","last_peered":"2023-08-31T02:01:22.472783+0000","last_clean":"2023-08-31T02:01:22.472783+0000","last_became_active":"2023-08-31T02:01:21.493676+0000","last_became_peered":"2023-08-31T02:01:21.493676+0000","last_unstale":"2023-08-31T02:01:22.472783+0000","last_undegraded":"2023-08-31T02:01:22.472783+0000","last_fullsized":"2023-08-31T02:01:22.472783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474583+0000","last_change":"2023-08-31T02:01:20.477508+0000","last_active":"2023-08-31T02:01:22.474583+0000","last_peered":"2023-08-31T02:01:22.474583+0000","last_clean":"2023-08-31T02:01:22.474583+0000","last_became_active":"2023-08-31T02:01:20.477260+0000","last_became_peered":"2023-08-31T02:01:20.477260+0000","last_unstale":"2023-08-31T02:01:22.474583+0000","last_undegraded":"2023-08-31T02:01:22.474583+0000","last_fullsized":"2023-08-31T02:01:22.474583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:44:05.421419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474724+0000","last_change":"2023-08-31T02:01:21.491870+0000","last_active":"2023-08-31T02:01:22.474724+0000","last_peered":"2023-08-31T02:01:22.474724+0000","last_clean":"2023-08-31T02:01:22.474724+0000","last_became_active":"2023-08-31T02:01:21.491592+0000","last_became_peered":"2023-08-31T02:01:21.491592+0000","last_unstale":"2023-08-31T02:01:22.474724+0000","last_undegraded":"2023-08-31T02:01:22.474724+0000","last_fullsized":"2023-08-31T02:01:22.474724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473493+0000","last_change":"2023-08-31T02:01:20.475956+0000","last_active":"2023-08-31T02:01:22.473493+0000","last_peered":"2023-08-31T02:01:22.473493+0000","last_clean":"2023-08-31T02:01:22.473493+0000","last_became_active":"2023-08-31T02:01:20.475694+0000","last_became_peered":"2023-08-31T02:01:20.475694+0000","last_unstale":"2023-08-31T02:01:22.473493+0000","last_undegraded":"2023-08-31T02:01:22.473493+0000","last_fullsized":"2023-08-31T02:01:22.473493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473616+0000","last_change":"2023-08-31T02:01:21.491382+0000","last_active":"2023-08-31T02:01:22.473616+0000","last_peered":"2023-08-31T02:01:22.473616+0000","last_clean":"2023-08-31T02:01:22.473616+0000","last_became_active":"2023-08-31T02:01:21.491114+0000","last_became_peered":"2023-08-31T02:01:21.491114+0000","last_unstale":"2023-08-31T02:01:22.473616+0000","last_undegraded":"2023-08-31T02:01:22.473616+0000","last_fullsized":"2023-08-31T02:01:22.473616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154526+0000","last_change":"2023-08-31T02:01:20.474505+0000","last_active":"2023-08-31T02:01:23.154526+0000","last_peered":"2023-08-31T02:01:23.154526+0000","last_clean":"2023-08-31T02:01:23.154526+0000","last_became_active":"2023-08-31T02:01:20.474179+0000","last_became_peered":"2023-08-31T02:01:20.474179+0000","last_unstale":"2023-08-31T02:01:23.154526+0000","last_undegraded":"2023-08-31T02:01:23.154526+0000","last_fullsized":"2023-08-31T02:01:23.154526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:02:02.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154570+0000","last_change":"2023-08-31T02:01:21.491206+0000","last_active":"2023-08-31T02:01:23.154570+0000","last_peered":"2023-08-31T02:01:23.154570+0000","last_clean":"2023-08-31T02:01:23.154570+0000","last_became_active":"2023-08-31T02:01:21.490947+0000","last_became_peered":"2023-08-31T02:01:21.490947+0000","last_unstale":"2023-08-31T02:01:23.154570+0000","last_undegraded":"2023-08-31T02:01:23.154570+0000","last_fullsized":"2023-08-31T02:01:23.154570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:55.955512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454653+0000","last_change":"2023-08-31T02:01:19.454653+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454653+0000","last_undegraded":"2023-08-31T02:01:19.454653+0000","last_fullsized":"2023-08-31T02:01:19.454653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155214+0000","last_change":"2023-08-31T02:01:21.494374+0000","last_active":"2023-08-31T02:01:23.155214+0000","last_peered":"2023-08-31T02:01:23.155214+0000","last_clean":"2023-08-31T02:01:23.155214+0000","last_became_active":"2023-08-31T02:01:21.494077+0000","last_became_peered":"2023-08-31T02:01:21.494077+0000","last_unstale":"2023-08-31T02:01:23.155214+0000","last_undegraded":"2023-08-31T02:01:23.155214+0000","last_fullsized":"2023-08-31T02:01:23.155214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:19:25.263827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154576+0000","last_change":"2023-08-31T02:01:20.467838+0000","last_active":"2023-08-31T02:01:23.154576+0000","last_peered":"2023-08-31T02:01:23.154576+0000","last_clean":"2023-08-31T02:01:23.154576+0000","last_became_active":"2023-08-31T02:01:20.467567+0000","last_became_peered":"2023-08-31T02:01:20.467567+0000","last_unstale":"2023-08-31T02:01:23.154576+0000","last_undegraded":"2023-08-31T02:01:23.154576+0000","last_fullsized":"2023-08-31T02:01:23.154576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:27:02.795050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154093+0000","last_change":"2023-08-31T02:01:21.491262+0000","last_active":"2023-08-31T02:01:23.154093+0000","last_peered":"2023-08-31T02:01:23.154093+0000","last_clean":"2023-08-31T02:01:23.154093+0000","last_became_active":"2023-08-31T02:01:21.490982+0000","last_became_peered":"2023-08-31T02:01:21.490982+0000","last_unstale":"2023-08-31T02:01:23.154093+0000","last_undegraded":"2023-08-31T02:01:23.154093+0000","last_fullsized":"2023-08-31T02:01:23.154093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154338+0000","last_change":"2023-08-31T02:01:20.469596+0000","last_active":"2023-08-31T02:01:23.154338+0000","last_peered":"2023-08-31T02:01:23.154338+0000","last_clean":"2023-08-31T02:01:23.154338+0000","last_became_active":"2023-08-31T02:01:20.469290+0000","last_became_peered":"2023-08-31T02:01:20.469290+0000","last_unstale":"2023-08-31T02:01:23.154338+0000","last_undegraded":"2023-08-31T02:01:23.154338+0000","last_fullsized":"2023-08-31T02:01:23.154338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:27:42.568205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474353+0000","last_change":"2023-08-31T02:01:21.493623+0000","last_active":"2023-08-31T02:01:22.474353+0000","last_peered":"2023-08-31T02:01:22.474353+0000","last_clean":"2023-08-31T02:01:22.474353+0000","last_became_active":"2023-08-31T02:01:21.493369+0000","last_became_peered":"2023-08-31T02:01:21.493369+0000","last_unstale":"2023-08-31T02:01:22.474353+0000","last_undegraded":"2023-08-31T02:01:22.474353+0000","last_fullsized":"2023-08-31T02:01:22.474353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:20.474557+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:20.474269+0000","last_became_peered":"2023-08-31T02:01:20.474269+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472721+0000","last_change":"2023-08-31T02:01:21.488629+0000","last_active":"2023-08-31T02:01:22.472721+0000","last_peered":"2023-08-31T02:01:22.472721+0000","last_clean":"2023-08-31T02:01:22.472721+0000","last_became_active":"2023-08-31T02:01:21.487877+0000","last_became_peered":"2023-08-31T02:01:21.487877+0000","last_unstale":"2023-08-31T02:01:22.472721+0000","last_undegraded":"2023-08-31T02:01:22.472721+0000","last_fullsized":"2023-08-31T02:01:22.472721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153853+0000","last_change":"2023-08-31T02:01:20.474084+0000","last_active":"2023-08-31T02:01:23.153853+0000","last_peered":"2023-08-31T02:01:23.153853+0000","last_clean":"2023-08-31T02:01:23.153853+0000","last_became_active":"2023-08-31T02:01:20.473811+0000","last_became_peered":"2023-08-31T02:01:20.473811+0000","last_unstale":"2023-08-31T02:01:23.153853+0000","last_undegraded":"2023-08-31T02:01:23.153853+0000","last_fullsized":"2023-08-31T02:01:23.153853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:18:30.609765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474465+0000","last_change":"2023-08-31T02:01:20.474116+0000","last_active":"2023-08-31T02:01:22.474465+0000","last_peered":"2023-08-31T02:01:22.474465+0000","last_clean":"2023-08-31T02:01:22.474465+0000","last_became_active":"2023-08-31T02:01:20.473855+0000","last_became_peered":"2023-08-31T02:01:20.473855+0000","last_unstale":"2023-08-31T02:01:22.474465+0000","last_undegraded":"2023-08-31T02:01:22.474465+0000","last_fullsized":"2023-08-31T02:01:22.474465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:41:18.994166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:21.494457+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:21.493732+0000","last_became_peered":"2023-08-31T02:01:21.493732+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.600588+0000","last_change":"2023-08-31T02:01:20.474656+0000","last_active":"2023-08-31T02:01:23.600588+0000","last_peered":"2023-08-31T02:01:23.600588+0000","last_clean":"2023-08-31T02:01:23.600588+0000","last_became_active":"2023-08-31T02:01:20.474369+0000","last_became_peered":"2023-08-31T02:01:20.474369+0000","last_unstale":"2023-08-31T02:01:23.600588+0000","last_undegraded":"2023-08-31T02:01:23.600588+0000","last_fullsized":"2023-08-31T02:01:23.600588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:45:00.848193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473070+0000","last_change":"2023-08-31T02:01:21.477794+0000","last_active":"2023-08-31T02:01:22.473070+0000","last_peered":"2023-08-31T02:01:22.473070+0000","last_clean":"2023-08-31T02:01:22.473070+0000","last_became_active":"2023-08-31T02:01:21.477508+0000","last_became_peered":"2023-08-31T02:01:21.477508+0000","last_unstale":"2023-08-31T02:01:22.473070+0000","last_undegraded":"2023-08-31T02:01:22.473070+0000","last_fullsized":"2023-08-31T02:01:22.473070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154313+0000","last_change":"2023-08-31T02:01:20.474392+0000","last_active":"2023-08-31T02:01:23.154313+0000","last_peered":"2023-08-31T02:01:23.154313+0000","last_clean":"2023-08-31T02:01:23.154313+0000","last_became_active":"2023-08-31T02:01:20.473883+0000","last_became_peered":"2023-08-31T02:01:20.473883+0000","last_unstale":"2023-08-31T02:01:23.154313+0000","last_undegraded":"2023-08-31T02:01:23.154313+0000","last_fullsized":"2023-08-31T02:01:23.154313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:36.309094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153979+0000","last_change":"2023-08-31T02:01:21.484480+0000","last_active":"2023-08-31T02:01:23.153979+0000","last_peered":"2023-08-31T02:01:23.153979+0000","last_clean":"2023-08-31T02:01:23.153979+0000","last_became_active":"2023-08-31T02:01:21.484215+0000","last_became_peered":"2023-08-31T02:01:21.484215+0000","last_unstale":"2023-08-31T02:01:23.153979+0000","last_undegraded":"2023-08-31T02:01:23.153979+0000","last_fullsized":"2023-08-31T02:01:23.153979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154406+0000","last_change":"2023-08-31T02:01:20.470456+0000","last_active":"2023-08-31T02:01:23.154406+0000","last_peered":"2023-08-31T02:01:23.154406+0000","last_clean":"2023-08-31T02:01:23.154406+0000","last_became_active":"2023-08-31T02:01:20.470196+0000","last_became_peered":"2023-08-31T02:01:20.470196+0000","last_unstale":"2023-08-31T02:01:23.154406+0000","last_undegraded":"2023-08-31T02:01:23.154406+0000","last_fullsized":"2023-08-31T02:01:23.154406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155067+0000","last_change":"2023-08-31T02:01:20.473075+0000","last_active":"2023-08-31T02:01:23.155067+0000","last_peered":"2023-08-31T02:01:23.155067+0000","last_clean":"2023-08-31T02:01:23.155067+0000","last_became_active":"2023-08-31T02:01:20.472816+0000","last_became_peered":"2023-08-31T02:01:20.472816+0000","last_unstale":"2023-08-31T02:01:23.155067+0000","last_undegraded":"2023-08-31T02:01:23.155067+0000","last_fullsized":"2023-08-31T02:01:23.155067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473306+0000","last_change":"2023-08-31T02:01:21.480979+0000","last_active":"2023-08-31T02:01:22.473306+0000","last_peered":"2023-08-31T02:01:22.473306+0000","last_clean":"2023-08-31T02:01:22.473306+0000","last_became_active":"2023-08-31T02:01:21.480663+0000","last_became_peered":"2023-08-31T02:01:21.480663+0000","last_unstale":"2023-08-31T02:01:22.473306+0000","last_undegraded":"2023-08-31T02:01:22.473306+0000","last_fullsized":"2023-08-31T02:01:22.473306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472970+0000","last_change":"2023-08-31T02:01:20.471925+0000","last_active":"2023-08-31T02:01:22.472970+0000","last_peered":"2023-08-31T02:01:22.472970+0000","last_clean":"2023-08-31T02:01:22.472970+0000","last_became_active":"2023-08-31T02:01:20.471633+0000","last_became_peered":"2023-08-31T02:01:20.471633+0000","last_unstale":"2023-08-31T02:01:22.472970+0000","last_undegraded":"2023-08-31T02:01:22.472970+0000","last_fullsized":"2023-08-31T02:01:22.472970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155077+0000","last_change":"2023-08-31T02:01:21.490803+0000","last_active":"2023-08-31T02:01:23.155077+0000","last_peered":"2023-08-31T02:01:23.155077+0000","last_clean":"2023-08-31T02:01:23.155077+0000","last_became_active":"2023-08-31T02:01:21.490535+0000","last_became_peered":"2023-08-31T02:01:21.490535+0000","last_unstale":"2023-08-31T02:01:23.155077+0000","last_undegraded":"2023-08-31T02:01:23.155077+0000","last_fullsized":"2023-08-31T02:01:23.155077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:17:07.573441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472499+0000","last_change":"2023-08-31T02:01:20.473424+0000","last_active":"2023-08-31T02:01:22.472499+0000","last_peered":"2023-08-31T02:01:22.472499+0000","last_clean":"2023-08-31T02:01:22.472499+0000","last_became_active":"2023-08-31T02:01:20.473069+0000","last_became_peered":"2023-08-31T02:01:20.473069+0000","last_unstale":"2023-08-31T02:01:22.472499+0000","last_undegraded":"2023-08-31T02:01:22.472499+0000","last_fullsized":"2023-08-31T02:01:22.472499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:19:53.569012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474460+0000","last_change":"2023-08-31T02:01:21.478455+0000","last_active":"2023-08-31T02:01:22.474460+0000","last_peered":"2023-08-31T02:01:22.474460+0000","last_clean":"2023-08-31T02:01:22.474460+0000","last_became_active":"2023-08-31T02:01:21.476993+0000","last_became_peered":"2023-08-31T02:01:21.476993+0000","last_unstale":"2023-08-31T02:01:22.474460+0000","last_undegraded":"2023-08-31T02:01:22.474460+0000","last_fullsized":"2023-08-31T02:01:22.474460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155095+0000","last_change":"2023-08-31T02:01:20.477325+0000","last_active":"2023-08-31T02:01:23.155095+0000","last_peered":"2023-08-31T02:01:23.155095+0000","last_clean":"2023-08-31T02:01:23.155095+0000","last_became_active":"2023-08-31T02:01:20.476450+0000","last_became_peered":"2023-08-31T02:01:20.476450+0000","last_unstale":"2023-08-31T02:01:23.155095+0000","last_undegraded":"2023-08-31T02:01:23.155095+0000","last_fullsized":"2023-08-31T02:01:23.155095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480301+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:21.480301+0000","last_peered":"2023-08-31T02:01:21.480301+0000","last_clean":"2023-08-31T02:01:21.480301+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:21.480301+0000","last_undegraded":"2023-08-31T02:01:21.480301+0000","last_fullsized":"2023-08-31T02:01:21.480301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.74,"5min":11.74,"15min":11.74},"last":0.318}]},{"osd":4,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.436}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":11.707000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.659000000000001,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":11.628,"5min":11.628,"15min":11.628},"last":0.41399999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1069056,"data_stored":789651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":788003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.62}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.309},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.6799999999999997,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.71,"5min":5.71,"15min":5.71},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.621},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.8579999999999997,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.64900000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":199247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.308}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.372},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.45300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.495},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.627}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":198183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.8460000000000001,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:25.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:25.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 -- 172.21.15.84:0/4008454180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0380cb170 msgr2=0x7ff0380b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/4008454180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0380cb170 0x7ff0380b0970 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff03806f7f0 tx=0x7ff02c009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:25.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 -- 172.21.15.84:0/4008454180 shutdown_connections 2023-08-31T02:01:25.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/4008454180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0380b0eb0 0x7ff0380ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/4008454180 >> v2:172.21.15.170:3300/0 conn(0x7ff038153770 0x7ff0380c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/4008454180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0380cb170 0x7ff0380b0970 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 -- 172.21.15.84:0/4008454180 >> 172.21.15.84:0/4008454180 conn(0x7ff0380cba80 msgr2=0x7ff0380cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:25.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 -- 172.21.15.84:0/4008454180 shutdown_connections 2023-08-31T02:01:25.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.741+0000 7ff03ca9a700 1 -- 172.21.15.84:0/4008454180 wait complete. 2023-08-31T02:01:25.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.742+0000 7ff03ca9a700 1 Processor -- start 2023-08-31T02:01:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.742+0000 7ff03ca9a700 1 -- start start 2023-08-31T02:01:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff03ca9a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0380b0eb0 0x7ff0381423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff03ca9a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0380cb170 0x7ff0380c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff03ca9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff038153770 0x7ff0380c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff03ca9a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03813fe80 con 0x7ff038153770 2023-08-31T02:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff03ca9a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380c8c40 con 0x7ff0380cb170 2023-08-31T02:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff03ca9a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380c1ee0 con 0x7ff0380b0eb0 2023-08-31T02:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff036d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff038153770 0x7ff0380c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff036d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff038153770 0x7ff0380c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53958/0 (socket says 172.21.15.84:53958) 2023-08-31T02:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff036d9d700 1 -- 172.21.15.84:0/3445537025 learned_addr learned my addr 172.21.15.84:0/3445537025 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:25.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff035d9b700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0380cb170 0x7ff0380c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.743+0000 7ff03659c700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0380b0eb0 0x7ff0381423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff036d9d700 1 -- 172.21.15.84:0/3445537025 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0380b0eb0 msgr2=0x7ff0381423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff036d9d700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0380b0eb0 0x7ff0381423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff036d9d700 1 -- 172.21.15.84:0/3445537025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0380cb170 msgr2=0x7ff0380c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff036d9d700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0380cb170 0x7ff0380c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff036d9d700 1 -- 172.21.15.84:0/3445537025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0095f0 con 0x7ff038153770 2023-08-31T02:01:25.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff036d9d700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff038153770 0x7ff0380c8700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff03000add0 tx=0x7ff03000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:25.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff026ffd700 1 -- 172.21.15.84:0/3445537025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000f070 con 0x7ff038153770 2023-08-31T02:01:25.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff026ffd700 1 -- 172.21.15.84:0/3445537025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff03000ae00 con 0x7ff038153770 2023-08-31T02:01:25.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0380c8e90 con 0x7ff038153770 2023-08-31T02:01:25.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff026ffd700 1 -- 172.21.15.84:0/3445537025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030004e10 con 0x7ff038153770 2023-08-31T02:01:25.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.744+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0380c9450 con 0x7ff038153770 2023-08-31T02:01:25.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.745+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03804e7c0 con 0x7ff038153770 2023-08-31T02:01:25.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.745+0000 7ff026ffd700 1 -- 172.21.15.84:0/3445537025 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff03000c890 con 0x7ff038153770 2023-08-31T02:01:25.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.746+0000 7ff026ffd700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff01806a110 0x7ff01806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:25.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.746+0000 7ff026ffd700 1 -- 172.21.15.84:0/3445537025 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff0300880c0 con 0x7ff038153770 2023-08-31T02:01:25.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.746+0000 7ff03659c700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff01806a110 0x7ff01806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:25.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.746+0000 7ff03659c700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff01806a110 0x7ff01806c5d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff02800ab40 tx=0x7ff02800a2d0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.750+0000 7ff026ffd700 1 -- 172.21.15.84:0/3445537025 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff0300537f0 con 0x7ff038153770 2023-08-31T02:01:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.933+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff03815d9c0 con 0x7ff01806a110 2023-08-31T02:01:25.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.941+0000 7ff026ffd700 1 -- 172.21.15.84:0/3445537025 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288250 (secure 0 0 0) 0x7ff028014070 con 0x7ff01806a110 2023-08-31T02:01:25.978 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:25.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff01806a110 msgr2=0x7ff01806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff01806a110 0x7ff01806c5d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff02800ab40 tx=0x7ff02800a2d0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff038153770 msgr2=0x7ff0380c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff038153770 0x7ff0380c8700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff03000add0 tx=0x7ff03000c330 comp rx=0 tx=0).stop 2023-08-31T02:01:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 shutdown_connections 2023-08-31T02:01:25.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff01806a110 0x7ff01806c5d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff038153770 0x7ff0380c8700 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0380b0eb0 0x7ff0381423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 --2- 172.21.15.84:0/3445537025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0380cb170 0x7ff0380c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:25.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 >> 172.21.15.84:0/3445537025 conn(0x7ff0380cba80 msgr2=0x7ff038150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:25.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 shutdown_connections 2023-08-31T02:01:25.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:25.944+0000 7ff03ca9a700 1 -- 172.21.15.84:0/3445537025 wait complete. 2023-08-31T02:01:25.983 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:25.983 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-08-31T02:01:25.067979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220932,"kb_used_data":4756,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753788,"statfs":{"total":773094113280,"available":772867878912,"internally_reserved":0,"allocated":4870144,"data_stored":2739344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.615040"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472865+0000","last_change":"2023-08-31T02:01:21.483607+0000","last_active":"2023-08-31T02:01:22.472865+0000","last_peered":"2023-08-31T02:01:22.472865+0000","last_clean":"2023-08-31T02:01:22.472865+0000","last_became_active":"2023-08-31T02:01:21.483386+0000","last_became_peered":"2023-08-31T02:01:21.483386+0000","last_unstale":"2023-08-31T02:01:22.472865+0000","last_undegraded":"2023-08-31T02:01:22.472865+0000","last_fullsized":"2023-08-31T02:01:22.472865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472940+0000","last_change":"2023-08-31T02:01:21.479696+0000","last_active":"2023-08-31T02:01:22.472940+0000","last_peered":"2023-08-31T02:01:22.472940+0000","last_clean":"2023-08-31T02:01:22.472940+0000","last_became_active":"2023-08-31T02:01:21.479422+0000","last_became_peered":"2023-08-31T02:01:21.479422+0000","last_unstale":"2023-08-31T02:01:22.472940+0000","last_undegraded":"2023-08-31T02:01:22.472940+0000","last_fullsized":"2023-08-31T02:01:22.472940+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154224+0000","last_change":"2023-08-31T02:01:21.487277+0000","last_active":"2023-08-31T02:01:23.154224+0000","last_peered":"2023-08-31T02:01:23.154224+0000","last_clean":"2023-08-31T02:01:23.154224+0000","last_became_active":"2023-08-31T02:01:21.486976+0000","last_became_peered":"2023-08-31T02:01:21.486976+0000","last_unstale":"2023-08-31T02:01:23.154224+0000","last_undegraded":"2023-08-31T02:01:23.154224+0000","last_fullsized":"2023-08-31T02:01:23.154224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154614+0000","last_change":"2023-08-31T02:01:21.494288+0000","last_active":"2023-08-31T02:01:23.154614+0000","last_peered":"2023-08-31T02:01:23.154614+0000","last_clean":"2023-08-31T02:01:23.154614+0000","last_became_active":"2023-08-31T02:01:21.493886+0000","last_became_peered":"2023-08-31T02:01:21.493886+0000","last_unstale":"2023-08-31T02:01:23.154614+0000","last_undegraded":"2023-08-31T02:01:23.154614+0000","last_fullsized":"2023-08-31T02:01:23.154614+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:40:06.925751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154293+0000","last_change":"2023-08-31T02:01:21.490804+0000","last_active":"2023-08-31T02:01:23.154293+0000","last_peered":"2023-08-31T02:01:23.154293+0000","last_clean":"2023-08-31T02:01:23.154293+0000","last_became_active":"2023-08-31T02:01:21.490531+0000","last_became_peered":"2023-08-31T02:01:21.490531+0000","last_unstale":"2023-08-31T02:01:23.154293+0000","last_undegraded":"2023-08-31T02:01:23.154293+0000","last_fullsized":"2023-08-31T02:01:23.154293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:16:12.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474162+0000","last_change":"2023-08-31T02:01:21.477335+0000","last_active":"2023-08-31T02:01:22.474162+0000","last_peered":"2023-08-31T02:01:22.474162+0000","last_clean":"2023-08-31T02:01:22.474162+0000","last_became_active":"2023-08-31T02:01:21.476978+0000","last_became_peered":"2023-08-31T02:01:21.476978+0000","last_unstale":"2023-08-31T02:01:22.474162+0000","last_undegraded":"2023-08-31T02:01:22.474162+0000","last_fullsized":"2023-08-31T02:01:22.474162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472523+0000","last_change":"2023-08-31T02:01:21.479618+0000","last_active":"2023-08-31T02:01:22.472523+0000","last_peered":"2023-08-31T02:01:22.472523+0000","last_clean":"2023-08-31T02:01:22.472523+0000","last_became_active":"2023-08-31T02:01:21.479344+0000","last_became_peered":"2023-08-31T02:01:21.479344+0000","last_unstale":"2023-08-31T02:01:22.472523+0000","last_undegraded":"2023-08-31T02:01:22.472523+0000","last_fullsized":"2023-08-31T02:01:22.472523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154346+0000","last_change":"2023-08-31T02:01:21.487087+0000","last_active":"2023-08-31T02:01:23.154346+0000","last_peered":"2023-08-31T02:01:23.154346+0000","last_clean":"2023-08-31T02:01:23.154346+0000","last_became_active":"2023-08-31T02:01:21.486783+0000","last_became_peered":"2023-08-31T02:01:21.486783+0000","last_unstale":"2023-08-31T02:01:23.154346+0000","last_undegraded":"2023-08-31T02:01:23.154346+0000","last_fullsized":"2023-08-31T02:01:23.154346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474348+0000","last_change":"2023-08-31T02:01:21.485931+0000","last_active":"2023-08-31T02:01:22.474348+0000","last_peered":"2023-08-31T02:01:22.474348+0000","last_clean":"2023-08-31T02:01:22.474348+0000","last_became_active":"2023-08-31T02:01:21.485666+0000","last_became_peered":"2023-08-31T02:01:21.485666+0000","last_unstale":"2023-08-31T02:01:22.474348+0000","last_undegraded":"2023-08-31T02:01:22.474348+0000","last_fullsized":"2023-08-31T02:01:22.474348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474466+0000","last_change":"2023-08-31T02:01:21.481313+0000","last_active":"2023-08-31T02:01:22.474466+0000","last_peered":"2023-08-31T02:01:22.474466+0000","last_clean":"2023-08-31T02:01:22.474466+0000","last_became_active":"2023-08-31T02:01:21.481052+0000","last_became_peered":"2023-08-31T02:01:21.481052+0000","last_unstale":"2023-08-31T02:01:22.474466+0000","last_undegraded":"2023-08-31T02:01:22.474466+0000","last_fullsized":"2023-08-31T02:01:22.474466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154140+0000","last_change":"2023-08-31T02:01:21.487451+0000","last_active":"2023-08-31T02:01:23.154140+0000","last_peered":"2023-08-31T02:01:23.154140+0000","last_clean":"2023-08-31T02:01:23.154140+0000","last_became_active":"2023-08-31T02:01:21.486899+0000","last_became_peered":"2023-08-31T02:01:21.486899+0000","last_unstale":"2023-08-31T02:01:23.154140+0000","last_undegraded":"2023-08-31T02:01:23.154140+0000","last_fullsized":"2023-08-31T02:01:23.154140+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474198+0000","last_change":"2023-08-31T02:01:21.490530+0000","last_active":"2023-08-31T02:01:22.474198+0000","last_peered":"2023-08-31T02:01:22.474198+0000","last_clean":"2023-08-31T02:01:22.474198+0000","last_became_active":"2023-08-31T02:01:21.490216+0000","last_became_peered":"2023-08-31T02:01:21.490216+0000","last_unstale":"2023-08-31T02:01:22.474198+0000","last_undegraded":"2023-08-31T02:01:22.474198+0000","last_fullsized":"2023-08-31T02:01:22.474198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473438+0000","last_change":"2023-08-31T02:01:21.486405+0000","last_active":"2023-08-31T02:01:22.473438+0000","last_peered":"2023-08-31T02:01:22.473438+0000","last_clean":"2023-08-31T02:01:22.473438+0000","last_became_active":"2023-08-31T02:01:21.485996+0000","last_became_peered":"2023-08-31T02:01:21.485996+0000","last_unstale":"2023-08-31T02:01:22.473438+0000","last_undegraded":"2023-08-31T02:01:22.473438+0000","last_fullsized":"2023-08-31T02:01:22.473438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473444+0000","last_change":"2023-08-31T02:01:21.485585+0000","last_active":"2023-08-31T02:01:22.473444+0000","last_peered":"2023-08-31T02:01:22.473444+0000","last_clean":"2023-08-31T02:01:22.473444+0000","last_became_active":"2023-08-31T02:01:21.484565+0000","last_became_peered":"2023-08-31T02:01:21.484565+0000","last_unstale":"2023-08-31T02:01:22.473444+0000","last_undegraded":"2023-08-31T02:01:22.473444+0000","last_fullsized":"2023-08-31T02:01:22.473444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:22:22.347703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154531+0000","last_change":"2023-08-31T02:01:21.486621+0000","last_active":"2023-08-31T02:01:23.154531+0000","last_peered":"2023-08-31T02:01:23.154531+0000","last_clean":"2023-08-31T02:01:23.154531+0000","last_became_active":"2023-08-31T02:01:21.486282+0000","last_became_peered":"2023-08-31T02:01:21.486282+0000","last_unstale":"2023-08-31T02:01:23.154531+0000","last_undegraded":"2023-08-31T02:01:23.154531+0000","last_fullsized":"2023-08-31T02:01:23.154531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155145+0000","last_change":"2023-08-31T02:01:21.490357+0000","last_active":"2023-08-31T02:01:23.155145+0000","last_peered":"2023-08-31T02:01:23.155145+0000","last_clean":"2023-08-31T02:01:23.155145+0000","last_became_active":"2023-08-31T02:01:21.487866+0000","last_became_peered":"2023-08-31T02:01:21.487866+0000","last_unstale":"2023-08-31T02:01:23.155145+0000","last_undegraded":"2023-08-31T02:01:23.155145+0000","last_fullsized":"2023-08-31T02:01:23.155145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154508+0000","last_change":"2023-08-31T02:01:21.495399+0000","last_active":"2023-08-31T02:01:23.154508+0000","last_peered":"2023-08-31T02:01:23.154508+0000","last_clean":"2023-08-31T02:01:23.154508+0000","last_became_active":"2023-08-31T02:01:21.495110+0000","last_became_peered":"2023-08-31T02:01:21.495110+0000","last_unstale":"2023-08-31T02:01:23.154508+0000","last_undegraded":"2023-08-31T02:01:23.154508+0000","last_fullsized":"2023-08-31T02:01:23.154508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:17.307517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154441+0000","last_change":"2023-08-31T02:01:21.488517+0000","last_active":"2023-08-31T02:01:23.154441+0000","last_peered":"2023-08-31T02:01:23.154441+0000","last_clean":"2023-08-31T02:01:23.154441+0000","last_became_active":"2023-08-31T02:01:21.488239+0000","last_became_peered":"2023-08-31T02:01:21.488239+0000","last_unstale":"2023-08-31T02:01:23.154441+0000","last_undegraded":"2023-08-31T02:01:23.154441+0000","last_fullsized":"2023-08-31T02:01:23.154441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:33.898751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154306+0000","last_change":"2023-08-31T02:01:21.490976+0000","last_active":"2023-08-31T02:01:23.154306+0000","last_peered":"2023-08-31T02:01:23.154306+0000","last_clean":"2023-08-31T02:01:23.154306+0000","last_became_active":"2023-08-31T02:01:21.490707+0000","last_became_peered":"2023-08-31T02:01:21.490707+0000","last_unstale":"2023-08-31T02:01:23.154306+0000","last_undegraded":"2023-08-31T02:01:23.154306+0000","last_fullsized":"2023-08-31T02:01:23.154306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:21:01.584279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474281+0000","last_change":"2023-08-31T02:01:21.487315+0000","last_active":"2023-08-31T02:01:22.474281+0000","last_peered":"2023-08-31T02:01:22.474281+0000","last_clean":"2023-08-31T02:01:22.474281+0000","last_became_active":"2023-08-31T02:01:21.487028+0000","last_became_peered":"2023-08-31T02:01:21.487028+0000","last_unstale":"2023-08-31T02:01:22.474281+0000","last_undegraded":"2023-08-31T02:01:22.474281+0000","last_fullsized":"2023-08-31T02:01:22.474281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473190+0000","last_change":"2023-08-31T02:01:21.486242+0000","last_active":"2023-08-31T02:01:22.473190+0000","last_peered":"2023-08-31T02:01:22.473190+0000","last_clean":"2023-08-31T02:01:22.473190+0000","last_became_active":"2023-08-31T02:01:21.485620+0000","last_became_peered":"2023-08-31T02:01:21.485620+0000","last_unstale":"2023-08-31T02:01:22.473190+0000","last_undegraded":"2023-08-31T02:01:22.473190+0000","last_fullsized":"2023-08-31T02:01:22.473190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154800+0000","last_change":"2023-08-31T02:01:21.495072+0000","last_active":"2023-08-31T02:01:23.154800+0000","last_peered":"2023-08-31T02:01:23.154800+0000","last_clean":"2023-08-31T02:01:23.154800+0000","last_became_active":"2023-08-31T02:01:21.494263+0000","last_became_peered":"2023-08-31T02:01:21.494263+0000","last_unstale":"2023-08-31T02:01:23.154800+0000","last_undegraded":"2023-08-31T02:01:23.154800+0000","last_fullsized":"2023-08-31T02:01:23.154800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153910+0000","last_change":"2023-08-31T02:01:21.494001+0000","last_active":"2023-08-31T02:01:23.153910+0000","last_peered":"2023-08-31T02:01:23.153910+0000","last_clean":"2023-08-31T02:01:23.153910+0000","last_became_active":"2023-08-31T02:01:21.493742+0000","last_became_peered":"2023-08-31T02:01:21.493742+0000","last_unstale":"2023-08-31T02:01:23.153910+0000","last_undegraded":"2023-08-31T02:01:23.153910+0000","last_fullsized":"2023-08-31T02:01:23.153910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:53:45.076676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154521+0000","last_change":"2023-08-31T02:01:21.491466+0000","last_active":"2023-08-31T02:01:23.154521+0000","last_peered":"2023-08-31T02:01:23.154521+0000","last_clean":"2023-08-31T02:01:23.154521+0000","last_became_active":"2023-08-31T02:01:21.488906+0000","last_became_peered":"2023-08-31T02:01:21.488906+0000","last_unstale":"2023-08-31T02:01:23.154521+0000","last_undegraded":"2023-08-31T02:01:23.154521+0000","last_fullsized":"2023-08-31T02:01:23.154521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:53.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154435+0000","last_change":"2023-08-31T02:01:21.495374+0000","last_active":"2023-08-31T02:01:23.154435+0000","last_peered":"2023-08-31T02:01:23.154435+0000","last_clean":"2023-08-31T02:01:23.154435+0000","last_became_active":"2023-08-31T02:01:21.494511+0000","last_became_peered":"2023-08-31T02:01:21.494511+0000","last_unstale":"2023-08-31T02:01:23.154435+0000","last_undegraded":"2023-08-31T02:01:23.154435+0000","last_fullsized":"2023-08-31T02:01:23.154435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:37.313340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474483+0000","last_change":"2023-08-31T02:01:21.486431+0000","last_active":"2023-08-31T02:01:22.474483+0000","last_peered":"2023-08-31T02:01:22.474483+0000","last_clean":"2023-08-31T02:01:22.474483+0000","last_became_active":"2023-08-31T02:01:21.486138+0000","last_became_peered":"2023-08-31T02:01:21.486138+0000","last_unstale":"2023-08-31T02:01:22.474483+0000","last_undegraded":"2023-08-31T02:01:22.474483+0000","last_fullsized":"2023-08-31T02:01:22.474483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154708+0000","last_change":"2023-08-31T02:01:21.492203+0000","last_active":"2023-08-31T02:01:23.154708+0000","last_peered":"2023-08-31T02:01:23.154708+0000","last_clean":"2023-08-31T02:01:23.154708+0000","last_became_active":"2023-08-31T02:01:21.491853+0000","last_became_peered":"2023-08-31T02:01:21.491853+0000","last_unstale":"2023-08-31T02:01:23.154708+0000","last_undegraded":"2023-08-31T02:01:23.154708+0000","last_fullsized":"2023-08-31T02:01:23.154708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:12.582057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155112+0000","last_change":"2023-08-31T02:01:21.489782+0000","last_active":"2023-08-31T02:01:23.155112+0000","last_peered":"2023-08-31T02:01:23.155112+0000","last_clean":"2023-08-31T02:01:23.155112+0000","last_became_active":"2023-08-31T02:01:21.489511+0000","last_became_peered":"2023-08-31T02:01:21.489511+0000","last_unstale":"2023-08-31T02:01:23.155112+0000","last_undegraded":"2023-08-31T02:01:23.155112+0000","last_fullsized":"2023-08-31T02:01:23.155112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:29.822747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154808+0000","last_change":"2023-08-31T02:01:21.494310+0000","last_active":"2023-08-31T02:01:23.154808+0000","last_peered":"2023-08-31T02:01:23.154808+0000","last_clean":"2023-08-31T02:01:23.154808+0000","last_became_active":"2023-08-31T02:01:21.493693+0000","last_became_peered":"2023-08-31T02:01:21.493693+0000","last_unstale":"2023-08-31T02:01:23.154808+0000","last_undegraded":"2023-08-31T02:01:23.154808+0000","last_fullsized":"2023-08-31T02:01:23.154808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154938+0000","last_change":"2023-08-31T02:01:21.488296+0000","last_active":"2023-08-31T02:01:23.154938+0000","last_peered":"2023-08-31T02:01:23.154938+0000","last_clean":"2023-08-31T02:01:23.154938+0000","last_became_active":"2023-08-31T02:01:21.487819+0000","last_became_peered":"2023-08-31T02:01:21.487819+0000","last_unstale":"2023-08-31T02:01:23.154938+0000","last_undegraded":"2023-08-31T02:01:23.154938+0000","last_fullsized":"2023-08-31T02:01:23.154938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:25:18.019269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154497+0000","last_change":"2023-08-31T02:01:20.465896+0000","last_active":"2023-08-31T02:01:23.154497+0000","last_peered":"2023-08-31T02:01:23.154497+0000","last_clean":"2023-08-31T02:01:23.154497+0000","last_became_active":"2023-08-31T02:01:20.465615+0000","last_became_peered":"2023-08-31T02:01:20.465615+0000","last_unstale":"2023-08-31T02:01:23.154497+0000","last_undegraded":"2023-08-31T02:01:23.154497+0000","last_fullsized":"2023-08-31T02:01:23.154497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154252+0000","last_change":"2023-08-31T02:01:20.473610+0000","last_active":"2023-08-31T02:01:23.154252+0000","last_peered":"2023-08-31T02:01:23.154252+0000","last_clean":"2023-08-31T02:01:23.154252+0000","last_became_active":"2023-08-31T02:01:20.473370+0000","last_became_peered":"2023-08-31T02:01:20.473370+0000","last_unstale":"2023-08-31T02:01:23.154252+0000","last_undegraded":"2023-08-31T02:01:23.154252+0000","last_fullsized":"2023-08-31T02:01:23.154252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473534+0000","last_change":"2023-08-31T02:01:21.489900+0000","last_active":"2023-08-31T02:01:22.473534+0000","last_peered":"2023-08-31T02:01:22.473534+0000","last_clean":"2023-08-31T02:01:22.473534+0000","last_became_active":"2023-08-31T02:01:21.489618+0000","last_became_peered":"2023-08-31T02:01:21.489618+0000","last_unstale":"2023-08-31T02:01:22.473534+0000","last_undegraded":"2023-08-31T02:01:22.473534+0000","last_fullsized":"2023-08-31T02:01:22.473534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454626+0000","last_change":"2023-08-31T02:01:19.454626+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454626+0000","last_undegraded":"2023-08-31T02:01:19.454626+0000","last_fullsized":"2023-08-31T02:01:19.454626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473009+0000","last_change":"2023-08-31T02:01:21.494971+0000","last_active":"2023-08-31T02:01:22.473009+0000","last_peered":"2023-08-31T02:01:22.473009+0000","last_clean":"2023-08-31T02:01:22.473009+0000","last_became_active":"2023-08-31T02:01:21.494720+0000","last_became_peered":"2023-08-31T02:01:21.494720+0000","last_unstale":"2023-08-31T02:01:22.473009+0000","last_undegraded":"2023-08-31T02:01:22.473009+0000","last_fullsized":"2023-08-31T02:01:22.473009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473465+0000","last_change":"2023-08-31T02:01:20.473405+0000","last_active":"2023-08-31T02:01:22.473465+0000","last_peered":"2023-08-31T02:01:22.473465+0000","last_clean":"2023-08-31T02:01:22.473465+0000","last_became_active":"2023-08-31T02:01:20.473136+0000","last_became_peered":"2023-08-31T02:01:20.473136+0000","last_unstale":"2023-08-31T02:01:22.473465+0000","last_undegraded":"2023-08-31T02:01:22.473465+0000","last_fullsized":"2023-08-31T02:01:22.473465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:52.204278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154011+0000","last_change":"2023-08-31T02:01:21.492984+0000","last_active":"2023-08-31T02:01:23.154011+0000","last_peered":"2023-08-31T02:01:23.154011+0000","last_clean":"2023-08-31T02:01:23.154011+0000","last_became_active":"2023-08-31T02:01:21.492715+0000","last_became_peered":"2023-08-31T02:01:21.492715+0000","last_unstale":"2023-08-31T02:01:23.154011+0000","last_undegraded":"2023-08-31T02:01:23.154011+0000","last_fullsized":"2023-08-31T02:01:23.154011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474381+0000","last_change":"2023-08-31T02:01:20.473298+0000","last_active":"2023-08-31T02:01:22.474381+0000","last_peered":"2023-08-31T02:01:22.474381+0000","last_clean":"2023-08-31T02:01:22.474381+0000","last_became_active":"2023-08-31T02:01:20.473015+0000","last_became_peered":"2023-08-31T02:01:20.473015+0000","last_unstale":"2023-08-31T02:01:22.474381+0000","last_undegraded":"2023-08-31T02:01:22.474381+0000","last_fullsized":"2023-08-31T02:01:22.474381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:30:14.876894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474030+0000","last_change":"2023-08-31T02:01:21.490644+0000","last_active":"2023-08-31T02:01:22.474030+0000","last_peered":"2023-08-31T02:01:22.474030+0000","last_clean":"2023-08-31T02:01:22.474030+0000","last_became_active":"2023-08-31T02:01:21.490332+0000","last_became_peered":"2023-08-31T02:01:21.490332+0000","last_unstale":"2023-08-31T02:01:22.474030+0000","last_undegraded":"2023-08-31T02:01:22.474030+0000","last_fullsized":"2023-08-31T02:01:22.474030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154648+0000","last_change":"2023-08-31T02:01:20.477111+0000","last_active":"2023-08-31T02:01:23.154648+0000","last_peered":"2023-08-31T02:01:23.154648+0000","last_clean":"2023-08-31T02:01:23.154648+0000","last_became_active":"2023-08-31T02:01:20.476863+0000","last_became_peered":"2023-08-31T02:01:20.476863+0000","last_unstale":"2023-08-31T02:01:23.154648+0000","last_undegraded":"2023-08-31T02:01:23.154648+0000","last_fullsized":"2023-08-31T02:01:23.154648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473095+0000","last_change":"2023-08-31T02:01:21.487297+0000","last_active":"2023-08-31T02:01:22.473095+0000","last_peered":"2023-08-31T02:01:22.473095+0000","last_clean":"2023-08-31T02:01:22.473095+0000","last_became_active":"2023-08-31T02:01:21.487044+0000","last_became_peered":"2023-08-31T02:01:21.487044+0000","last_unstale":"2023-08-31T02:01:22.473095+0000","last_undegraded":"2023-08-31T02:01:22.473095+0000","last_fullsized":"2023-08-31T02:01:22.473095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454640+0000","last_change":"2023-08-31T02:01:19.454640+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454640+0000","last_undegraded":"2023-08-31T02:01:19.454640+0000","last_fullsized":"2023-08-31T02:01:19.454640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473036+0000","last_change":"2023-08-31T02:01:21.488464+0000","last_active":"2023-08-31T02:01:22.473036+0000","last_peered":"2023-08-31T02:01:22.473036+0000","last_clean":"2023-08-31T02:01:22.473036+0000","last_became_active":"2023-08-31T02:01:21.487547+0000","last_became_peered":"2023-08-31T02:01:21.487547+0000","last_unstale":"2023-08-31T02:01:22.473036+0000","last_undegraded":"2023-08-31T02:01:22.473036+0000","last_fullsized":"2023-08-31T02:01:22.473036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472884+0000","last_change":"2023-08-31T02:01:20.463335+0000","last_active":"2023-08-31T02:01:22.472884+0000","last_peered":"2023-08-31T02:01:22.472884+0000","last_clean":"2023-08-31T02:01:22.472884+0000","last_became_active":"2023-08-31T02:01:20.463073+0000","last_became_peered":"2023-08-31T02:01:20.463073+0000","last_unstale":"2023-08-31T02:01:22.472884+0000","last_undegraded":"2023-08-31T02:01:22.472884+0000","last_fullsized":"2023-08-31T02:01:22.472884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:35:51.541453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154755+0000","last_change":"2023-08-31T02:01:21.494127+0000","last_active":"2023-08-31T02:01:23.154755+0000","last_peered":"2023-08-31T02:01:23.154755+0000","last_clean":"2023-08-31T02:01:23.154755+0000","last_became_active":"2023-08-31T02:01:21.491465+0000","last_became_peered":"2023-08-31T02:01:21.491465+0000","last_unstale":"2023-08-31T02:01:23.154755+0000","last_undegraded":"2023-08-31T02:01:23.154755+0000","last_fullsized":"2023-08-31T02:01:23.154755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:36:48.080941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473047+0000","last_change":"2023-08-31T02:01:20.472411+0000","last_active":"2023-08-31T02:01:22.473047+0000","last_peered":"2023-08-31T02:01:22.473047+0000","last_clean":"2023-08-31T02:01:22.473047+0000","last_became_active":"2023-08-31T02:01:20.472124+0000","last_became_peered":"2023-08-31T02:01:20.472124+0000","last_unstale":"2023-08-31T02:01:22.473047+0000","last_undegraded":"2023-08-31T02:01:22.473047+0000","last_fullsized":"2023-08-31T02:01:22.473047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154748+0000","last_change":"2023-08-31T02:01:21.494040+0000","last_active":"2023-08-31T02:01:23.154748+0000","last_peered":"2023-08-31T02:01:23.154748+0000","last_clean":"2023-08-31T02:01:23.154748+0000","last_became_active":"2023-08-31T02:01:21.493350+0000","last_became_peered":"2023-08-31T02:01:21.493350+0000","last_unstale":"2023-08-31T02:01:23.154748+0000","last_undegraded":"2023-08-31T02:01:23.154748+0000","last_fullsized":"2023-08-31T02:01:23.154748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474606+0000","last_change":"2023-08-31T02:01:20.475643+0000","last_active":"2023-08-31T02:01:22.474606+0000","last_peered":"2023-08-31T02:01:22.474606+0000","last_clean":"2023-08-31T02:01:22.474606+0000","last_became_active":"2023-08-31T02:01:20.475359+0000","last_became_peered":"2023-08-31T02:01:20.475359+0000","last_unstale":"2023-08-31T02:01:22.474606+0000","last_undegraded":"2023-08-31T02:01:22.474606+0000","last_fullsized":"2023-08-31T02:01:22.474606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154159+0000","last_change":"2023-08-31T02:01:21.486994+0000","last_active":"2023-08-31T02:01:23.154159+0000","last_peered":"2023-08-31T02:01:23.154159+0000","last_clean":"2023-08-31T02:01:23.154159+0000","last_became_active":"2023-08-31T02:01:21.485891+0000","last_became_peered":"2023-08-31T02:01:21.485891+0000","last_unstale":"2023-08-31T02:01:23.154159+0000","last_undegraded":"2023-08-31T02:01:23.154159+0000","last_fullsized":"2023-08-31T02:01:23.154159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474693+0000","last_change":"2023-08-31T02:01:20.474688+0000","last_active":"2023-08-31T02:01:22.474693+0000","last_peered":"2023-08-31T02:01:22.474693+0000","last_clean":"2023-08-31T02:01:22.474693+0000","last_became_active":"2023-08-31T02:01:20.474417+0000","last_became_peered":"2023-08-31T02:01:20.474417+0000","last_unstale":"2023-08-31T02:01:22.474693+0000","last_undegraded":"2023-08-31T02:01:22.474693+0000","last_fullsized":"2023-08-31T02:01:22.474693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473576+0000","last_change":"2023-08-31T02:01:21.481153+0000","last_active":"2023-08-31T02:01:22.473576+0000","last_peered":"2023-08-31T02:01:22.473576+0000","last_clean":"2023-08-31T02:01:22.473576+0000","last_became_active":"2023-08-31T02:01:21.480678+0000","last_became_peered":"2023-08-31T02:01:21.480678+0000","last_unstale":"2023-08-31T02:01:22.473576+0000","last_undegraded":"2023-08-31T02:01:22.473576+0000","last_fullsized":"2023-08-31T02:01:22.473576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472919+0000","last_change":"2023-08-31T02:01:20.474897+0000","last_active":"2023-08-31T02:01:22.472919+0000","last_peered":"2023-08-31T02:01:22.472919+0000","last_clean":"2023-08-31T02:01:22.472919+0000","last_became_active":"2023-08-31T02:01:20.474227+0000","last_became_peered":"2023-08-31T02:01:20.474227+0000","last_unstale":"2023-08-31T02:01:22.472919+0000","last_undegraded":"2023-08-31T02:01:22.472919+0000","last_fullsized":"2023-08-31T02:01:22.472919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153851+0000","last_change":"2023-08-31T02:01:21.487392+0000","last_active":"2023-08-31T02:01:23.153851+0000","last_peered":"2023-08-31T02:01:23.153851+0000","last_clean":"2023-08-31T02:01:23.153851+0000","last_became_active":"2023-08-31T02:01:21.487162+0000","last_became_peered":"2023-08-31T02:01:21.487162+0000","last_unstale":"2023-08-31T02:01:23.153851+0000","last_undegraded":"2023-08-31T02:01:23.153851+0000","last_fullsized":"2023-08-31T02:01:23.153851+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472807+0000","last_change":"2023-08-31T02:01:20.480632+0000","last_active":"2023-08-31T02:01:22.472807+0000","last_peered":"2023-08-31T02:01:22.472807+0000","last_clean":"2023-08-31T02:01:22.472807+0000","last_became_active":"2023-08-31T02:01:20.480307+0000","last_became_peered":"2023-08-31T02:01:20.480307+0000","last_unstale":"2023-08-31T02:01:22.472807+0000","last_undegraded":"2023-08-31T02:01:22.472807+0000","last_fullsized":"2023-08-31T02:01:22.472807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:27:43.975042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472537+0000","last_change":"2023-08-31T02:01:21.492360+0000","last_active":"2023-08-31T02:01:22.472537+0000","last_peered":"2023-08-31T02:01:22.472537+0000","last_clean":"2023-08-31T02:01:22.472537+0000","last_became_active":"2023-08-31T02:01:21.492055+0000","last_became_peered":"2023-08-31T02:01:21.492055+0000","last_unstale":"2023-08-31T02:01:22.472537+0000","last_undegraded":"2023-08-31T02:01:22.472537+0000","last_fullsized":"2023-08-31T02:01:22.472537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454580+0000","last_change":"2023-08-31T02:01:19.454580+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454580+0000","last_undegraded":"2023-08-31T02:01:19.454580+0000","last_fullsized":"2023-08-31T02:01:19.454580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154659+0000","last_change":"2023-08-31T02:01:21.494582+0000","last_active":"2023-08-31T02:01:23.154659+0000","last_peered":"2023-08-31T02:01:23.154659+0000","last_clean":"2023-08-31T02:01:23.154659+0000","last_became_active":"2023-08-31T02:01:21.494273+0000","last_became_peered":"2023-08-31T02:01:21.494273+0000","last_unstale":"2023-08-31T02:01:23.154659+0000","last_undegraded":"2023-08-31T02:01:23.154659+0000","last_fullsized":"2023-08-31T02:01:23.154659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154231+0000","last_change":"2023-08-31T02:01:20.466640+0000","last_active":"2023-08-31T02:01:23.154231+0000","last_peered":"2023-08-31T02:01:23.154231+0000","last_clean":"2023-08-31T02:01:23.154231+0000","last_became_active":"2023-08-31T02:01:20.466315+0000","last_became_peered":"2023-08-31T02:01:20.466315+0000","last_unstale":"2023-08-31T02:01:23.154231+0000","last_undegraded":"2023-08-31T02:01:23.154231+0000","last_fullsized":"2023-08-31T02:01:23.154231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472600+0000","last_change":"2023-08-31T02:01:21.488792+0000","last_active":"2023-08-31T02:01:22.472600+0000","last_peered":"2023-08-31T02:01:22.472600+0000","last_clean":"2023-08-31T02:01:22.472600+0000","last_became_active":"2023-08-31T02:01:21.488218+0000","last_became_peered":"2023-08-31T02:01:21.488218+0000","last_unstale":"2023-08-31T02:01:22.472600+0000","last_undegraded":"2023-08-31T02:01:22.472600+0000","last_fullsized":"2023-08-31T02:01:22.472600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155040+0000","last_change":"2023-08-31T02:01:20.476965+0000","last_active":"2023-08-31T02:01:23.155040+0000","last_peered":"2023-08-31T02:01:23.155040+0000","last_clean":"2023-08-31T02:01:23.155040+0000","last_became_active":"2023-08-31T02:01:20.476698+0000","last_became_peered":"2023-08-31T02:01:20.476698+0000","last_unstale":"2023-08-31T02:01:23.155040+0000","last_undegraded":"2023-08-31T02:01:23.155040+0000","last_fullsized":"2023-08-31T02:01:23.155040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472783+0000","last_change":"2023-08-31T02:01:21.493915+0000","last_active":"2023-08-31T02:01:22.472783+0000","last_peered":"2023-08-31T02:01:22.472783+0000","last_clean":"2023-08-31T02:01:22.472783+0000","last_became_active":"2023-08-31T02:01:21.493676+0000","last_became_peered":"2023-08-31T02:01:21.493676+0000","last_unstale":"2023-08-31T02:01:22.472783+0000","last_undegraded":"2023-08-31T02:01:22.472783+0000","last_fullsized":"2023-08-31T02:01:22.472783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474583+0000","last_change":"2023-08-31T02:01:20.477508+0000","last_active":"2023-08-31T02:01:22.474583+0000","last_peered":"2023-08-31T02:01:22.474583+0000","last_clean":"2023-08-31T02:01:22.474583+0000","last_became_active":"2023-08-31T02:01:20.477260+0000","last_became_peered":"2023-08-31T02:01:20.477260+0000","last_unstale":"2023-08-31T02:01:22.474583+0000","last_undegraded":"2023-08-31T02:01:22.474583+0000","last_fullsized":"2023-08-31T02:01:22.474583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:44:05.421419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474724+0000","last_change":"2023-08-31T02:01:21.491870+0000","last_active":"2023-08-31T02:01:22.474724+0000","last_peered":"2023-08-31T02:01:22.474724+0000","last_clean":"2023-08-31T02:01:22.474724+0000","last_became_active":"2023-08-31T02:01:21.491592+0000","last_became_peered":"2023-08-31T02:01:21.491592+0000","last_unstale":"2023-08-31T02:01:22.474724+0000","last_undegraded":"2023-08-31T02:01:22.474724+0000","last_fullsized":"2023-08-31T02:01:22.474724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473493+0000","last_change":"2023-08-31T02:01:20.475956+0000","last_active":"2023-08-31T02:01:22.473493+0000","last_peered":"2023-08-31T02:01:22.473493+0000","last_clean":"2023-08-31T02:01:22.473493+0000","last_became_active":"2023-08-31T02:01:20.475694+0000","last_became_peered":"2023-08-31T02:01:20.475694+0000","last_unstale":"2023-08-31T02:01:22.473493+0000","last_undegraded":"2023-08-31T02:01:22.473493+0000","last_fullsized":"2023-08-31T02:01:22.473493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473616+0000","last_change":"2023-08-31T02:01:21.491382+0000","last_active":"2023-08-31T02:01:22.473616+0000","last_peered":"2023-08-31T02:01:22.473616+0000","last_clean":"2023-08-31T02:01:22.473616+0000","last_became_active":"2023-08-31T02:01:21.491114+0000","last_became_peered":"2023-08-31T02:01:21.491114+0000","last_unstale":"2023-08-31T02:01:22.473616+0000","last_undegraded":"2023-08-31T02:01:22.473616+0000","last_fullsized":"2023-08-31T02:01:22.473616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154526+0000","last_change":"2023-08-31T02:01:20.474505+0000","last_active":"2023-08-31T02:01:23.154526+0000","last_peered":"2023-08-31T02:01:23.154526+0000","last_clean":"2023-08-31T02:01:23.154526+0000","last_became_active":"2023-08-31T02:01:20.474179+0000","last_became_peered":"2023-08-31T02:01:20.474179+0000","last_unstale":"2023-08-31T02:01:23.154526+0000","last_undegraded":"2023-08-31T02:01:23.154526+0000","last_fullsized":"2023-08-31T02:01:23.154526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:02:02.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154570+0000","last_change":"2023-08-31T02:01:21.491206+0000","last_active":"2023-08-31T02:01:23.154570+0000","last_peered":"2023-08-31T02:01:23.154570+0000","last_clean":"2023-08-31T02:01:23.154570+0000","last_became_active":"2023-08-31T02:01:21.490947+0000","last_became_peered":"2023-08-31T02:01:21.490947+0000","last_unstale":"2023-08-31T02:01:23.154570+0000","last_undegraded":"2023-08-31T02:01:23.154570+0000","last_fullsized":"2023-08-31T02:01:23.154570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:55.955512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454653+0000","last_change":"2023-08-31T02:01:19.454653+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454653+0000","last_undegraded":"2023-08-31T02:01:19.454653+0000","last_fullsized":"2023-08-31T02:01:19.454653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155214+0000","last_change":"2023-08-31T02:01:21.494374+0000","last_active":"2023-08-31T02:01:23.155214+0000","last_peered":"2023-08-31T02:01:23.155214+0000","last_clean":"2023-08-31T02:01:23.155214+0000","last_became_active":"2023-08-31T02:01:21.494077+0000","last_became_peered":"2023-08-31T02:01:21.494077+0000","last_unstale":"2023-08-31T02:01:23.155214+0000","last_undegraded":"2023-08-31T02:01:23.155214+0000","last_fullsized":"2023-08-31T02:01:23.155214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:19:25.263827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154576+0000","last_change":"2023-08-31T02:01:20.467838+0000","last_active":"2023-08-31T02:01:23.154576+0000","last_peered":"2023-08-31T02:01:23.154576+0000","last_clean":"2023-08-31T02:01:23.154576+0000","last_became_active":"2023-08-31T02:01:20.467567+0000","last_became_peered":"2023-08-31T02:01:20.467567+0000","last_unstale":"2023-08-31T02:01:23.154576+0000","last_undegraded":"2023-08-31T02:01:23.154576+0000","last_fullsized":"2023-08-31T02:01:23.154576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:27:02.795050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154093+0000","last_change":"2023-08-31T02:01:21.491262+0000","last_active":"2023-08-31T02:01:23.154093+0000","last_peered":"2023-08-31T02:01:23.154093+0000","last_clean":"2023-08-31T02:01:23.154093+0000","last_became_active":"2023-08-31T02:01:21.490982+0000","last_became_peered":"2023-08-31T02:01:21.490982+0000","last_unstale":"2023-08-31T02:01:23.154093+0000","last_undegraded":"2023-08-31T02:01:23.154093+0000","last_fullsized":"2023-08-31T02:01:23.154093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154338+0000","last_change":"2023-08-31T02:01:20.469596+0000","last_active":"2023-08-31T02:01:23.154338+0000","last_peered":"2023-08-31T02:01:23.154338+0000","last_clean":"2023-08-31T02:01:23.154338+0000","last_became_active":"2023-08-31T02:01:20.469290+0000","last_became_peered":"2023-08-31T02:01:20.469290+0000","last_unstale":"2023-08-31T02:01:23.154338+0000","last_undegraded":"2023-08-31T02:01:23.154338+0000","last_fullsized":"2023-08-31T02:01:23.154338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:27:42.568205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474353+0000","last_change":"2023-08-31T02:01:21.493623+0000","last_active":"2023-08-31T02:01:22.474353+0000","last_peered":"2023-08-31T02:01:22.474353+0000","last_clean":"2023-08-31T02:01:22.474353+0000","last_became_active":"2023-08-31T02:01:21.493369+0000","last_became_peered":"2023-08-31T02:01:21.493369+0000","last_unstale":"2023-08-31T02:01:22.474353+0000","last_undegraded":"2023-08-31T02:01:22.474353+0000","last_fullsized":"2023-08-31T02:01:22.474353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:20.474557+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:20.474269+0000","last_became_peered":"2023-08-31T02:01:20.474269+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472721+0000","last_change":"2023-08-31T02:01:21.488629+0000","last_active":"2023-08-31T02:01:22.472721+0000","last_peered":"2023-08-31T02:01:22.472721+0000","last_clean":"2023-08-31T02:01:22.472721+0000","last_became_active":"2023-08-31T02:01:21.487877+0000","last_became_peered":"2023-08-31T02:01:21.487877+0000","last_unstale":"2023-08-31T02:01:22.472721+0000","last_undegraded":"2023-08-31T02:01:22.472721+0000","last_fullsized":"2023-08-31T02:01:22.472721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153853+0000","last_change":"2023-08-31T02:01:20.474084+0000","last_active":"2023-08-31T02:01:23.153853+0000","last_peered":"2023-08-31T02:01:23.153853+0000","last_clean":"2023-08-31T02:01:23.153853+0000","last_became_active":"2023-08-31T02:01:20.473811+0000","last_became_peered":"2023-08-31T02:01:20.473811+0000","last_unstale":"2023-08-31T02:01:23.153853+0000","last_undegraded":"2023-08-31T02:01:23.153853+0000","last_fullsized":"2023-08-31T02:01:23.153853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:18:30.609765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474465+0000","last_change":"2023-08-31T02:01:20.474116+0000","last_active":"2023-08-31T02:01:22.474465+0000","last_peered":"2023-08-31T02:01:22.474465+0000","last_clean":"2023-08-31T02:01:22.474465+0000","last_became_active":"2023-08-31T02:01:20.473855+0000","last_became_peered":"2023-08-31T02:01:20.473855+0000","last_unstale":"2023-08-31T02:01:22.474465+0000","last_undegraded":"2023-08-31T02:01:22.474465+0000","last_fullsized":"2023-08-31T02:01:22.474465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:41:18.994166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:21.494457+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:21.493732+0000","last_became_peered":"2023-08-31T02:01:21.493732+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.600588+0000","last_change":"2023-08-31T02:01:20.474656+0000","last_active":"2023-08-31T02:01:23.600588+0000","last_peered":"2023-08-31T02:01:23.600588+0000","last_clean":"2023-08-31T02:01:23.600588+0000","last_became_active":"2023-08-31T02:01:20.474369+0000","last_became_peered":"2023-08-31T02:01:20.474369+0000","last_unstale":"2023-08-31T02:01:23.600588+0000","last_undegraded":"2023-08-31T02:01:23.600588+0000","last_fullsized":"2023-08-31T02:01:23.600588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:45:00.848193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473070+0000","last_change":"2023-08-31T02:01:21.477794+0000","last_active":"2023-08-31T02:01:22.473070+0000","last_peered":"2023-08-31T02:01:22.473070+0000","last_clean":"2023-08-31T02:01:22.473070+0000","last_became_active":"2023-08-31T02:01:21.477508+0000","last_became_peered":"2023-08-31T02:01:21.477508+0000","last_unstale":"2023-08-31T02:01:22.473070+0000","last_undegraded":"2023-08-31T02:01:22.473070+0000","last_fullsized":"2023-08-31T02:01:22.473070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154313+0000","last_change":"2023-08-31T02:01:20.474392+0000","last_active":"2023-08-31T02:01:23.154313+0000","last_peered":"2023-08-31T02:01:23.154313+0000","last_clean":"2023-08-31T02:01:23.154313+0000","last_became_active":"2023-08-31T02:01:20.473883+0000","last_became_peered":"2023-08-31T02:01:20.473883+0000","last_unstale":"2023-08-31T02:01:23.154313+0000","last_undegraded":"2023-08-31T02:01:23.154313+0000","last_fullsized":"2023-08-31T02:01:23.154313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:36.309094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153979+0000","last_change":"2023-08-31T02:01:21.484480+0000","last_active":"2023-08-31T02:01:23.153979+0000","last_peered":"2023-08-31T02:01:23.153979+0000","last_clean":"2023-08-31T02:01:23.153979+0000","last_became_active":"2023-08-31T02:01:21.484215+0000","last_became_peered":"2023-08-31T02:01:21.484215+0000","last_unstale":"2023-08-31T02:01:23.153979+0000","last_undegraded":"2023-08-31T02:01:23.153979+0000","last_fullsized":"2023-08-31T02:01:23.153979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154406+0000","last_change":"2023-08-31T02:01:20.470456+0000","last_active":"2023-08-31T02:01:23.154406+0000","last_peered":"2023-08-31T02:01:23.154406+0000","last_clean":"2023-08-31T02:01:23.154406+0000","last_became_active":"2023-08-31T02:01:20.470196+0000","last_became_peered":"2023-08-31T02:01:20.470196+0000","last_unstale":"2023-08-31T02:01:23.154406+0000","last_undegraded":"2023-08-31T02:01:23.154406+0000","last_fullsized":"2023-08-31T02:01:23.154406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155067+0000","last_change":"2023-08-31T02:01:20.473075+0000","last_active":"2023-08-31T02:01:23.155067+0000","last_peered":"2023-08-31T02:01:23.155067+0000","last_clean":"2023-08-31T02:01:23.155067+0000","last_became_active":"2023-08-31T02:01:20.472816+0000","last_became_peered":"2023-08-31T02:01:20.472816+0000","last_unstale":"2023-08-31T02:01:23.155067+0000","last_undegraded":"2023-08-31T02:01:23.155067+0000","last_fullsized":"2023-08-31T02:01:23.155067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473306+0000","last_change":"2023-08-31T02:01:21.480979+0000","last_active":"2023-08-31T02:01:22.473306+0000","last_peered":"2023-08-31T02:01:22.473306+0000","last_clean":"2023-08-31T02:01:22.473306+0000","last_became_active":"2023-08-31T02:01:21.480663+0000","last_became_peered":"2023-08-31T02:01:21.480663+0000","last_unstale":"2023-08-31T02:01:22.473306+0000","last_undegraded":"2023-08-31T02:01:22.473306+0000","last_fullsized":"2023-08-31T02:01:22.473306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472970+0000","last_change":"2023-08-31T02:01:20.471925+0000","last_active":"2023-08-31T02:01:22.472970+0000","last_peered":"2023-08-31T02:01:22.472970+0000","last_clean":"2023-08-31T02:01:22.472970+0000","last_became_active":"2023-08-31T02:01:20.471633+0000","last_became_peered":"2023-08-31T02:01:20.471633+0000","last_unstale":"2023-08-31T02:01:22.472970+0000","last_undegraded":"2023-08-31T02:01:22.472970+0000","last_fullsized":"2023-08-31T02:01:22.472970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155077+0000","last_change":"2023-08-31T02:01:21.490803+0000","last_active":"2023-08-31T02:01:23.155077+0000","last_peered":"2023-08-31T02:01:23.155077+0000","last_clean":"2023-08-31T02:01:23.155077+0000","last_became_active":"2023-08-31T02:01:21.490535+0000","last_became_peered":"2023-08-31T02:01:21.490535+0000","last_unstale":"2023-08-31T02:01:23.155077+0000","last_undegraded":"2023-08-31T02:01:23.155077+0000","last_fullsized":"2023-08-31T02:01:23.155077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:17:07.573441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472499+0000","last_change":"2023-08-31T02:01:20.473424+0000","last_active":"2023-08-31T02:01:22.472499+0000","last_peered":"2023-08-31T02:01:22.472499+0000","last_clean":"2023-08-31T02:01:22.472499+0000","last_became_active":"2023-08-31T02:01:20.473069+0000","last_became_peered":"2023-08-31T02:01:20.473069+0000","last_unstale":"2023-08-31T02:01:22.472499+0000","last_undegraded":"2023-08-31T02:01:22.472499+0000","last_fullsized":"2023-08-31T02:01:22.472499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:19:53.569012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474460+0000","last_change":"2023-08-31T02:01:21.478455+0000","last_active":"2023-08-31T02:01:22.474460+0000","last_peered":"2023-08-31T02:01:22.474460+0000","last_clean":"2023-08-31T02:01:22.474460+0000","last_became_active":"2023-08-31T02:01:21.476993+0000","last_became_peered":"2023-08-31T02:01:21.476993+0000","last_unstale":"2023-08-31T02:01:22.474460+0000","last_undegraded":"2023-08-31T02:01:22.474460+0000","last_fullsized":"2023-08-31T02:01:22.474460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155095+0000","last_change":"2023-08-31T02:01:20.477325+0000","last_active":"2023-08-31T02:01:23.155095+0000","last_peered":"2023-08-31T02:01:23.155095+0000","last_clean":"2023-08-31T02:01:23.155095+0000","last_became_active":"2023-08-31T02:01:20.476450+0000","last_became_peered":"2023-08-31T02:01:20.476450+0000","last_unstale":"2023-08-31T02:01:23.155095+0000","last_undegraded":"2023-08-31T02:01:23.155095+0000","last_fullsized":"2023-08-31T02:01:23.155095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480301+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:21.480301+0000","last_peered":"2023-08-31T02:01:21.480301+0000","last_clean":"2023-08-31T02:01:21.480301+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:21.480301+0000","last_undegraded":"2023-08-31T02:01:21.480301+0000","last_fullsized":"2023-08-31T02:01:21.480301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.74,"5min":11.74,"15min":11.74},"last":0.318}]},{"osd":4,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.436}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":11.707000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.659000000000001,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":11.628,"5min":11.628,"15min":11.628},"last":0.41399999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1069056,"data_stored":789651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":788003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.62}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.309},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.6799999999999997,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.71,"5min":5.71,"15min":5.71},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.621},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.8579999999999997,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.64900000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":199247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.308}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.372},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.45300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.495},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.627}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":198183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.8460000000000001,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:25.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.118+0000 7f654000e700 1 -- 172.21.15.84:0/1100309405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653815d3c0 msgr2=0x7f653806dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.118+0000 7f654000e700 1 --2- 172.21.15.84:0/1100309405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653815d3c0 0x7f653806dcf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f65380cc930 tx=0x7f653000b380 comp rx=0 tx=0).stop 2023-08-31T02:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.118+0000 7f654000e700 1 -- 172.21.15.84:0/1100309405 shutdown_connections 2023-08-31T02:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.118+0000 7f654000e700 1 --2- 172.21.15.84:0/1100309405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653815d3c0 0x7f653806dcf0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.118+0000 7f654000e700 1 --2- 172.21.15.84:0/1100309405 >> v2:172.21.15.170:3300/0 conn(0x7f6538142950 0x7f65380cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.118+0000 7f654000e700 1 -- 172.21.15.84:0/1100309405 >> 172.21.15.84:0/1100309405 conn(0x7f65380cdf00 msgr2=0x7f65380ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.118+0000 7f654000e700 1 -- 172.21.15.84:0/1100309405 shutdown_connections 2023-08-31T02:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.119+0000 7f654000e700 1 -- 172.21.15.84:0/1100309405 wait complete. 2023-08-31T02:01:26.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f654000e700 1 Processor -- start 2023-08-31T02:01:26.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f654000e700 1 -- start start 2023-08-31T02:01:26.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f654000e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380cc290 0x7f65380a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f654000e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6538142950 0x7f653813eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f654000e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f653815d3c0 0x7f65380b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f654000e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653815c270 con 0x7f65380cc290 2023-08-31T02:01:26.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f654000e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65380a69f0 con 0x7f6538142950 2023-08-31T02:01:26.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f654000e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653815ba60 con 0x7f653815d3c0 2023-08-31T02:01:26.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f653ddaa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380cc290 0x7f65380a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.120+0000 7f653ddaa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380cc290 0x7f65380a64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53968/0 (socket says 172.21.15.84:53968) 2023-08-31T02:01:26.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f653ddaa700 1 -- 172.21.15.84:0/4155258844 learned_addr learned my addr 172.21.15.84:0/4155258844 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:26.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f653d5a9700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6538142950 0x7f653813eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f653ddaa700 1 -- 172.21.15.84:0/4155258844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f653815d3c0 msgr2=0x7f65380b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f653ddaa700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f653815d3c0 0x7f65380b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f653ddaa700 1 -- 172.21.15.84:0/4155258844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6538142950 msgr2=0x7f653813eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f653ddaa700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6538142950 0x7f653813eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f653ddaa700 1 -- 172.21.15.84:0/4155258844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6530009d00 con 0x7f65380cc290 2023-08-31T02:01:26.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f653ddaa700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380cc290 0x7f65380a64b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f652800c950 tx=0x7f652800cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:26.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f652e7fc700 1 -- 172.21.15.84:0/4155258844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528007a60 con 0x7f65380cc290 2023-08-31T02:01:26.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f652e7fc700 1 -- 172.21.15.84:0/4155258844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6528007cb0 con 0x7f65380cc290 2023-08-31T02:01:26.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f652e7fc700 1 -- 172.21.15.84:0/4155258844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528004a90 con 0x7f65380cc290 2023-08-31T02:01:26.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65380b2e00 con 0x7f65380cc290 2023-08-31T02:01:26.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.121+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653815bf90 con 0x7f65380cc290 2023-08-31T02:01:26.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.122+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65380cc6f0 con 0x7f65380cc290 2023-08-31T02:01:26.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.122+0000 7f652e7fc700 1 -- 172.21.15.84:0/4155258844 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6528004bf0 con 0x7f65380cc290 2023-08-31T02:01:26.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.123+0000 7f652e7fc700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f651c06a0e0 0x7f651c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.123+0000 7f652e7fc700 1 -- 172.21.15.84:0/4155258844 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6528088960 con 0x7f65380cc290 2023-08-31T02:01:26.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.123+0000 7f653d5a9700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f651c06a0e0 0x7f651c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.123+0000 7f653d5a9700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f651c06a0e0 0x7f651c06c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f65381f2750 tx=0x7f6534009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:26.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.127+0000 7f652e7fc700 1 -- 172.21.15.84:0/4155258844 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6528053f80 con 0x7f65380cc290 2023-08-31T02:01:26.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.313+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f653804e7c0 con 0x7f651c06a0e0 2023-08-31T02:01:26.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.320+0000 7f652e7fc700 1 -- 172.21.15.84:0/4155258844 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288250 (secure 0 0 0) 0x7f653804e7c0 con 0x7f651c06a0e0 2023-08-31T02:01:26.317 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.323+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f651c06a0e0 msgr2=0x7f651c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.323+0000 7f654000e700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f651c06a0e0 0x7f651c06c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f65381f2750 tx=0x7f6534009040 comp rx=0 tx=0).stop 2023-08-31T02:01:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380cc290 msgr2=0x7f65380a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380cc290 0x7f65380a64b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f652800c950 tx=0x7f652800cd10 comp rx=0 tx=0).stop 2023-08-31T02:01:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 shutdown_connections 2023-08-31T02:01:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f651c06a0e0 0x7f651c06c5a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f653815d3c0 0x7f65380b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65380cc290 0x7f65380a64b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 --2- 172.21.15.84:0/4155258844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6538142950 0x7f653813eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 >> 172.21.15.84:0/4155258844 conn(0x7f65380cdf00 msgr2=0x7f65380ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 shutdown_connections 2023-08-31T02:01:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.324+0000 7f654000e700 1 -- 172.21.15.84:0/4155258844 wait complete. 2023-08-31T02:01:26.322 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:26.328 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-08-31T02:01:25.067979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220932,"kb_used_data":4756,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753788,"statfs":{"total":773094113280,"available":772867878912,"internally_reserved":0,"allocated":4870144,"data_stored":2739344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.615040"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472865+0000","last_change":"2023-08-31T02:01:21.483607+0000","last_active":"2023-08-31T02:01:22.472865+0000","last_peered":"2023-08-31T02:01:22.472865+0000","last_clean":"2023-08-31T02:01:22.472865+0000","last_became_active":"2023-08-31T02:01:21.483386+0000","last_became_peered":"2023-08-31T02:01:21.483386+0000","last_unstale":"2023-08-31T02:01:22.472865+0000","last_undegraded":"2023-08-31T02:01:22.472865+0000","last_fullsized":"2023-08-31T02:01:22.472865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472940+0000","last_change":"2023-08-31T02:01:21.479696+0000","last_active":"2023-08-31T02:01:22.472940+0000","last_peered":"2023-08-31T02:01:22.472940+0000","last_clean":"2023-08-31T02:01:22.472940+0000","last_became_active":"2023-08-31T02:01:21.479422+0000","last_became_peered":"2023-08-31T02:01:21.479422+0000","last_unstale":"2023-08-31T02:01:22.472940+0000","last_undegraded":"2023-08-31T02:01:22.472940+0000","last_fullsized":"2023-08-31T02:01:22.472940+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154224+0000","last_change":"2023-08-31T02:01:21.487277+0000","last_active":"2023-08-31T02:01:23.154224+0000","last_peered":"2023-08-31T02:01:23.154224+0000","last_clean":"2023-08-31T02:01:23.154224+0000","last_became_active":"2023-08-31T02:01:21.486976+0000","last_became_peered":"2023-08-31T02:01:21.486976+0000","last_unstale":"2023-08-31T02:01:23.154224+0000","last_undegraded":"2023-08-31T02:01:23.154224+0000","last_fullsized":"2023-08-31T02:01:23.154224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154614+0000","last_change":"2023-08-31T02:01:21.494288+0000","last_active":"2023-08-31T02:01:23.154614+0000","last_peered":"2023-08-31T02:01:23.154614+0000","last_clean":"2023-08-31T02:01:23.154614+0000","last_became_active":"2023-08-31T02:01:21.493886+0000","last_became_peered":"2023-08-31T02:01:21.493886+0000","last_unstale":"2023-08-31T02:01:23.154614+0000","last_undegraded":"2023-08-31T02:01:23.154614+0000","last_fullsized":"2023-08-31T02:01:23.154614+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:40:06.925751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154293+0000","last_change":"2023-08-31T02:01:21.490804+0000","last_active":"2023-08-31T02:01:23.154293+0000","last_peered":"2023-08-31T02:01:23.154293+0000","last_clean":"2023-08-31T02:01:23.154293+0000","last_became_active":"2023-08-31T02:01:21.490531+0000","last_became_peered":"2023-08-31T02:01:21.490531+0000","last_unstale":"2023-08-31T02:01:23.154293+0000","last_undegraded":"2023-08-31T02:01:23.154293+0000","last_fullsized":"2023-08-31T02:01:23.154293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:16:12.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474162+0000","last_change":"2023-08-31T02:01:21.477335+0000","last_active":"2023-08-31T02:01:22.474162+0000","last_peered":"2023-08-31T02:01:22.474162+0000","last_clean":"2023-08-31T02:01:22.474162+0000","last_became_active":"2023-08-31T02:01:21.476978+0000","last_became_peered":"2023-08-31T02:01:21.476978+0000","last_unstale":"2023-08-31T02:01:22.474162+0000","last_undegraded":"2023-08-31T02:01:22.474162+0000","last_fullsized":"2023-08-31T02:01:22.474162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472523+0000","last_change":"2023-08-31T02:01:21.479618+0000","last_active":"2023-08-31T02:01:22.472523+0000","last_peered":"2023-08-31T02:01:22.472523+0000","last_clean":"2023-08-31T02:01:22.472523+0000","last_became_active":"2023-08-31T02:01:21.479344+0000","last_became_peered":"2023-08-31T02:01:21.479344+0000","last_unstale":"2023-08-31T02:01:22.472523+0000","last_undegraded":"2023-08-31T02:01:22.472523+0000","last_fullsized":"2023-08-31T02:01:22.472523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154346+0000","last_change":"2023-08-31T02:01:21.487087+0000","last_active":"2023-08-31T02:01:23.154346+0000","last_peered":"2023-08-31T02:01:23.154346+0000","last_clean":"2023-08-31T02:01:23.154346+0000","last_became_active":"2023-08-31T02:01:21.486783+0000","last_became_peered":"2023-08-31T02:01:21.486783+0000","last_unstale":"2023-08-31T02:01:23.154346+0000","last_undegraded":"2023-08-31T02:01:23.154346+0000","last_fullsized":"2023-08-31T02:01:23.154346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474348+0000","last_change":"2023-08-31T02:01:21.485931+0000","last_active":"2023-08-31T02:01:22.474348+0000","last_peered":"2023-08-31T02:01:22.474348+0000","last_clean":"2023-08-31T02:01:22.474348+0000","last_became_active":"2023-08-31T02:01:21.485666+0000","last_became_peered":"2023-08-31T02:01:21.485666+0000","last_unstale":"2023-08-31T02:01:22.474348+0000","last_undegraded":"2023-08-31T02:01:22.474348+0000","last_fullsized":"2023-08-31T02:01:22.474348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474466+0000","last_change":"2023-08-31T02:01:21.481313+0000","last_active":"2023-08-31T02:01:22.474466+0000","last_peered":"2023-08-31T02:01:22.474466+0000","last_clean":"2023-08-31T02:01:22.474466+0000","last_became_active":"2023-08-31T02:01:21.481052+0000","last_became_peered":"2023-08-31T02:01:21.481052+0000","last_unstale":"2023-08-31T02:01:22.474466+0000","last_undegraded":"2023-08-31T02:01:22.474466+0000","last_fullsized":"2023-08-31T02:01:22.474466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154140+0000","last_change":"2023-08-31T02:01:21.487451+0000","last_active":"2023-08-31T02:01:23.154140+0000","last_peered":"2023-08-31T02:01:23.154140+0000","last_clean":"2023-08-31T02:01:23.154140+0000","last_became_active":"2023-08-31T02:01:21.486899+0000","last_became_peered":"2023-08-31T02:01:21.486899+0000","last_unstale":"2023-08-31T02:01:23.154140+0000","last_undegraded":"2023-08-31T02:01:23.154140+0000","last_fullsized":"2023-08-31T02:01:23.154140+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474198+0000","last_change":"2023-08-31T02:01:21.490530+0000","last_active":"2023-08-31T02:01:22.474198+0000","last_peered":"2023-08-31T02:01:22.474198+0000","last_clean":"2023-08-31T02:01:22.474198+0000","last_became_active":"2023-08-31T02:01:21.490216+0000","last_became_peered":"2023-08-31T02:01:21.490216+0000","last_unstale":"2023-08-31T02:01:22.474198+0000","last_undegraded":"2023-08-31T02:01:22.474198+0000","last_fullsized":"2023-08-31T02:01:22.474198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473438+0000","last_change":"2023-08-31T02:01:21.486405+0000","last_active":"2023-08-31T02:01:22.473438+0000","last_peered":"2023-08-31T02:01:22.473438+0000","last_clean":"2023-08-31T02:01:22.473438+0000","last_became_active":"2023-08-31T02:01:21.485996+0000","last_became_peered":"2023-08-31T02:01:21.485996+0000","last_unstale":"2023-08-31T02:01:22.473438+0000","last_undegraded":"2023-08-31T02:01:22.473438+0000","last_fullsized":"2023-08-31T02:01:22.473438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473444+0000","last_change":"2023-08-31T02:01:21.485585+0000","last_active":"2023-08-31T02:01:22.473444+0000","last_peered":"2023-08-31T02:01:22.473444+0000","last_clean":"2023-08-31T02:01:22.473444+0000","last_became_active":"2023-08-31T02:01:21.484565+0000","last_became_peered":"2023-08-31T02:01:21.484565+0000","last_unstale":"2023-08-31T02:01:22.473444+0000","last_undegraded":"2023-08-31T02:01:22.473444+0000","last_fullsized":"2023-08-31T02:01:22.473444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:22:22.347703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154531+0000","last_change":"2023-08-31T02:01:21.486621+0000","last_active":"2023-08-31T02:01:23.154531+0000","last_peered":"2023-08-31T02:01:23.154531+0000","last_clean":"2023-08-31T02:01:23.154531+0000","last_became_active":"2023-08-31T02:01:21.486282+0000","last_became_peered":"2023-08-31T02:01:21.486282+0000","last_unstale":"2023-08-31T02:01:23.154531+0000","last_undegraded":"2023-08-31T02:01:23.154531+0000","last_fullsized":"2023-08-31T02:01:23.154531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155145+0000","last_change":"2023-08-31T02:01:21.490357+0000","last_active":"2023-08-31T02:01:23.155145+0000","last_peered":"2023-08-31T02:01:23.155145+0000","last_clean":"2023-08-31T02:01:23.155145+0000","last_became_active":"2023-08-31T02:01:21.487866+0000","last_became_peered":"2023-08-31T02:01:21.487866+0000","last_unstale":"2023-08-31T02:01:23.155145+0000","last_undegraded":"2023-08-31T02:01:23.155145+0000","last_fullsized":"2023-08-31T02:01:23.155145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154508+0000","last_change":"2023-08-31T02:01:21.495399+0000","last_active":"2023-08-31T02:01:23.154508+0000","last_peered":"2023-08-31T02:01:23.154508+0000","last_clean":"2023-08-31T02:01:23.154508+0000","last_became_active":"2023-08-31T02:01:21.495110+0000","last_became_peered":"2023-08-31T02:01:21.495110+0000","last_unstale":"2023-08-31T02:01:23.154508+0000","last_undegraded":"2023-08-31T02:01:23.154508+0000","last_fullsized":"2023-08-31T02:01:23.154508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:17.307517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154441+0000","last_change":"2023-08-31T02:01:21.488517+0000","last_active":"2023-08-31T02:01:23.154441+0000","last_peered":"2023-08-31T02:01:23.154441+0000","last_clean":"2023-08-31T02:01:23.154441+0000","last_became_active":"2023-08-31T02:01:21.488239+0000","last_became_peered":"2023-08-31T02:01:21.488239+0000","last_unstale":"2023-08-31T02:01:23.154441+0000","last_undegraded":"2023-08-31T02:01:23.154441+0000","last_fullsized":"2023-08-31T02:01:23.154441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:33.898751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154306+0000","last_change":"2023-08-31T02:01:21.490976+0000","last_active":"2023-08-31T02:01:23.154306+0000","last_peered":"2023-08-31T02:01:23.154306+0000","last_clean":"2023-08-31T02:01:23.154306+0000","last_became_active":"2023-08-31T02:01:21.490707+0000","last_became_peered":"2023-08-31T02:01:21.490707+0000","last_unstale":"2023-08-31T02:01:23.154306+0000","last_undegraded":"2023-08-31T02:01:23.154306+0000","last_fullsized":"2023-08-31T02:01:23.154306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:21:01.584279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474281+0000","last_change":"2023-08-31T02:01:21.487315+0000","last_active":"2023-08-31T02:01:22.474281+0000","last_peered":"2023-08-31T02:01:22.474281+0000","last_clean":"2023-08-31T02:01:22.474281+0000","last_became_active":"2023-08-31T02:01:21.487028+0000","last_became_peered":"2023-08-31T02:01:21.487028+0000","last_unstale":"2023-08-31T02:01:22.474281+0000","last_undegraded":"2023-08-31T02:01:22.474281+0000","last_fullsized":"2023-08-31T02:01:22.474281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473190+0000","last_change":"2023-08-31T02:01:21.486242+0000","last_active":"2023-08-31T02:01:22.473190+0000","last_peered":"2023-08-31T02:01:22.473190+0000","last_clean":"2023-08-31T02:01:22.473190+0000","last_became_active":"2023-08-31T02:01:21.485620+0000","last_became_peered":"2023-08-31T02:01:21.485620+0000","last_unstale":"2023-08-31T02:01:22.473190+0000","last_undegraded":"2023-08-31T02:01:22.473190+0000","last_fullsized":"2023-08-31T02:01:22.473190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154800+0000","last_change":"2023-08-31T02:01:21.495072+0000","last_active":"2023-08-31T02:01:23.154800+0000","last_peered":"2023-08-31T02:01:23.154800+0000","last_clean":"2023-08-31T02:01:23.154800+0000","last_became_active":"2023-08-31T02:01:21.494263+0000","last_became_peered":"2023-08-31T02:01:21.494263+0000","last_unstale":"2023-08-31T02:01:23.154800+0000","last_undegraded":"2023-08-31T02:01:23.154800+0000","last_fullsized":"2023-08-31T02:01:23.154800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153910+0000","last_change":"2023-08-31T02:01:21.494001+0000","last_active":"2023-08-31T02:01:23.153910+0000","last_peered":"2023-08-31T02:01:23.153910+0000","last_clean":"2023-08-31T02:01:23.153910+0000","last_became_active":"2023-08-31T02:01:21.493742+0000","last_became_peered":"2023-08-31T02:01:21.493742+0000","last_unstale":"2023-08-31T02:01:23.153910+0000","last_undegraded":"2023-08-31T02:01:23.153910+0000","last_fullsized":"2023-08-31T02:01:23.153910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:53:45.076676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154521+0000","last_change":"2023-08-31T02:01:21.491466+0000","last_active":"2023-08-31T02:01:23.154521+0000","last_peered":"2023-08-31T02:01:23.154521+0000","last_clean":"2023-08-31T02:01:23.154521+0000","last_became_active":"2023-08-31T02:01:21.488906+0000","last_became_peered":"2023-08-31T02:01:21.488906+0000","last_unstale":"2023-08-31T02:01:23.154521+0000","last_undegraded":"2023-08-31T02:01:23.154521+0000","last_fullsized":"2023-08-31T02:01:23.154521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:53.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154435+0000","last_change":"2023-08-31T02:01:21.495374+0000","last_active":"2023-08-31T02:01:23.154435+0000","last_peered":"2023-08-31T02:01:23.154435+0000","last_clean":"2023-08-31T02:01:23.154435+0000","last_became_active":"2023-08-31T02:01:21.494511+0000","last_became_peered":"2023-08-31T02:01:21.494511+0000","last_unstale":"2023-08-31T02:01:23.154435+0000","last_undegraded":"2023-08-31T02:01:23.154435+0000","last_fullsized":"2023-08-31T02:01:23.154435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:37.313340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474483+0000","last_change":"2023-08-31T02:01:21.486431+0000","last_active":"2023-08-31T02:01:22.474483+0000","last_peered":"2023-08-31T02:01:22.474483+0000","last_clean":"2023-08-31T02:01:22.474483+0000","last_became_active":"2023-08-31T02:01:21.486138+0000","last_became_peered":"2023-08-31T02:01:21.486138+0000","last_unstale":"2023-08-31T02:01:22.474483+0000","last_undegraded":"2023-08-31T02:01:22.474483+0000","last_fullsized":"2023-08-31T02:01:22.474483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154708+0000","last_change":"2023-08-31T02:01:21.492203+0000","last_active":"2023-08-31T02:01:23.154708+0000","last_peered":"2023-08-31T02:01:23.154708+0000","last_clean":"2023-08-31T02:01:23.154708+0000","last_became_active":"2023-08-31T02:01:21.491853+0000","last_became_peered":"2023-08-31T02:01:21.491853+0000","last_unstale":"2023-08-31T02:01:23.154708+0000","last_undegraded":"2023-08-31T02:01:23.154708+0000","last_fullsized":"2023-08-31T02:01:23.154708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:12.582057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155112+0000","last_change":"2023-08-31T02:01:21.489782+0000","last_active":"2023-08-31T02:01:23.155112+0000","last_peered":"2023-08-31T02:01:23.155112+0000","last_clean":"2023-08-31T02:01:23.155112+0000","last_became_active":"2023-08-31T02:01:21.489511+0000","last_became_peered":"2023-08-31T02:01:21.489511+0000","last_unstale":"2023-08-31T02:01:23.155112+0000","last_undegraded":"2023-08-31T02:01:23.155112+0000","last_fullsized":"2023-08-31T02:01:23.155112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:29.822747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154808+0000","last_change":"2023-08-31T02:01:21.494310+0000","last_active":"2023-08-31T02:01:23.154808+0000","last_peered":"2023-08-31T02:01:23.154808+0000","last_clean":"2023-08-31T02:01:23.154808+0000","last_became_active":"2023-08-31T02:01:21.493693+0000","last_became_peered":"2023-08-31T02:01:21.493693+0000","last_unstale":"2023-08-31T02:01:23.154808+0000","last_undegraded":"2023-08-31T02:01:23.154808+0000","last_fullsized":"2023-08-31T02:01:23.154808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154938+0000","last_change":"2023-08-31T02:01:21.488296+0000","last_active":"2023-08-31T02:01:23.154938+0000","last_peered":"2023-08-31T02:01:23.154938+0000","last_clean":"2023-08-31T02:01:23.154938+0000","last_became_active":"2023-08-31T02:01:21.487819+0000","last_became_peered":"2023-08-31T02:01:21.487819+0000","last_unstale":"2023-08-31T02:01:23.154938+0000","last_undegraded":"2023-08-31T02:01:23.154938+0000","last_fullsized":"2023-08-31T02:01:23.154938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:25:18.019269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154497+0000","last_change":"2023-08-31T02:01:20.465896+0000","last_active":"2023-08-31T02:01:23.154497+0000","last_peered":"2023-08-31T02:01:23.154497+0000","last_clean":"2023-08-31T02:01:23.154497+0000","last_became_active":"2023-08-31T02:01:20.465615+0000","last_became_peered":"2023-08-31T02:01:20.465615+0000","last_unstale":"2023-08-31T02:01:23.154497+0000","last_undegraded":"2023-08-31T02:01:23.154497+0000","last_fullsized":"2023-08-31T02:01:23.154497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154252+0000","last_change":"2023-08-31T02:01:20.473610+0000","last_active":"2023-08-31T02:01:23.154252+0000","last_peered":"2023-08-31T02:01:23.154252+0000","last_clean":"2023-08-31T02:01:23.154252+0000","last_became_active":"2023-08-31T02:01:20.473370+0000","last_became_peered":"2023-08-31T02:01:20.473370+0000","last_unstale":"2023-08-31T02:01:23.154252+0000","last_undegraded":"2023-08-31T02:01:23.154252+0000","last_fullsized":"2023-08-31T02:01:23.154252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473534+0000","last_change":"2023-08-31T02:01:21.489900+0000","last_active":"2023-08-31T02:01:22.473534+0000","last_peered":"2023-08-31T02:01:22.473534+0000","last_clean":"2023-08-31T02:01:22.473534+0000","last_became_active":"2023-08-31T02:01:21.489618+0000","last_became_peered":"2023-08-31T02:01:21.489618+0000","last_unstale":"2023-08-31T02:01:22.473534+0000","last_undegraded":"2023-08-31T02:01:22.473534+0000","last_fullsized":"2023-08-31T02:01:22.473534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454626+0000","last_change":"2023-08-31T02:01:19.454626+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454626+0000","last_undegraded":"2023-08-31T02:01:19.454626+0000","last_fullsized":"2023-08-31T02:01:19.454626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473009+0000","last_change":"2023-08-31T02:01:21.494971+0000","last_active":"2023-08-31T02:01:22.473009+0000","last_peered":"2023-08-31T02:01:22.473009+0000","last_clean":"2023-08-31T02:01:22.473009+0000","last_became_active":"2023-08-31T02:01:21.494720+0000","last_became_peered":"2023-08-31T02:01:21.494720+0000","last_unstale":"2023-08-31T02:01:22.473009+0000","last_undegraded":"2023-08-31T02:01:22.473009+0000","last_fullsized":"2023-08-31T02:01:22.473009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473465+0000","last_change":"2023-08-31T02:01:20.473405+0000","last_active":"2023-08-31T02:01:22.473465+0000","last_peered":"2023-08-31T02:01:22.473465+0000","last_clean":"2023-08-31T02:01:22.473465+0000","last_became_active":"2023-08-31T02:01:20.473136+0000","last_became_peered":"2023-08-31T02:01:20.473136+0000","last_unstale":"2023-08-31T02:01:22.473465+0000","last_undegraded":"2023-08-31T02:01:22.473465+0000","last_fullsized":"2023-08-31T02:01:22.473465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:52.204278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154011+0000","last_change":"2023-08-31T02:01:21.492984+0000","last_active":"2023-08-31T02:01:23.154011+0000","last_peered":"2023-08-31T02:01:23.154011+0000","last_clean":"2023-08-31T02:01:23.154011+0000","last_became_active":"2023-08-31T02:01:21.492715+0000","last_became_peered":"2023-08-31T02:01:21.492715+0000","last_unstale":"2023-08-31T02:01:23.154011+0000","last_undegraded":"2023-08-31T02:01:23.154011+0000","last_fullsized":"2023-08-31T02:01:23.154011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474381+0000","last_change":"2023-08-31T02:01:20.473298+0000","last_active":"2023-08-31T02:01:22.474381+0000","last_peered":"2023-08-31T02:01:22.474381+0000","last_clean":"2023-08-31T02:01:22.474381+0000","last_became_active":"2023-08-31T02:01:20.473015+0000","last_became_peered":"2023-08-31T02:01:20.473015+0000","last_unstale":"2023-08-31T02:01:22.474381+0000","last_undegraded":"2023-08-31T02:01:22.474381+0000","last_fullsized":"2023-08-31T02:01:22.474381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:30:14.876894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474030+0000","last_change":"2023-08-31T02:01:21.490644+0000","last_active":"2023-08-31T02:01:22.474030+0000","last_peered":"2023-08-31T02:01:22.474030+0000","last_clean":"2023-08-31T02:01:22.474030+0000","last_became_active":"2023-08-31T02:01:21.490332+0000","last_became_peered":"2023-08-31T02:01:21.490332+0000","last_unstale":"2023-08-31T02:01:22.474030+0000","last_undegraded":"2023-08-31T02:01:22.474030+0000","last_fullsized":"2023-08-31T02:01:22.474030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154648+0000","last_change":"2023-08-31T02:01:20.477111+0000","last_active":"2023-08-31T02:01:23.154648+0000","last_peered":"2023-08-31T02:01:23.154648+0000","last_clean":"2023-08-31T02:01:23.154648+0000","last_became_active":"2023-08-31T02:01:20.476863+0000","last_became_peered":"2023-08-31T02:01:20.476863+0000","last_unstale":"2023-08-31T02:01:23.154648+0000","last_undegraded":"2023-08-31T02:01:23.154648+0000","last_fullsized":"2023-08-31T02:01:23.154648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473095+0000","last_change":"2023-08-31T02:01:21.487297+0000","last_active":"2023-08-31T02:01:22.473095+0000","last_peered":"2023-08-31T02:01:22.473095+0000","last_clean":"2023-08-31T02:01:22.473095+0000","last_became_active":"2023-08-31T02:01:21.487044+0000","last_became_peered":"2023-08-31T02:01:21.487044+0000","last_unstale":"2023-08-31T02:01:22.473095+0000","last_undegraded":"2023-08-31T02:01:22.473095+0000","last_fullsized":"2023-08-31T02:01:22.473095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454640+0000","last_change":"2023-08-31T02:01:19.454640+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454640+0000","last_undegraded":"2023-08-31T02:01:19.454640+0000","last_fullsized":"2023-08-31T02:01:19.454640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473036+0000","last_change":"2023-08-31T02:01:21.488464+0000","last_active":"2023-08-31T02:01:22.473036+0000","last_peered":"2023-08-31T02:01:22.473036+0000","last_clean":"2023-08-31T02:01:22.473036+0000","last_became_active":"2023-08-31T02:01:21.487547+0000","last_became_peered":"2023-08-31T02:01:21.487547+0000","last_unstale":"2023-08-31T02:01:22.473036+0000","last_undegraded":"2023-08-31T02:01:22.473036+0000","last_fullsized":"2023-08-31T02:01:22.473036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472884+0000","last_change":"2023-08-31T02:01:20.463335+0000","last_active":"2023-08-31T02:01:22.472884+0000","last_peered":"2023-08-31T02:01:22.472884+0000","last_clean":"2023-08-31T02:01:22.472884+0000","last_became_active":"2023-08-31T02:01:20.463073+0000","last_became_peered":"2023-08-31T02:01:20.463073+0000","last_unstale":"2023-08-31T02:01:22.472884+0000","last_undegraded":"2023-08-31T02:01:22.472884+0000","last_fullsized":"2023-08-31T02:01:22.472884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:35:51.541453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154755+0000","last_change":"2023-08-31T02:01:21.494127+0000","last_active":"2023-08-31T02:01:23.154755+0000","last_peered":"2023-08-31T02:01:23.154755+0000","last_clean":"2023-08-31T02:01:23.154755+0000","last_became_active":"2023-08-31T02:01:21.491465+0000","last_became_peered":"2023-08-31T02:01:21.491465+0000","last_unstale":"2023-08-31T02:01:23.154755+0000","last_undegraded":"2023-08-31T02:01:23.154755+0000","last_fullsized":"2023-08-31T02:01:23.154755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:36:48.080941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473047+0000","last_change":"2023-08-31T02:01:20.472411+0000","last_active":"2023-08-31T02:01:22.473047+0000","last_peered":"2023-08-31T02:01:22.473047+0000","last_clean":"2023-08-31T02:01:22.473047+0000","last_became_active":"2023-08-31T02:01:20.472124+0000","last_became_peered":"2023-08-31T02:01:20.472124+0000","last_unstale":"2023-08-31T02:01:22.473047+0000","last_undegraded":"2023-08-31T02:01:22.473047+0000","last_fullsized":"2023-08-31T02:01:22.473047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154748+0000","last_change":"2023-08-31T02:01:21.494040+0000","last_active":"2023-08-31T02:01:23.154748+0000","last_peered":"2023-08-31T02:01:23.154748+0000","last_clean":"2023-08-31T02:01:23.154748+0000","last_became_active":"2023-08-31T02:01:21.493350+0000","last_became_peered":"2023-08-31T02:01:21.493350+0000","last_unstale":"2023-08-31T02:01:23.154748+0000","last_undegraded":"2023-08-31T02:01:23.154748+0000","last_fullsized":"2023-08-31T02:01:23.154748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474606+0000","last_change":"2023-08-31T02:01:20.475643+0000","last_active":"2023-08-31T02:01:22.474606+0000","last_peered":"2023-08-31T02:01:22.474606+0000","last_clean":"2023-08-31T02:01:22.474606+0000","last_became_active":"2023-08-31T02:01:20.475359+0000","last_became_peered":"2023-08-31T02:01:20.475359+0000","last_unstale":"2023-08-31T02:01:22.474606+0000","last_undegraded":"2023-08-31T02:01:22.474606+0000","last_fullsized":"2023-08-31T02:01:22.474606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154159+0000","last_change":"2023-08-31T02:01:21.486994+0000","last_active":"2023-08-31T02:01:23.154159+0000","last_peered":"2023-08-31T02:01:23.154159+0000","last_clean":"2023-08-31T02:01:23.154159+0000","last_became_active":"2023-08-31T02:01:21.485891+0000","last_became_peered":"2023-08-31T02:01:21.485891+0000","last_unstale":"2023-08-31T02:01:23.154159+0000","last_undegraded":"2023-08-31T02:01:23.154159+0000","last_fullsized":"2023-08-31T02:01:23.154159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474693+0000","last_change":"2023-08-31T02:01:20.474688+0000","last_active":"2023-08-31T02:01:22.474693+0000","last_peered":"2023-08-31T02:01:22.474693+0000","last_clean":"2023-08-31T02:01:22.474693+0000","last_became_active":"2023-08-31T02:01:20.474417+0000","last_became_peered":"2023-08-31T02:01:20.474417+0000","last_unstale":"2023-08-31T02:01:22.474693+0000","last_undegraded":"2023-08-31T02:01:22.474693+0000","last_fullsized":"2023-08-31T02:01:22.474693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473576+0000","last_change":"2023-08-31T02:01:21.481153+0000","last_active":"2023-08-31T02:01:22.473576+0000","last_peered":"2023-08-31T02:01:22.473576+0000","last_clean":"2023-08-31T02:01:22.473576+0000","last_became_active":"2023-08-31T02:01:21.480678+0000","last_became_peered":"2023-08-31T02:01:21.480678+0000","last_unstale":"2023-08-31T02:01:22.473576+0000","last_undegraded":"2023-08-31T02:01:22.473576+0000","last_fullsized":"2023-08-31T02:01:22.473576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472919+0000","last_change":"2023-08-31T02:01:20.474897+0000","last_active":"2023-08-31T02:01:22.472919+0000","last_peered":"2023-08-31T02:01:22.472919+0000","last_clean":"2023-08-31T02:01:22.472919+0000","last_became_active":"2023-08-31T02:01:20.474227+0000","last_became_peered":"2023-08-31T02:01:20.474227+0000","last_unstale":"2023-08-31T02:01:22.472919+0000","last_undegraded":"2023-08-31T02:01:22.472919+0000","last_fullsized":"2023-08-31T02:01:22.472919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153851+0000","last_change":"2023-08-31T02:01:21.487392+0000","last_active":"2023-08-31T02:01:23.153851+0000","last_peered":"2023-08-31T02:01:23.153851+0000","last_clean":"2023-08-31T02:01:23.153851+0000","last_became_active":"2023-08-31T02:01:21.487162+0000","last_became_peered":"2023-08-31T02:01:21.487162+0000","last_unstale":"2023-08-31T02:01:23.153851+0000","last_undegraded":"2023-08-31T02:01:23.153851+0000","last_fullsized":"2023-08-31T02:01:23.153851+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472807+0000","last_change":"2023-08-31T02:01:20.480632+0000","last_active":"2023-08-31T02:01:22.472807+0000","last_peered":"2023-08-31T02:01:22.472807+0000","last_clean":"2023-08-31T02:01:22.472807+0000","last_became_active":"2023-08-31T02:01:20.480307+0000","last_became_peered":"2023-08-31T02:01:20.480307+0000","last_unstale":"2023-08-31T02:01:22.472807+0000","last_undegraded":"2023-08-31T02:01:22.472807+0000","last_fullsized":"2023-08-31T02:01:22.472807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:27:43.975042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472537+0000","last_change":"2023-08-31T02:01:21.492360+0000","last_active":"2023-08-31T02:01:22.472537+0000","last_peered":"2023-08-31T02:01:22.472537+0000","last_clean":"2023-08-31T02:01:22.472537+0000","last_became_active":"2023-08-31T02:01:21.492055+0000","last_became_peered":"2023-08-31T02:01:21.492055+0000","last_unstale":"2023-08-31T02:01:22.472537+0000","last_undegraded":"2023-08-31T02:01:22.472537+0000","last_fullsized":"2023-08-31T02:01:22.472537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454580+0000","last_change":"2023-08-31T02:01:19.454580+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454580+0000","last_undegraded":"2023-08-31T02:01:19.454580+0000","last_fullsized":"2023-08-31T02:01:19.454580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154659+0000","last_change":"2023-08-31T02:01:21.494582+0000","last_active":"2023-08-31T02:01:23.154659+0000","last_peered":"2023-08-31T02:01:23.154659+0000","last_clean":"2023-08-31T02:01:23.154659+0000","last_became_active":"2023-08-31T02:01:21.494273+0000","last_became_peered":"2023-08-31T02:01:21.494273+0000","last_unstale":"2023-08-31T02:01:23.154659+0000","last_undegraded":"2023-08-31T02:01:23.154659+0000","last_fullsized":"2023-08-31T02:01:23.154659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154231+0000","last_change":"2023-08-31T02:01:20.466640+0000","last_active":"2023-08-31T02:01:23.154231+0000","last_peered":"2023-08-31T02:01:23.154231+0000","last_clean":"2023-08-31T02:01:23.154231+0000","last_became_active":"2023-08-31T02:01:20.466315+0000","last_became_peered":"2023-08-31T02:01:20.466315+0000","last_unstale":"2023-08-31T02:01:23.154231+0000","last_undegraded":"2023-08-31T02:01:23.154231+0000","last_fullsized":"2023-08-31T02:01:23.154231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472600+0000","last_change":"2023-08-31T02:01:21.488792+0000","last_active":"2023-08-31T02:01:22.472600+0000","last_peered":"2023-08-31T02:01:22.472600+0000","last_clean":"2023-08-31T02:01:22.472600+0000","last_became_active":"2023-08-31T02:01:21.488218+0000","last_became_peered":"2023-08-31T02:01:21.488218+0000","last_unstale":"2023-08-31T02:01:22.472600+0000","last_undegraded":"2023-08-31T02:01:22.472600+0000","last_fullsized":"2023-08-31T02:01:22.472600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155040+0000","last_change":"2023-08-31T02:01:20.476965+0000","last_active":"2023-08-31T02:01:23.155040+0000","last_peered":"2023-08-31T02:01:23.155040+0000","last_clean":"2023-08-31T02:01:23.155040+0000","last_became_active":"2023-08-31T02:01:20.476698+0000","last_became_peered":"2023-08-31T02:01:20.476698+0000","last_unstale":"2023-08-31T02:01:23.155040+0000","last_undegraded":"2023-08-31T02:01:23.155040+0000","last_fullsized":"2023-08-31T02:01:23.155040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472783+0000","last_change":"2023-08-31T02:01:21.493915+0000","last_active":"2023-08-31T02:01:22.472783+0000","last_peered":"2023-08-31T02:01:22.472783+0000","last_clean":"2023-08-31T02:01:22.472783+0000","last_became_active":"2023-08-31T02:01:21.493676+0000","last_became_peered":"2023-08-31T02:01:21.493676+0000","last_unstale":"2023-08-31T02:01:22.472783+0000","last_undegraded":"2023-08-31T02:01:22.472783+0000","last_fullsized":"2023-08-31T02:01:22.472783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474583+0000","last_change":"2023-08-31T02:01:20.477508+0000","last_active":"2023-08-31T02:01:22.474583+0000","last_peered":"2023-08-31T02:01:22.474583+0000","last_clean":"2023-08-31T02:01:22.474583+0000","last_became_active":"2023-08-31T02:01:20.477260+0000","last_became_peered":"2023-08-31T02:01:20.477260+0000","last_unstale":"2023-08-31T02:01:22.474583+0000","last_undegraded":"2023-08-31T02:01:22.474583+0000","last_fullsized":"2023-08-31T02:01:22.474583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:44:05.421419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474724+0000","last_change":"2023-08-31T02:01:21.491870+0000","last_active":"2023-08-31T02:01:22.474724+0000","last_peered":"2023-08-31T02:01:22.474724+0000","last_clean":"2023-08-31T02:01:22.474724+0000","last_became_active":"2023-08-31T02:01:21.491592+0000","last_became_peered":"2023-08-31T02:01:21.491592+0000","last_unstale":"2023-08-31T02:01:22.474724+0000","last_undegraded":"2023-08-31T02:01:22.474724+0000","last_fullsized":"2023-08-31T02:01:22.474724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473493+0000","last_change":"2023-08-31T02:01:20.475956+0000","last_active":"2023-08-31T02:01:22.473493+0000","last_peered":"2023-08-31T02:01:22.473493+0000","last_clean":"2023-08-31T02:01:22.473493+0000","last_became_active":"2023-08-31T02:01:20.475694+0000","last_became_peered":"2023-08-31T02:01:20.475694+0000","last_unstale":"2023-08-31T02:01:22.473493+0000","last_undegraded":"2023-08-31T02:01:22.473493+0000","last_fullsized":"2023-08-31T02:01:22.473493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473616+0000","last_change":"2023-08-31T02:01:21.491382+0000","last_active":"2023-08-31T02:01:22.473616+0000","last_peered":"2023-08-31T02:01:22.473616+0000","last_clean":"2023-08-31T02:01:22.473616+0000","last_became_active":"2023-08-31T02:01:21.491114+0000","last_became_peered":"2023-08-31T02:01:21.491114+0000","last_unstale":"2023-08-31T02:01:22.473616+0000","last_undegraded":"2023-08-31T02:01:22.473616+0000","last_fullsized":"2023-08-31T02:01:22.473616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154526+0000","last_change":"2023-08-31T02:01:20.474505+0000","last_active":"2023-08-31T02:01:23.154526+0000","last_peered":"2023-08-31T02:01:23.154526+0000","last_clean":"2023-08-31T02:01:23.154526+0000","last_became_active":"2023-08-31T02:01:20.474179+0000","last_became_peered":"2023-08-31T02:01:20.474179+0000","last_unstale":"2023-08-31T02:01:23.154526+0000","last_undegraded":"2023-08-31T02:01:23.154526+0000","last_fullsized":"2023-08-31T02:01:23.154526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:02:02.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154570+0000","last_change":"2023-08-31T02:01:21.491206+0000","last_active":"2023-08-31T02:01:23.154570+0000","last_peered":"2023-08-31T02:01:23.154570+0000","last_clean":"2023-08-31T02:01:23.154570+0000","last_became_active":"2023-08-31T02:01:21.490947+0000","last_became_peered":"2023-08-31T02:01:21.490947+0000","last_unstale":"2023-08-31T02:01:23.154570+0000","last_undegraded":"2023-08-31T02:01:23.154570+0000","last_fullsized":"2023-08-31T02:01:23.154570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:55.955512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T02:01:19.454653+0000","last_change":"2023-08-31T02:01:19.454653+0000","last_active":"2023-08-31T02:01:19.448346+0000","last_peered":"2023-08-31T02:01:19.448346+0000","last_clean":"2023-08-31T02:01:19.448346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:19.454653+0000","last_undegraded":"2023-08-31T02:01:19.454653+0000","last_fullsized":"2023-08-31T02:01:19.454653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155214+0000","last_change":"2023-08-31T02:01:21.494374+0000","last_active":"2023-08-31T02:01:23.155214+0000","last_peered":"2023-08-31T02:01:23.155214+0000","last_clean":"2023-08-31T02:01:23.155214+0000","last_became_active":"2023-08-31T02:01:21.494077+0000","last_became_peered":"2023-08-31T02:01:21.494077+0000","last_unstale":"2023-08-31T02:01:23.155214+0000","last_undegraded":"2023-08-31T02:01:23.155214+0000","last_fullsized":"2023-08-31T02:01:23.155214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:19:25.263827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154576+0000","last_change":"2023-08-31T02:01:20.467838+0000","last_active":"2023-08-31T02:01:23.154576+0000","last_peered":"2023-08-31T02:01:23.154576+0000","last_clean":"2023-08-31T02:01:23.154576+0000","last_became_active":"2023-08-31T02:01:20.467567+0000","last_became_peered":"2023-08-31T02:01:20.467567+0000","last_unstale":"2023-08-31T02:01:23.154576+0000","last_undegraded":"2023-08-31T02:01:23.154576+0000","last_fullsized":"2023-08-31T02:01:23.154576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:27:02.795050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154093+0000","last_change":"2023-08-31T02:01:21.491262+0000","last_active":"2023-08-31T02:01:23.154093+0000","last_peered":"2023-08-31T02:01:23.154093+0000","last_clean":"2023-08-31T02:01:23.154093+0000","last_became_active":"2023-08-31T02:01:21.490982+0000","last_became_peered":"2023-08-31T02:01:21.490982+0000","last_unstale":"2023-08-31T02:01:23.154093+0000","last_undegraded":"2023-08-31T02:01:23.154093+0000","last_fullsized":"2023-08-31T02:01:23.154093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154338+0000","last_change":"2023-08-31T02:01:20.469596+0000","last_active":"2023-08-31T02:01:23.154338+0000","last_peered":"2023-08-31T02:01:23.154338+0000","last_clean":"2023-08-31T02:01:23.154338+0000","last_became_active":"2023-08-31T02:01:20.469290+0000","last_became_peered":"2023-08-31T02:01:20.469290+0000","last_unstale":"2023-08-31T02:01:23.154338+0000","last_undegraded":"2023-08-31T02:01:23.154338+0000","last_fullsized":"2023-08-31T02:01:23.154338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:27:42.568205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474353+0000","last_change":"2023-08-31T02:01:21.493623+0000","last_active":"2023-08-31T02:01:22.474353+0000","last_peered":"2023-08-31T02:01:22.474353+0000","last_clean":"2023-08-31T02:01:22.474353+0000","last_became_active":"2023-08-31T02:01:21.493369+0000","last_became_peered":"2023-08-31T02:01:21.493369+0000","last_unstale":"2023-08-31T02:01:22.474353+0000","last_undegraded":"2023-08-31T02:01:22.474353+0000","last_fullsized":"2023-08-31T02:01:22.474353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:20.474557+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:20.474269+0000","last_became_peered":"2023-08-31T02:01:20.474269+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472721+0000","last_change":"2023-08-31T02:01:21.488629+0000","last_active":"2023-08-31T02:01:22.472721+0000","last_peered":"2023-08-31T02:01:22.472721+0000","last_clean":"2023-08-31T02:01:22.472721+0000","last_became_active":"2023-08-31T02:01:21.487877+0000","last_became_peered":"2023-08-31T02:01:21.487877+0000","last_unstale":"2023-08-31T02:01:22.472721+0000","last_undegraded":"2023-08-31T02:01:22.472721+0000","last_fullsized":"2023-08-31T02:01:22.472721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153853+0000","last_change":"2023-08-31T02:01:20.474084+0000","last_active":"2023-08-31T02:01:23.153853+0000","last_peered":"2023-08-31T02:01:23.153853+0000","last_clean":"2023-08-31T02:01:23.153853+0000","last_became_active":"2023-08-31T02:01:20.473811+0000","last_became_peered":"2023-08-31T02:01:20.473811+0000","last_unstale":"2023-08-31T02:01:23.153853+0000","last_undegraded":"2023-08-31T02:01:23.153853+0000","last_fullsized":"2023-08-31T02:01:23.153853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:18:30.609765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474465+0000","last_change":"2023-08-31T02:01:20.474116+0000","last_active":"2023-08-31T02:01:22.474465+0000","last_peered":"2023-08-31T02:01:22.474465+0000","last_clean":"2023-08-31T02:01:22.474465+0000","last_became_active":"2023-08-31T02:01:20.473855+0000","last_became_peered":"2023-08-31T02:01:20.473855+0000","last_unstale":"2023-08-31T02:01:22.474465+0000","last_undegraded":"2023-08-31T02:01:22.474465+0000","last_fullsized":"2023-08-31T02:01:22.474465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:41:18.994166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:21.494457+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:21.493732+0000","last_became_peered":"2023-08-31T02:01:21.493732+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.600588+0000","last_change":"2023-08-31T02:01:20.474656+0000","last_active":"2023-08-31T02:01:23.600588+0000","last_peered":"2023-08-31T02:01:23.600588+0000","last_clean":"2023-08-31T02:01:23.600588+0000","last_became_active":"2023-08-31T02:01:20.474369+0000","last_became_peered":"2023-08-31T02:01:20.474369+0000","last_unstale":"2023-08-31T02:01:23.600588+0000","last_undegraded":"2023-08-31T02:01:23.600588+0000","last_fullsized":"2023-08-31T02:01:23.600588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:45:00.848193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473070+0000","last_change":"2023-08-31T02:01:21.477794+0000","last_active":"2023-08-31T02:01:22.473070+0000","last_peered":"2023-08-31T02:01:22.473070+0000","last_clean":"2023-08-31T02:01:22.473070+0000","last_became_active":"2023-08-31T02:01:21.477508+0000","last_became_peered":"2023-08-31T02:01:21.477508+0000","last_unstale":"2023-08-31T02:01:22.473070+0000","last_undegraded":"2023-08-31T02:01:22.473070+0000","last_fullsized":"2023-08-31T02:01:22.473070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154313+0000","last_change":"2023-08-31T02:01:20.474392+0000","last_active":"2023-08-31T02:01:23.154313+0000","last_peered":"2023-08-31T02:01:23.154313+0000","last_clean":"2023-08-31T02:01:23.154313+0000","last_became_active":"2023-08-31T02:01:20.473883+0000","last_became_peered":"2023-08-31T02:01:20.473883+0000","last_unstale":"2023-08-31T02:01:23.154313+0000","last_undegraded":"2023-08-31T02:01:23.154313+0000","last_fullsized":"2023-08-31T02:01:23.154313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:36.309094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153979+0000","last_change":"2023-08-31T02:01:21.484480+0000","last_active":"2023-08-31T02:01:23.153979+0000","last_peered":"2023-08-31T02:01:23.153979+0000","last_clean":"2023-08-31T02:01:23.153979+0000","last_became_active":"2023-08-31T02:01:21.484215+0000","last_became_peered":"2023-08-31T02:01:21.484215+0000","last_unstale":"2023-08-31T02:01:23.153979+0000","last_undegraded":"2023-08-31T02:01:23.153979+0000","last_fullsized":"2023-08-31T02:01:23.153979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154406+0000","last_change":"2023-08-31T02:01:20.470456+0000","last_active":"2023-08-31T02:01:23.154406+0000","last_peered":"2023-08-31T02:01:23.154406+0000","last_clean":"2023-08-31T02:01:23.154406+0000","last_became_active":"2023-08-31T02:01:20.470196+0000","last_became_peered":"2023-08-31T02:01:20.470196+0000","last_unstale":"2023-08-31T02:01:23.154406+0000","last_undegraded":"2023-08-31T02:01:23.154406+0000","last_fullsized":"2023-08-31T02:01:23.154406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T02:01:20.452593+0000","last_change":"2023-08-31T02:01:20.452593+0000","last_active":"2023-08-31T02:01:20.452593+0000","last_peered":"2023-08-31T02:01:20.452593+0000","last_clean":"2023-08-31T02:01:20.452593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T02:01:20.452593+0000","last_undegraded":"2023-08-31T02:01:20.452593+0000","last_fullsized":"2023-08-31T02:01:20.452593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155067+0000","last_change":"2023-08-31T02:01:20.473075+0000","last_active":"2023-08-31T02:01:23.155067+0000","last_peered":"2023-08-31T02:01:23.155067+0000","last_clean":"2023-08-31T02:01:23.155067+0000","last_became_active":"2023-08-31T02:01:20.472816+0000","last_became_peered":"2023-08-31T02:01:20.472816+0000","last_unstale":"2023-08-31T02:01:23.155067+0000","last_undegraded":"2023-08-31T02:01:23.155067+0000","last_fullsized":"2023-08-31T02:01:23.155067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473306+0000","last_change":"2023-08-31T02:01:21.480979+0000","last_active":"2023-08-31T02:01:22.473306+0000","last_peered":"2023-08-31T02:01:22.473306+0000","last_clean":"2023-08-31T02:01:22.473306+0000","last_became_active":"2023-08-31T02:01:21.480663+0000","last_became_peered":"2023-08-31T02:01:21.480663+0000","last_unstale":"2023-08-31T02:01:22.473306+0000","last_undegraded":"2023-08-31T02:01:22.473306+0000","last_fullsized":"2023-08-31T02:01:22.473306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472970+0000","last_change":"2023-08-31T02:01:20.471925+0000","last_active":"2023-08-31T02:01:22.472970+0000","last_peered":"2023-08-31T02:01:22.472970+0000","last_clean":"2023-08-31T02:01:22.472970+0000","last_became_active":"2023-08-31T02:01:20.471633+0000","last_became_peered":"2023-08-31T02:01:20.471633+0000","last_unstale":"2023-08-31T02:01:22.472970+0000","last_undegraded":"2023-08-31T02:01:22.472970+0000","last_fullsized":"2023-08-31T02:01:22.472970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155077+0000","last_change":"2023-08-31T02:01:21.490803+0000","last_active":"2023-08-31T02:01:23.155077+0000","last_peered":"2023-08-31T02:01:23.155077+0000","last_clean":"2023-08-31T02:01:23.155077+0000","last_became_active":"2023-08-31T02:01:21.490535+0000","last_became_peered":"2023-08-31T02:01:21.490535+0000","last_unstale":"2023-08-31T02:01:23.155077+0000","last_undegraded":"2023-08-31T02:01:23.155077+0000","last_fullsized":"2023-08-31T02:01:23.155077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:17:07.573441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472499+0000","last_change":"2023-08-31T02:01:20.473424+0000","last_active":"2023-08-31T02:01:22.472499+0000","last_peered":"2023-08-31T02:01:22.472499+0000","last_clean":"2023-08-31T02:01:22.472499+0000","last_became_active":"2023-08-31T02:01:20.473069+0000","last_became_peered":"2023-08-31T02:01:20.473069+0000","last_unstale":"2023-08-31T02:01:22.472499+0000","last_undegraded":"2023-08-31T02:01:22.472499+0000","last_fullsized":"2023-08-31T02:01:22.472499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:19:53.569012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474460+0000","last_change":"2023-08-31T02:01:21.478455+0000","last_active":"2023-08-31T02:01:22.474460+0000","last_peered":"2023-08-31T02:01:22.474460+0000","last_clean":"2023-08-31T02:01:22.474460+0000","last_became_active":"2023-08-31T02:01:21.476993+0000","last_became_peered":"2023-08-31T02:01:21.476993+0000","last_unstale":"2023-08-31T02:01:22.474460+0000","last_undegraded":"2023-08-31T02:01:22.474460+0000","last_fullsized":"2023-08-31T02:01:22.474460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155095+0000","last_change":"2023-08-31T02:01:20.477325+0000","last_active":"2023-08-31T02:01:23.155095+0000","last_peered":"2023-08-31T02:01:23.155095+0000","last_clean":"2023-08-31T02:01:23.155095+0000","last_became_active":"2023-08-31T02:01:20.476450+0000","last_became_peered":"2023-08-31T02:01:20.476450+0000","last_unstale":"2023-08-31T02:01:23.155095+0000","last_undegraded":"2023-08-31T02:01:23.155095+0000","last_fullsized":"2023-08-31T02:01:23.155095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480301+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:21.480301+0000","last_peered":"2023-08-31T02:01:21.480301+0000","last_clean":"2023-08-31T02:01:21.480301+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:21.480301+0000","last_undegraded":"2023-08-31T02:01:21.480301+0000","last_fullsized":"2023-08-31T02:01:21.480301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.74,"5min":11.74,"15min":11.74},"last":0.318}]},{"osd":4,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.436}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":11.707000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.659000000000001,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":11.628,"5min":11.628,"15min":11.628},"last":0.41399999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1069056,"data_stored":789651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":788003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.62}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.309},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.6799999999999997,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.71,"5min":5.71,"15min":5.71},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.621},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.8579999999999997,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.64900000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":199247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.308}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.372},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.45300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.495},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.627}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":198183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.8460000000000001,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:26.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-08-31T02:01:26.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T02:01:20.452593+0000', 'last_change': '2023-08-31T02:01:20.452593+0000', 'last_active': '2023-08-31T02:01:20.452593+0000', 'last_peered': '2023-08-31T02:01:20.452593+0000', 'last_clean': '2023-08-31T02:01:20.452593+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:20.452593+0000', 'last_undegraded': '2023-08-31T02:01:20.452593+0000', 'last_fullsized': '2023-08-31T02:01:20.452593+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T02:01:26.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-08-31T02:01:26.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T02:01:20.452593+0000', 'last_change': '2023-08-31T02:01:20.452593+0000', 'last_active': '2023-08-31T02:01:20.452593+0000', 'last_peered': '2023-08-31T02:01:20.452593+0000', 'last_clean': '2023-08-31T02:01:20.452593+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:20.452593+0000', 'last_undegraded': '2023-08-31T02:01:20.452593+0000', 'last_fullsized': '2023-08-31T02:01:20.452593+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T02:01:26.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-08-31T02:01:26.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T02:01:20.452593+0000', 'last_change': '2023-08-31T02:01:20.452593+0000', 'last_active': '2023-08-31T02:01:20.452593+0000', 'last_peered': '2023-08-31T02:01:20.452593+0000', 'last_clean': '2023-08-31T02:01:20.452593+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:20.452593+0000', 'last_undegraded': '2023-08-31T02:01:20.452593+0000', 'last_fullsized': '2023-08-31T02:01:20.452593+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T02:01:26.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-08-31T02:01:26.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T02:01:20.452593+0000', 'last_change': '2023-08-31T02:01:20.452593+0000', 'last_active': '2023-08-31T02:01:20.452593+0000', 'last_peered': '2023-08-31T02:01:20.452593+0000', 'last_clean': '2023-08-31T02:01:20.452593+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:20.452593+0000', 'last_undegraded': '2023-08-31T02:01:20.452593+0000', 'last_fullsized': '2023-08-31T02:01:20.452593+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T02:01:26.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-08-31T02:01:26.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T02:01:19.454626+0000', 'last_change': '2023-08-31T02:01:19.454626+0000', 'last_active': '2023-08-31T02:01:19.448346+0000', 'last_peered': '2023-08-31T02:01:19.448346+0000', 'last_clean': '2023-08-31T02:01:19.448346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:19.454626+0000', 'last_undegraded': '2023-08-31T02:01:19.454626+0000', 'last_fullsized': '2023-08-31T02:01:19.454626+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T02:01:26.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-08-31T02:01:26.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T02:01:19.454640+0000', 'last_change': '2023-08-31T02:01:19.454640+0000', 'last_active': '2023-08-31T02:01:19.448346+0000', 'last_peered': '2023-08-31T02:01:19.448346+0000', 'last_clean': '2023-08-31T02:01:19.448346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:19.454640+0000', 'last_undegraded': '2023-08-31T02:01:19.454640+0000', 'last_fullsized': '2023-08-31T02:01:19.454640+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T02:01:26.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-08-31T02:01:26.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T02:01:19.454580+0000', 'last_change': '2023-08-31T02:01:19.454580+0000', 'last_active': '2023-08-31T02:01:19.448346+0000', 'last_peered': '2023-08-31T02:01:19.448346+0000', 'last_clean': '2023-08-31T02:01:19.448346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:19.454580+0000', 'last_undegraded': '2023-08-31T02:01:19.454580+0000', 'last_fullsized': '2023-08-31T02:01:19.454580+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T02:01:26.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-08-31T02:01:26.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T02:01:19.454653+0000', 'last_change': '2023-08-31T02:01:19.454653+0000', 'last_active': '2023-08-31T02:01:19.448346+0000', 'last_peered': '2023-08-31T02:01:19.448346+0000', 'last_clean': '2023-08-31T02:01:19.448346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:19.454653+0000', 'last_undegraded': '2023-08-31T02:01:19.454653+0000', 'last_fullsized': '2023-08-31T02:01:19.454653+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:19.448346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T02:01:26.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-08-31T02:01:26.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T02:01:20.452593+0000', 'last_change': '2023-08-31T02:01:20.452593+0000', 'last_active': '2023-08-31T02:01:20.452593+0000', 'last_peered': '2023-08-31T02:01:20.452593+0000', 'last_clean': '2023-08-31T02:01:20.452593+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:20.452593+0000', 'last_undegraded': '2023-08-31T02:01:20.452593+0000', 'last_fullsized': '2023-08-31T02:01:20.452593+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T02:01:26.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-08-31T02:01:26.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T02:01:20.452593+0000', 'last_change': '2023-08-31T02:01:20.452593+0000', 'last_active': '2023-08-31T02:01:20.452593+0000', 'last_peered': '2023-08-31T02:01:20.452593+0000', 'last_clean': '2023-08-31T02:01:20.452593+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T02:01:20.452593+0000', 'last_undegraded': '2023-08-31T02:01:20.452593+0000', 'last_fullsized': '2023-08-31T02:01:20.452593+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'last_clean_scrub_stamp': '2023-08-31T02:01:20.452593+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T02:01:26.343 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-31T02:01:26.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.496+0000 7f95899b9700 1 -- 172.21.15.84:0/4221096035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 msgr2=0x7f9584070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.496+0000 7f95899b9700 1 --2- 172.21.15.84:0/4221096035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 0x7f9584070bf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f95840cb510 tx=0x7f957c00b380 comp rx=0 tx=0).stop 2023-08-31T02:01:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.496+0000 7f95899b9700 1 -- 172.21.15.84:0/4221096035 shutdown_connections 2023-08-31T02:01:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.496+0000 7f95899b9700 1 --2- 172.21.15.84:0/4221096035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 0x7f9584070bf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.497+0000 7f95899b9700 1 --2- 172.21.15.84:0/4221096035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9584158220 0x7f95840cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.497+0000 7f95899b9700 1 --2- 172.21.15.84:0/4221096035 >> v2:172.21.15.170:3300/0 conn(0x7f95840b0df0 0x7f95840c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.497+0000 7f95899b9700 1 -- 172.21.15.84:0/4221096035 >> 172.21.15.84:0/4221096035 conn(0x7f95840caa20 msgr2=0x7f95840cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:26.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.497+0000 7f95899b9700 1 -- 172.21.15.84:0/4221096035 shutdown_connections 2023-08-31T02:01:26.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.497+0000 7f95899b9700 1 -- 172.21.15.84:0/4221096035 wait complete. 2023-08-31T02:01:26.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.498+0000 7f95899b9700 1 Processor -- start 2023-08-31T02:01:26.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.498+0000 7f95899b9700 1 -- start start 2023-08-31T02:01:26.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95899b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 0x7f958414d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95899b9700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95840b0df0 0x7f95840aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95899b9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9584158220 0x7f95840aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95899b9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584157670 con 0x7f95840707c0 2023-08-31T02:01:26.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95899b9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840c6e40 con 0x7f9584158220 2023-08-31T02:01:26.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95899b9700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958414d840 con 0x7f95840b0df0 2023-08-31T02:01:26.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 0x7f958414d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 0x7f958414d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53982/0 (socket says 172.21.15.84:53982) 2023-08-31T02:01:26.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 -- 172.21.15.84:0/2739193330 learned_addr learned my addr 172.21.15.84:0/2739193330 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:26.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95827fc700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95840b0df0 0x7f95840aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 -- 172.21.15.84:0/2739193330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95840b0df0 msgr2=0x7f95840aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95840b0df0 0x7f95840aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 -- 172.21.15.84:0/2739193330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9584158220 msgr2=0x7f95840aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95837fe700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9584158220 0x7f95840aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9584158220 0x7f95840aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 -- 172.21.15.84:0/2739193330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009d00 con 0x7f95840707c0 2023-08-31T02:01:26.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f9582ffd700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 0x7f958414d300 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f957400d950 tx=0x7f957400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:26.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f956bfff700 1 -- 172.21.15.84:0/2739193330 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574009930 con 0x7f95840707c0 2023-08-31T02:01:26.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f956bfff700 1 -- 172.21.15.84:0/2739193330 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9574009b80 con 0x7f95840707c0 2023-08-31T02:01:26.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95840c5da0 con 0x7f95840707c0 2023-08-31T02:01:26.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f956bfff700 1 -- 172.21.15.84:0/2739193330 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574010460 con 0x7f95840707c0 2023-08-31T02:01:26.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.499+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95840c6360 con 0x7f95840707c0 2023-08-31T02:01:26.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.500+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958404e7c0 con 0x7f95840707c0 2023-08-31T02:01:26.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.501+0000 7f956bfff700 1 -- 172.21.15.84:0/2739193330 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f95740105c0 con 0x7f95840707c0 2023-08-31T02:01:26.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.501+0000 7f956bfff700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f957006a0e0 0x7f957006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.501+0000 7f95827fc700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f957006a0e0 0x7f957006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.501+0000 7f956bfff700 1 -- 172.21.15.84:0/2739193330 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f95740888e0 con 0x7f95840707c0 2023-08-31T02:01:26.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.502+0000 7f95827fc700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f957006a0e0 0x7f957006c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9578005fd0 tx=0x7f9578005f60 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:26.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.506+0000 7f956bfff700 1 -- 172.21.15.84:0/2739193330 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9574057a80 con 0x7f95840707c0 2023-08-31T02:01:26.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.777+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f958415b570 con 0x7f95840707c0 2023-08-31T02:01:26.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.778+0000 7f956bfff700 1 -- 172.21.15.84:0/2739193330 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1174 (secure 0 0 0) 0x7f95740174b0 con 0x7f95840707c0 2023-08-31T02:01:26.771 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:26.771 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":114,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1693447184,"num_in_osds":8,"osd_in_since":1693447175,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"unknown","count":6},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":226234368,"bytes_avail":772867878912,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":2553,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5583}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-31T02:01:03.063881+0000","services":{}},"progress_events":{}} 2023-08-31T02:01:26.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f957006a0e0 msgr2=0x7f957006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f957006a0e0 0x7f957006c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9578005fd0 tx=0x7f9578005f60 comp rx=0 tx=0).stop 2023-08-31T02:01:26.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 msgr2=0x7f958414d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 0x7f958414d300 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f957400d950 tx=0x7f957400dd10 comp rx=0 tx=0).stop 2023-08-31T02:01:26.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 shutdown_connections 2023-08-31T02:01:26.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f957006a0e0 0x7f957006c5a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9584158220 0x7f95840aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95840707c0 0x7f958414d300 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 --2- 172.21.15.84:0/2739193330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95840b0df0 0x7f95840aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 >> 172.21.15.84:0/2739193330 conn(0x7f95840caa20 msgr2=0x7f958415a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:26.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 shutdown_connections 2023-08-31T02:01:26.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.780+0000 7f95899b9700 1 -- 172.21.15.84:0/2739193330 wait complete. 2023-08-31T02:01:26.785 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-31T02:01:26.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:26.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.915+0000 7f556bcd2700 1 -- 172.21.15.84:0/3508089609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55640b12c0 msgr2=0x7f556415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.915+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3508089609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55640b12c0 0x7f556415da00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f55600098c0 tx=0x7f5560009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.915+0000 7f556bcd2700 1 -- 172.21.15.84:0/3508089609 shutdown_connections 2023-08-31T02:01:26.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.915+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3508089609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55640ce570 0x7f5564159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.915+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3508089609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55640b12c0 0x7f556415da00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.915+0000 7f556bcd2700 1 -- 172.21.15.84:0/3508089609 >> 172.21.15.84:0/3508089609 conn(0x7f556406fca0 msgr2=0x7f55640cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:26.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.915+0000 7f556bcd2700 1 -- 172.21.15.84:0/3508089609 shutdown_connections 2023-08-31T02:01:26.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.915+0000 7f556bcd2700 1 -- 172.21.15.84:0/3508089609 wait complete. 2023-08-31T02:01:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.916+0000 7f556bcd2700 1 Processor -- start 2023-08-31T02:01:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.916+0000 7f556bcd2700 1 -- start start 2023-08-31T02:01:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f556bcd2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55640af3d0 0x7f55640c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f556bcd2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55640b12c0 0x7f55640c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f556bcd2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55640ce570 0x7f556406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f556bcd2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55640c9110 con 0x7f55640af3d0 2023-08-31T02:01:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f556bcd2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556414b660 con 0x7f55640b12c0 2023-08-31T02:01:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f556bcd2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556414b940 con 0x7f55640ce570 2023-08-31T02:01:26.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f5569a6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55640af3d0 0x7f55640c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f5569a6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55640af3d0 0x7f55640c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53996/0 (socket says 172.21.15.84:53996) 2023-08-31T02:01:26.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f5569a6e700 1 -- 172.21.15.84:0/3836012446 learned_addr learned my addr 172.21.15.84:0/3836012446 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:26.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f556a26f700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55640ce570 0x7f556406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.917+0000 7f556926d700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55640b12c0 0x7f55640c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f5569a6e700 1 -- 172.21.15.84:0/3836012446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55640ce570 msgr2=0x7f556406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f5569a6e700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55640ce570 0x7f556406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f5569a6e700 1 -- 172.21.15.84:0/3836012446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55640b12c0 msgr2=0x7f55640c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:26.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f5569a6e700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55640b12c0 0x7f55640c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:26.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f5569a6e700 1 -- 172.21.15.84:0/3836012446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5560009520 con 0x7f55640af3d0 2023-08-31T02:01:26.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f5569a6e700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55640af3d0 0x7f55640c6200 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f555400c410 tx=0x7f555400c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:26.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f555a7fc700 1 -- 172.21.15.84:0/3836012446 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554004230 con 0x7f55640af3d0 2023-08-31T02:01:26.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f555a7fc700 1 -- 172.21.15.84:0/3836012446 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f55540044a0 con 0x7f55640af3d0 2023-08-31T02:01:26.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556414bc20 con 0x7f55640af3d0 2023-08-31T02:01:26.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f555a7fc700 1 -- 172.21.15.84:0/3836012446 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55540038e0 con 0x7f55640af3d0 2023-08-31T02:01:26.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.918+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55640b3910 con 0x7f55640af3d0 2023-08-31T02:01:26.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.919+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55640b3490 con 0x7f55640af3d0 2023-08-31T02:01:26.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.920+0000 7f555a7fc700 1 -- 172.21.15.84:0/3836012446 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5554003a40 con 0x7f55640af3d0 2023-08-31T02:01:26.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.921+0000 7f555a7fc700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f554806a0e0 0x7f554806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:26.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.921+0000 7f555a7fc700 1 -- 172.21.15.84:0/3836012446 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5554087b00 con 0x7f55640af3d0 2023-08-31T02:01:26.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.921+0000 7f556926d700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f554806a0e0 0x7f554806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:26.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.921+0000 7f556926d700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f554806a0e0 0x7f554806c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5560000c00 tx=0x7f55600047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:26.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:26.924+0000 7f555a7fc700 1 -- 172.21.15.84:0/3836012446 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f55540532d0 con 0x7f55640af3d0 2023-08-31T02:01:27.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.110+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55640aeb80 con 0x7f554806a0e0 2023-08-31T02:01:27.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.117+0000 7f555a7fc700 1 -- 172.21.15.84:0/3836012446 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289481 (secure 0 0 0) 0x7f556000bd20 con 0x7f554806a0e0 2023-08-31T02:01:27.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:27.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f554806a0e0 msgr2=0x7f554806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f554806a0e0 0x7f554806c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5560000c00 tx=0x7f55600047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55640af3d0 msgr2=0x7f55640c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55640af3d0 0x7f55640c6200 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f555400c410 tx=0x7f555400c720 comp rx=0 tx=0).stop 2023-08-31T02:01:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 shutdown_connections 2023-08-31T02:01:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f554806a0e0 0x7f554806c5a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55640ce570 0x7f556406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55640af3d0 0x7f55640c6200 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 --2- 172.21.15.84:0/3836012446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55640b12c0 0x7f55640c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 >> 172.21.15.84:0/3836012446 conn(0x7f556406fca0 msgr2=0x7f556406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 shutdown_connections 2023-08-31T02:01:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:27.120+0000 7f556bcd2700 1 -- 172.21.15.84:0/3836012446 wait complete. 2023-08-31T02:01:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:27.125 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-08-31T02:01:27.068413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220972,"kb_used_data":4796,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753748,"statfs":{"total":773094113280,"available":772867837952,"internally_reserved":0,"allocated":4911104,"data_stored":2759744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.613012"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472865+0000","last_change":"2023-08-31T02:01:21.483607+0000","last_active":"2023-08-31T02:01:22.472865+0000","last_peered":"2023-08-31T02:01:22.472865+0000","last_clean":"2023-08-31T02:01:22.472865+0000","last_became_active":"2023-08-31T02:01:21.483386+0000","last_became_peered":"2023-08-31T02:01:21.483386+0000","last_unstale":"2023-08-31T02:01:22.472865+0000","last_undegraded":"2023-08-31T02:01:22.472865+0000","last_fullsized":"2023-08-31T02:01:22.472865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472940+0000","last_change":"2023-08-31T02:01:21.479696+0000","last_active":"2023-08-31T02:01:22.472940+0000","last_peered":"2023-08-31T02:01:22.472940+0000","last_clean":"2023-08-31T02:01:22.472940+0000","last_became_active":"2023-08-31T02:01:21.479422+0000","last_became_peered":"2023-08-31T02:01:21.479422+0000","last_unstale":"2023-08-31T02:01:22.472940+0000","last_undegraded":"2023-08-31T02:01:22.472940+0000","last_fullsized":"2023-08-31T02:01:22.472940+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154224+0000","last_change":"2023-08-31T02:01:21.487277+0000","last_active":"2023-08-31T02:01:23.154224+0000","last_peered":"2023-08-31T02:01:23.154224+0000","last_clean":"2023-08-31T02:01:23.154224+0000","last_became_active":"2023-08-31T02:01:21.486976+0000","last_became_peered":"2023-08-31T02:01:21.486976+0000","last_unstale":"2023-08-31T02:01:23.154224+0000","last_undegraded":"2023-08-31T02:01:23.154224+0000","last_fullsized":"2023-08-31T02:01:23.154224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154614+0000","last_change":"2023-08-31T02:01:21.494288+0000","last_active":"2023-08-31T02:01:23.154614+0000","last_peered":"2023-08-31T02:01:23.154614+0000","last_clean":"2023-08-31T02:01:23.154614+0000","last_became_active":"2023-08-31T02:01:21.493886+0000","last_became_peered":"2023-08-31T02:01:21.493886+0000","last_unstale":"2023-08-31T02:01:23.154614+0000","last_undegraded":"2023-08-31T02:01:23.154614+0000","last_fullsized":"2023-08-31T02:01:23.154614+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:40:06.925751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154293+0000","last_change":"2023-08-31T02:01:21.490804+0000","last_active":"2023-08-31T02:01:23.154293+0000","last_peered":"2023-08-31T02:01:23.154293+0000","last_clean":"2023-08-31T02:01:23.154293+0000","last_became_active":"2023-08-31T02:01:21.490531+0000","last_became_peered":"2023-08-31T02:01:21.490531+0000","last_unstale":"2023-08-31T02:01:23.154293+0000","last_undegraded":"2023-08-31T02:01:23.154293+0000","last_fullsized":"2023-08-31T02:01:23.154293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:16:12.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154799+0000","last_change":"2023-08-31T02:01:21.493828+0000","last_active":"2023-08-31T02:01:23.154799+0000","last_peered":"2023-08-31T02:01:23.154799+0000","last_clean":"2023-08-31T02:01:23.154799+0000","last_became_active":"2023-08-31T02:01:21.493553+0000","last_became_peered":"2023-08-31T02:01:21.493553+0000","last_unstale":"2023-08-31T02:01:23.154799+0000","last_undegraded":"2023-08-31T02:01:23.154799+0000","last_fullsized":"2023-08-31T02:01:23.154799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474162+0000","last_change":"2023-08-31T02:01:21.477335+0000","last_active":"2023-08-31T02:01:22.474162+0000","last_peered":"2023-08-31T02:01:22.474162+0000","last_clean":"2023-08-31T02:01:22.474162+0000","last_became_active":"2023-08-31T02:01:21.476978+0000","last_became_peered":"2023-08-31T02:01:21.476978+0000","last_unstale":"2023-08-31T02:01:22.474162+0000","last_undegraded":"2023-08-31T02:01:22.474162+0000","last_fullsized":"2023-08-31T02:01:22.474162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472523+0000","last_change":"2023-08-31T02:01:21.479618+0000","last_active":"2023-08-31T02:01:22.472523+0000","last_peered":"2023-08-31T02:01:22.472523+0000","last_clean":"2023-08-31T02:01:22.472523+0000","last_became_active":"2023-08-31T02:01:21.479344+0000","last_became_peered":"2023-08-31T02:01:21.479344+0000","last_unstale":"2023-08-31T02:01:22.472523+0000","last_undegraded":"2023-08-31T02:01:22.472523+0000","last_fullsized":"2023-08-31T02:01:22.472523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154346+0000","last_change":"2023-08-31T02:01:21.487087+0000","last_active":"2023-08-31T02:01:23.154346+0000","last_peered":"2023-08-31T02:01:23.154346+0000","last_clean":"2023-08-31T02:01:23.154346+0000","last_became_active":"2023-08-31T02:01:21.486783+0000","last_became_peered":"2023-08-31T02:01:21.486783+0000","last_unstale":"2023-08-31T02:01:23.154346+0000","last_undegraded":"2023-08-31T02:01:23.154346+0000","last_fullsized":"2023-08-31T02:01:23.154346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474348+0000","last_change":"2023-08-31T02:01:21.485931+0000","last_active":"2023-08-31T02:01:22.474348+0000","last_peered":"2023-08-31T02:01:22.474348+0000","last_clean":"2023-08-31T02:01:22.474348+0000","last_became_active":"2023-08-31T02:01:21.485666+0000","last_became_peered":"2023-08-31T02:01:21.485666+0000","last_unstale":"2023-08-31T02:01:22.474348+0000","last_undegraded":"2023-08-31T02:01:22.474348+0000","last_fullsized":"2023-08-31T02:01:22.474348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474466+0000","last_change":"2023-08-31T02:01:21.481313+0000","last_active":"2023-08-31T02:01:22.474466+0000","last_peered":"2023-08-31T02:01:22.474466+0000","last_clean":"2023-08-31T02:01:22.474466+0000","last_became_active":"2023-08-31T02:01:21.481052+0000","last_became_peered":"2023-08-31T02:01:21.481052+0000","last_unstale":"2023-08-31T02:01:22.474466+0000","last_undegraded":"2023-08-31T02:01:22.474466+0000","last_fullsized":"2023-08-31T02:01:22.474466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154140+0000","last_change":"2023-08-31T02:01:21.487451+0000","last_active":"2023-08-31T02:01:23.154140+0000","last_peered":"2023-08-31T02:01:23.154140+0000","last_clean":"2023-08-31T02:01:23.154140+0000","last_became_active":"2023-08-31T02:01:21.486899+0000","last_became_peered":"2023-08-31T02:01:21.486899+0000","last_unstale":"2023-08-31T02:01:23.154140+0000","last_undegraded":"2023-08-31T02:01:23.154140+0000","last_fullsized":"2023-08-31T02:01:23.154140+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474198+0000","last_change":"2023-08-31T02:01:21.490530+0000","last_active":"2023-08-31T02:01:22.474198+0000","last_peered":"2023-08-31T02:01:22.474198+0000","last_clean":"2023-08-31T02:01:22.474198+0000","last_became_active":"2023-08-31T02:01:21.490216+0000","last_became_peered":"2023-08-31T02:01:21.490216+0000","last_unstale":"2023-08-31T02:01:22.474198+0000","last_undegraded":"2023-08-31T02:01:22.474198+0000","last_fullsized":"2023-08-31T02:01:22.474198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473438+0000","last_change":"2023-08-31T02:01:21.486405+0000","last_active":"2023-08-31T02:01:22.473438+0000","last_peered":"2023-08-31T02:01:22.473438+0000","last_clean":"2023-08-31T02:01:22.473438+0000","last_became_active":"2023-08-31T02:01:21.485996+0000","last_became_peered":"2023-08-31T02:01:21.485996+0000","last_unstale":"2023-08-31T02:01:22.473438+0000","last_undegraded":"2023-08-31T02:01:22.473438+0000","last_fullsized":"2023-08-31T02:01:22.473438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473444+0000","last_change":"2023-08-31T02:01:21.485585+0000","last_active":"2023-08-31T02:01:22.473444+0000","last_peered":"2023-08-31T02:01:22.473444+0000","last_clean":"2023-08-31T02:01:22.473444+0000","last_became_active":"2023-08-31T02:01:21.484565+0000","last_became_peered":"2023-08-31T02:01:21.484565+0000","last_unstale":"2023-08-31T02:01:22.473444+0000","last_undegraded":"2023-08-31T02:01:22.473444+0000","last_fullsized":"2023-08-31T02:01:22.473444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:22:22.347703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154531+0000","last_change":"2023-08-31T02:01:21.486621+0000","last_active":"2023-08-31T02:01:23.154531+0000","last_peered":"2023-08-31T02:01:23.154531+0000","last_clean":"2023-08-31T02:01:23.154531+0000","last_became_active":"2023-08-31T02:01:21.486282+0000","last_became_peered":"2023-08-31T02:01:21.486282+0000","last_unstale":"2023-08-31T02:01:23.154531+0000","last_undegraded":"2023-08-31T02:01:23.154531+0000","last_fullsized":"2023-08-31T02:01:23.154531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155145+0000","last_change":"2023-08-31T02:01:21.490357+0000","last_active":"2023-08-31T02:01:23.155145+0000","last_peered":"2023-08-31T02:01:23.155145+0000","last_clean":"2023-08-31T02:01:23.155145+0000","last_became_active":"2023-08-31T02:01:21.487866+0000","last_became_peered":"2023-08-31T02:01:21.487866+0000","last_unstale":"2023-08-31T02:01:23.155145+0000","last_undegraded":"2023-08-31T02:01:23.155145+0000","last_fullsized":"2023-08-31T02:01:23.155145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154508+0000","last_change":"2023-08-31T02:01:21.495399+0000","last_active":"2023-08-31T02:01:23.154508+0000","last_peered":"2023-08-31T02:01:23.154508+0000","last_clean":"2023-08-31T02:01:23.154508+0000","last_became_active":"2023-08-31T02:01:21.495110+0000","last_became_peered":"2023-08-31T02:01:21.495110+0000","last_unstale":"2023-08-31T02:01:23.154508+0000","last_undegraded":"2023-08-31T02:01:23.154508+0000","last_fullsized":"2023-08-31T02:01:23.154508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:17.307517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154441+0000","last_change":"2023-08-31T02:01:21.488517+0000","last_active":"2023-08-31T02:01:23.154441+0000","last_peered":"2023-08-31T02:01:23.154441+0000","last_clean":"2023-08-31T02:01:23.154441+0000","last_became_active":"2023-08-31T02:01:21.488239+0000","last_became_peered":"2023-08-31T02:01:21.488239+0000","last_unstale":"2023-08-31T02:01:23.154441+0000","last_undegraded":"2023-08-31T02:01:23.154441+0000","last_fullsized":"2023-08-31T02:01:23.154441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:33.898751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154306+0000","last_change":"2023-08-31T02:01:21.490976+0000","last_active":"2023-08-31T02:01:23.154306+0000","last_peered":"2023-08-31T02:01:23.154306+0000","last_clean":"2023-08-31T02:01:23.154306+0000","last_became_active":"2023-08-31T02:01:21.490707+0000","last_became_peered":"2023-08-31T02:01:21.490707+0000","last_unstale":"2023-08-31T02:01:23.154306+0000","last_undegraded":"2023-08-31T02:01:23.154306+0000","last_fullsized":"2023-08-31T02:01:23.154306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:21:01.584279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474281+0000","last_change":"2023-08-31T02:01:21.487315+0000","last_active":"2023-08-31T02:01:22.474281+0000","last_peered":"2023-08-31T02:01:22.474281+0000","last_clean":"2023-08-31T02:01:22.474281+0000","last_became_active":"2023-08-31T02:01:21.487028+0000","last_became_peered":"2023-08-31T02:01:21.487028+0000","last_unstale":"2023-08-31T02:01:22.474281+0000","last_undegraded":"2023-08-31T02:01:22.474281+0000","last_fullsized":"2023-08-31T02:01:22.474281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473190+0000","last_change":"2023-08-31T02:01:21.486242+0000","last_active":"2023-08-31T02:01:22.473190+0000","last_peered":"2023-08-31T02:01:22.473190+0000","last_clean":"2023-08-31T02:01:22.473190+0000","last_became_active":"2023-08-31T02:01:21.485620+0000","last_became_peered":"2023-08-31T02:01:21.485620+0000","last_unstale":"2023-08-31T02:01:22.473190+0000","last_undegraded":"2023-08-31T02:01:22.473190+0000","last_fullsized":"2023-08-31T02:01:22.473190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154800+0000","last_change":"2023-08-31T02:01:21.495072+0000","last_active":"2023-08-31T02:01:23.154800+0000","last_peered":"2023-08-31T02:01:23.154800+0000","last_clean":"2023-08-31T02:01:23.154800+0000","last_became_active":"2023-08-31T02:01:21.494263+0000","last_became_peered":"2023-08-31T02:01:21.494263+0000","last_unstale":"2023-08-31T02:01:23.154800+0000","last_undegraded":"2023-08-31T02:01:23.154800+0000","last_fullsized":"2023-08-31T02:01:23.154800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153910+0000","last_change":"2023-08-31T02:01:21.494001+0000","last_active":"2023-08-31T02:01:23.153910+0000","last_peered":"2023-08-31T02:01:23.153910+0000","last_clean":"2023-08-31T02:01:23.153910+0000","last_became_active":"2023-08-31T02:01:21.493742+0000","last_became_peered":"2023-08-31T02:01:21.493742+0000","last_unstale":"2023-08-31T02:01:23.153910+0000","last_undegraded":"2023-08-31T02:01:23.153910+0000","last_fullsized":"2023-08-31T02:01:23.153910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:53:45.076676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154521+0000","last_change":"2023-08-31T02:01:21.491466+0000","last_active":"2023-08-31T02:01:23.154521+0000","last_peered":"2023-08-31T02:01:23.154521+0000","last_clean":"2023-08-31T02:01:23.154521+0000","last_became_active":"2023-08-31T02:01:21.488906+0000","last_became_peered":"2023-08-31T02:01:21.488906+0000","last_unstale":"2023-08-31T02:01:23.154521+0000","last_undegraded":"2023-08-31T02:01:23.154521+0000","last_fullsized":"2023-08-31T02:01:23.154521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:53.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154713+0000","last_change":"2023-08-31T02:01:21.486091+0000","last_active":"2023-08-31T02:01:23.154713+0000","last_peered":"2023-08-31T02:01:23.154713+0000","last_clean":"2023-08-31T02:01:23.154713+0000","last_became_active":"2023-08-31T02:01:21.485760+0000","last_became_peered":"2023-08-31T02:01:21.485760+0000","last_unstale":"2023-08-31T02:01:23.154713+0000","last_undegraded":"2023-08-31T02:01:23.154713+0000","last_fullsized":"2023-08-31T02:01:23.154713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154435+0000","last_change":"2023-08-31T02:01:21.495374+0000","last_active":"2023-08-31T02:01:23.154435+0000","last_peered":"2023-08-31T02:01:23.154435+0000","last_clean":"2023-08-31T02:01:23.154435+0000","last_became_active":"2023-08-31T02:01:21.494511+0000","last_became_peered":"2023-08-31T02:01:21.494511+0000","last_unstale":"2023-08-31T02:01:23.154435+0000","last_undegraded":"2023-08-31T02:01:23.154435+0000","last_fullsized":"2023-08-31T02:01:23.154435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:37.313340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474483+0000","last_change":"2023-08-31T02:01:21.486431+0000","last_active":"2023-08-31T02:01:22.474483+0000","last_peered":"2023-08-31T02:01:22.474483+0000","last_clean":"2023-08-31T02:01:22.474483+0000","last_became_active":"2023-08-31T02:01:21.486138+0000","last_became_peered":"2023-08-31T02:01:21.486138+0000","last_unstale":"2023-08-31T02:01:22.474483+0000","last_undegraded":"2023-08-31T02:01:22.474483+0000","last_fullsized":"2023-08-31T02:01:22.474483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154708+0000","last_change":"2023-08-31T02:01:21.492203+0000","last_active":"2023-08-31T02:01:23.154708+0000","last_peered":"2023-08-31T02:01:23.154708+0000","last_clean":"2023-08-31T02:01:23.154708+0000","last_became_active":"2023-08-31T02:01:21.491853+0000","last_became_peered":"2023-08-31T02:01:21.491853+0000","last_unstale":"2023-08-31T02:01:23.154708+0000","last_undegraded":"2023-08-31T02:01:23.154708+0000","last_fullsized":"2023-08-31T02:01:23.154708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:12.582057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155112+0000","last_change":"2023-08-31T02:01:21.489782+0000","last_active":"2023-08-31T02:01:23.155112+0000","last_peered":"2023-08-31T02:01:23.155112+0000","last_clean":"2023-08-31T02:01:23.155112+0000","last_became_active":"2023-08-31T02:01:21.489511+0000","last_became_peered":"2023-08-31T02:01:21.489511+0000","last_unstale":"2023-08-31T02:01:23.155112+0000","last_undegraded":"2023-08-31T02:01:23.155112+0000","last_fullsized":"2023-08-31T02:01:23.155112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:29.822747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154808+0000","last_change":"2023-08-31T02:01:21.494310+0000","last_active":"2023-08-31T02:01:23.154808+0000","last_peered":"2023-08-31T02:01:23.154808+0000","last_clean":"2023-08-31T02:01:23.154808+0000","last_became_active":"2023-08-31T02:01:21.493693+0000","last_became_peered":"2023-08-31T02:01:21.493693+0000","last_unstale":"2023-08-31T02:01:23.154808+0000","last_undegraded":"2023-08-31T02:01:23.154808+0000","last_fullsized":"2023-08-31T02:01:23.154808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154984+0000","last_change":"2023-08-31T02:01:21.490055+0000","last_active":"2023-08-31T02:01:23.154984+0000","last_peered":"2023-08-31T02:01:23.154984+0000","last_clean":"2023-08-31T02:01:23.154984+0000","last_became_active":"2023-08-31T02:01:21.489759+0000","last_became_peered":"2023-08-31T02:01:21.489759+0000","last_unstale":"2023-08-31T02:01:23.154984+0000","last_undegraded":"2023-08-31T02:01:23.154984+0000","last_fullsized":"2023-08-31T02:01:23.154984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154938+0000","last_change":"2023-08-31T02:01:21.488296+0000","last_active":"2023-08-31T02:01:23.154938+0000","last_peered":"2023-08-31T02:01:23.154938+0000","last_clean":"2023-08-31T02:01:23.154938+0000","last_became_active":"2023-08-31T02:01:21.487819+0000","last_became_peered":"2023-08-31T02:01:21.487819+0000","last_unstale":"2023-08-31T02:01:23.154938+0000","last_undegraded":"2023-08-31T02:01:23.154938+0000","last_fullsized":"2023-08-31T02:01:23.154938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:25:18.019269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154497+0000","last_change":"2023-08-31T02:01:20.465896+0000","last_active":"2023-08-31T02:01:23.154497+0000","last_peered":"2023-08-31T02:01:23.154497+0000","last_clean":"2023-08-31T02:01:23.154497+0000","last_became_active":"2023-08-31T02:01:20.465615+0000","last_became_peered":"2023-08-31T02:01:20.465615+0000","last_unstale":"2023-08-31T02:01:23.154497+0000","last_undegraded":"2023-08-31T02:01:23.154497+0000","last_fullsized":"2023-08-31T02:01:23.154497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154718+0000","last_change":"2023-08-31T02:01:21.484891+0000","last_active":"2023-08-31T02:01:23.154718+0000","last_peered":"2023-08-31T02:01:23.154718+0000","last_clean":"2023-08-31T02:01:23.154718+0000","last_became_active":"2023-08-31T02:01:21.484626+0000","last_became_peered":"2023-08-31T02:01:21.484626+0000","last_unstale":"2023-08-31T02:01:23.154718+0000","last_undegraded":"2023-08-31T02:01:23.154718+0000","last_fullsized":"2023-08-31T02:01:23.154718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154252+0000","last_change":"2023-08-31T02:01:20.473610+0000","last_active":"2023-08-31T02:01:23.154252+0000","last_peered":"2023-08-31T02:01:23.154252+0000","last_clean":"2023-08-31T02:01:23.154252+0000","last_became_active":"2023-08-31T02:01:20.473370+0000","last_became_peered":"2023-08-31T02:01:20.473370+0000","last_unstale":"2023-08-31T02:01:23.154252+0000","last_undegraded":"2023-08-31T02:01:23.154252+0000","last_fullsized":"2023-08-31T02:01:23.154252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473534+0000","last_change":"2023-08-31T02:01:21.489900+0000","last_active":"2023-08-31T02:01:22.473534+0000","last_peered":"2023-08-31T02:01:22.473534+0000","last_clean":"2023-08-31T02:01:22.473534+0000","last_became_active":"2023-08-31T02:01:21.489618+0000","last_became_peered":"2023-08-31T02:01:21.489618+0000","last_unstale":"2023-08-31T02:01:22.473534+0000","last_undegraded":"2023-08-31T02:01:22.473534+0000","last_fullsized":"2023-08-31T02:01:22.473534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.505391+0000","last_change":"2023-08-31T02:01:20.471317+0000","last_active":"2023-08-31T02:01:21.505391+0000","last_peered":"2023-08-31T02:01:21.505391+0000","last_clean":"2023-08-31T02:01:21.505391+0000","last_became_active":"2023-08-31T02:01:20.471011+0000","last_became_peered":"2023-08-31T02:01:20.471011+0000","last_unstale":"2023-08-31T02:01:21.505391+0000","last_undegraded":"2023-08-31T02:01:21.505391+0000","last_fullsized":"2023-08-31T02:01:21.505391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:21:00.580032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473009+0000","last_change":"2023-08-31T02:01:21.494971+0000","last_active":"2023-08-31T02:01:22.473009+0000","last_peered":"2023-08-31T02:01:22.473009+0000","last_clean":"2023-08-31T02:01:22.473009+0000","last_became_active":"2023-08-31T02:01:21.494720+0000","last_became_peered":"2023-08-31T02:01:21.494720+0000","last_unstale":"2023-08-31T02:01:22.473009+0000","last_undegraded":"2023-08-31T02:01:22.473009+0000","last_fullsized":"2023-08-31T02:01:22.473009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473465+0000","last_change":"2023-08-31T02:01:20.473405+0000","last_active":"2023-08-31T02:01:22.473465+0000","last_peered":"2023-08-31T02:01:22.473465+0000","last_clean":"2023-08-31T02:01:22.473465+0000","last_became_active":"2023-08-31T02:01:20.473136+0000","last_became_peered":"2023-08-31T02:01:20.473136+0000","last_unstale":"2023-08-31T02:01:22.473465+0000","last_undegraded":"2023-08-31T02:01:22.473465+0000","last_fullsized":"2023-08-31T02:01:22.473465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:52.204278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154011+0000","last_change":"2023-08-31T02:01:21.492984+0000","last_active":"2023-08-31T02:01:23.154011+0000","last_peered":"2023-08-31T02:01:23.154011+0000","last_clean":"2023-08-31T02:01:23.154011+0000","last_became_active":"2023-08-31T02:01:21.492715+0000","last_became_peered":"2023-08-31T02:01:21.492715+0000","last_unstale":"2023-08-31T02:01:23.154011+0000","last_undegraded":"2023-08-31T02:01:23.154011+0000","last_fullsized":"2023-08-31T02:01:23.154011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474381+0000","last_change":"2023-08-31T02:01:20.473298+0000","last_active":"2023-08-31T02:01:22.474381+0000","last_peered":"2023-08-31T02:01:22.474381+0000","last_clean":"2023-08-31T02:01:22.474381+0000","last_became_active":"2023-08-31T02:01:20.473015+0000","last_became_peered":"2023-08-31T02:01:20.473015+0000","last_unstale":"2023-08-31T02:01:22.474381+0000","last_undegraded":"2023-08-31T02:01:22.474381+0000","last_fullsized":"2023-08-31T02:01:22.474381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:30:14.876894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474030+0000","last_change":"2023-08-31T02:01:21.490644+0000","last_active":"2023-08-31T02:01:22.474030+0000","last_peered":"2023-08-31T02:01:22.474030+0000","last_clean":"2023-08-31T02:01:22.474030+0000","last_became_active":"2023-08-31T02:01:21.490332+0000","last_became_peered":"2023-08-31T02:01:21.490332+0000","last_unstale":"2023-08-31T02:01:22.474030+0000","last_undegraded":"2023-08-31T02:01:22.474030+0000","last_fullsized":"2023-08-31T02:01:22.474030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154648+0000","last_change":"2023-08-31T02:01:20.477111+0000","last_active":"2023-08-31T02:01:23.154648+0000","last_peered":"2023-08-31T02:01:23.154648+0000","last_clean":"2023-08-31T02:01:23.154648+0000","last_became_active":"2023-08-31T02:01:20.476863+0000","last_became_peered":"2023-08-31T02:01:20.476863+0000","last_unstale":"2023-08-31T02:01:23.154648+0000","last_undegraded":"2023-08-31T02:01:23.154648+0000","last_fullsized":"2023-08-31T02:01:23.154648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473095+0000","last_change":"2023-08-31T02:01:21.487297+0000","last_active":"2023-08-31T02:01:22.473095+0000","last_peered":"2023-08-31T02:01:22.473095+0000","last_clean":"2023-08-31T02:01:22.473095+0000","last_became_active":"2023-08-31T02:01:21.487044+0000","last_became_peered":"2023-08-31T02:01:21.487044+0000","last_unstale":"2023-08-31T02:01:22.473095+0000","last_undegraded":"2023-08-31T02:01:22.473095+0000","last_fullsized":"2023-08-31T02:01:22.473095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480555+0000","last_change":"2023-08-31T02:01:20.476124+0000","last_active":"2023-08-31T02:01:21.480555+0000","last_peered":"2023-08-31T02:01:21.480555+0000","last_clean":"2023-08-31T02:01:21.480555+0000","last_became_active":"2023-08-31T02:01:20.475839+0000","last_became_peered":"2023-08-31T02:01:20.475839+0000","last_unstale":"2023-08-31T02:01:21.480555+0000","last_undegraded":"2023-08-31T02:01:21.480555+0000","last_fullsized":"2023-08-31T02:01:21.480555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473036+0000","last_change":"2023-08-31T02:01:21.488464+0000","last_active":"2023-08-31T02:01:22.473036+0000","last_peered":"2023-08-31T02:01:22.473036+0000","last_clean":"2023-08-31T02:01:22.473036+0000","last_became_active":"2023-08-31T02:01:21.487547+0000","last_became_peered":"2023-08-31T02:01:21.487547+0000","last_unstale":"2023-08-31T02:01:22.473036+0000","last_undegraded":"2023-08-31T02:01:22.473036+0000","last_fullsized":"2023-08-31T02:01:22.473036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472884+0000","last_change":"2023-08-31T02:01:20.463335+0000","last_active":"2023-08-31T02:01:22.472884+0000","last_peered":"2023-08-31T02:01:22.472884+0000","last_clean":"2023-08-31T02:01:22.472884+0000","last_became_active":"2023-08-31T02:01:20.463073+0000","last_became_peered":"2023-08-31T02:01:20.463073+0000","last_unstale":"2023-08-31T02:01:22.472884+0000","last_undegraded":"2023-08-31T02:01:22.472884+0000","last_fullsized":"2023-08-31T02:01:22.472884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:35:51.541453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154755+0000","last_change":"2023-08-31T02:01:21.494127+0000","last_active":"2023-08-31T02:01:23.154755+0000","last_peered":"2023-08-31T02:01:23.154755+0000","last_clean":"2023-08-31T02:01:23.154755+0000","last_became_active":"2023-08-31T02:01:21.491465+0000","last_became_peered":"2023-08-31T02:01:21.491465+0000","last_unstale":"2023-08-31T02:01:23.154755+0000","last_undegraded":"2023-08-31T02:01:23.154755+0000","last_fullsized":"2023-08-31T02:01:23.154755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:36:48.080941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473047+0000","last_change":"2023-08-31T02:01:20.472411+0000","last_active":"2023-08-31T02:01:22.473047+0000","last_peered":"2023-08-31T02:01:22.473047+0000","last_clean":"2023-08-31T02:01:22.473047+0000","last_became_active":"2023-08-31T02:01:20.472124+0000","last_became_peered":"2023-08-31T02:01:20.472124+0000","last_unstale":"2023-08-31T02:01:22.473047+0000","last_undegraded":"2023-08-31T02:01:22.473047+0000","last_fullsized":"2023-08-31T02:01:22.473047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154748+0000","last_change":"2023-08-31T02:01:21.494040+0000","last_active":"2023-08-31T02:01:23.154748+0000","last_peered":"2023-08-31T02:01:23.154748+0000","last_clean":"2023-08-31T02:01:23.154748+0000","last_became_active":"2023-08-31T02:01:21.493350+0000","last_became_peered":"2023-08-31T02:01:21.493350+0000","last_unstale":"2023-08-31T02:01:23.154748+0000","last_undegraded":"2023-08-31T02:01:23.154748+0000","last_fullsized":"2023-08-31T02:01:23.154748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474606+0000","last_change":"2023-08-31T02:01:20.475643+0000","last_active":"2023-08-31T02:01:22.474606+0000","last_peered":"2023-08-31T02:01:22.474606+0000","last_clean":"2023-08-31T02:01:22.474606+0000","last_became_active":"2023-08-31T02:01:20.475359+0000","last_became_peered":"2023-08-31T02:01:20.475359+0000","last_unstale":"2023-08-31T02:01:22.474606+0000","last_undegraded":"2023-08-31T02:01:22.474606+0000","last_fullsized":"2023-08-31T02:01:22.474606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154159+0000","last_change":"2023-08-31T02:01:21.486994+0000","last_active":"2023-08-31T02:01:23.154159+0000","last_peered":"2023-08-31T02:01:23.154159+0000","last_clean":"2023-08-31T02:01:23.154159+0000","last_became_active":"2023-08-31T02:01:21.485891+0000","last_became_peered":"2023-08-31T02:01:21.485891+0000","last_unstale":"2023-08-31T02:01:23.154159+0000","last_undegraded":"2023-08-31T02:01:23.154159+0000","last_fullsized":"2023-08-31T02:01:23.154159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474693+0000","last_change":"2023-08-31T02:01:20.474688+0000","last_active":"2023-08-31T02:01:22.474693+0000","last_peered":"2023-08-31T02:01:22.474693+0000","last_clean":"2023-08-31T02:01:22.474693+0000","last_became_active":"2023-08-31T02:01:20.474417+0000","last_became_peered":"2023-08-31T02:01:20.474417+0000","last_unstale":"2023-08-31T02:01:22.474693+0000","last_undegraded":"2023-08-31T02:01:22.474693+0000","last_fullsized":"2023-08-31T02:01:22.474693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473576+0000","last_change":"2023-08-31T02:01:21.481153+0000","last_active":"2023-08-31T02:01:22.473576+0000","last_peered":"2023-08-31T02:01:22.473576+0000","last_clean":"2023-08-31T02:01:22.473576+0000","last_became_active":"2023-08-31T02:01:21.480678+0000","last_became_peered":"2023-08-31T02:01:21.480678+0000","last_unstale":"2023-08-31T02:01:22.473576+0000","last_undegraded":"2023-08-31T02:01:22.473576+0000","last_fullsized":"2023-08-31T02:01:22.473576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472919+0000","last_change":"2023-08-31T02:01:20.474897+0000","last_active":"2023-08-31T02:01:22.472919+0000","last_peered":"2023-08-31T02:01:22.472919+0000","last_clean":"2023-08-31T02:01:22.472919+0000","last_became_active":"2023-08-31T02:01:20.474227+0000","last_became_peered":"2023-08-31T02:01:20.474227+0000","last_unstale":"2023-08-31T02:01:22.472919+0000","last_undegraded":"2023-08-31T02:01:22.472919+0000","last_fullsized":"2023-08-31T02:01:22.472919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153851+0000","last_change":"2023-08-31T02:01:21.487392+0000","last_active":"2023-08-31T02:01:23.153851+0000","last_peered":"2023-08-31T02:01:23.153851+0000","last_clean":"2023-08-31T02:01:23.153851+0000","last_became_active":"2023-08-31T02:01:21.487162+0000","last_became_peered":"2023-08-31T02:01:21.487162+0000","last_unstale":"2023-08-31T02:01:23.153851+0000","last_undegraded":"2023-08-31T02:01:23.153851+0000","last_fullsized":"2023-08-31T02:01:23.153851+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472807+0000","last_change":"2023-08-31T02:01:20.480632+0000","last_active":"2023-08-31T02:01:22.472807+0000","last_peered":"2023-08-31T02:01:22.472807+0000","last_clean":"2023-08-31T02:01:22.472807+0000","last_became_active":"2023-08-31T02:01:20.480307+0000","last_became_peered":"2023-08-31T02:01:20.480307+0000","last_unstale":"2023-08-31T02:01:22.472807+0000","last_undegraded":"2023-08-31T02:01:22.472807+0000","last_fullsized":"2023-08-31T02:01:22.472807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:27:43.975042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472537+0000","last_change":"2023-08-31T02:01:21.492360+0000","last_active":"2023-08-31T02:01:22.472537+0000","last_peered":"2023-08-31T02:01:22.472537+0000","last_clean":"2023-08-31T02:01:22.472537+0000","last_became_active":"2023-08-31T02:01:21.492055+0000","last_became_peered":"2023-08-31T02:01:21.492055+0000","last_unstale":"2023-08-31T02:01:22.472537+0000","last_undegraded":"2023-08-31T02:01:22.472537+0000","last_fullsized":"2023-08-31T02:01:22.472537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.483785+0000","last_change":"2023-08-31T02:01:20.476024+0000","last_active":"2023-08-31T02:01:21.483785+0000","last_peered":"2023-08-31T02:01:21.483785+0000","last_clean":"2023-08-31T02:01:21.483785+0000","last_became_active":"2023-08-31T02:01:20.475698+0000","last_became_peered":"2023-08-31T02:01:20.475698+0000","last_unstale":"2023-08-31T02:01:21.483785+0000","last_undegraded":"2023-08-31T02:01:21.483785+0000","last_fullsized":"2023-08-31T02:01:21.483785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154659+0000","last_change":"2023-08-31T02:01:21.494582+0000","last_active":"2023-08-31T02:01:23.154659+0000","last_peered":"2023-08-31T02:01:23.154659+0000","last_clean":"2023-08-31T02:01:23.154659+0000","last_became_active":"2023-08-31T02:01:21.494273+0000","last_became_peered":"2023-08-31T02:01:21.494273+0000","last_unstale":"2023-08-31T02:01:23.154659+0000","last_undegraded":"2023-08-31T02:01:23.154659+0000","last_fullsized":"2023-08-31T02:01:23.154659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154231+0000","last_change":"2023-08-31T02:01:20.466640+0000","last_active":"2023-08-31T02:01:23.154231+0000","last_peered":"2023-08-31T02:01:23.154231+0000","last_clean":"2023-08-31T02:01:23.154231+0000","last_became_active":"2023-08-31T02:01:20.466315+0000","last_became_peered":"2023-08-31T02:01:20.466315+0000","last_unstale":"2023-08-31T02:01:23.154231+0000","last_undegraded":"2023-08-31T02:01:23.154231+0000","last_fullsized":"2023-08-31T02:01:23.154231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472600+0000","last_change":"2023-08-31T02:01:21.488792+0000","last_active":"2023-08-31T02:01:22.472600+0000","last_peered":"2023-08-31T02:01:22.472600+0000","last_clean":"2023-08-31T02:01:22.472600+0000","last_became_active":"2023-08-31T02:01:21.488218+0000","last_became_peered":"2023-08-31T02:01:21.488218+0000","last_unstale":"2023-08-31T02:01:22.472600+0000","last_undegraded":"2023-08-31T02:01:22.472600+0000","last_fullsized":"2023-08-31T02:01:22.472600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155040+0000","last_change":"2023-08-31T02:01:20.476965+0000","last_active":"2023-08-31T02:01:23.155040+0000","last_peered":"2023-08-31T02:01:23.155040+0000","last_clean":"2023-08-31T02:01:23.155040+0000","last_became_active":"2023-08-31T02:01:20.476698+0000","last_became_peered":"2023-08-31T02:01:20.476698+0000","last_unstale":"2023-08-31T02:01:23.155040+0000","last_undegraded":"2023-08-31T02:01:23.155040+0000","last_fullsized":"2023-08-31T02:01:23.155040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472783+0000","last_change":"2023-08-31T02:01:21.493915+0000","last_active":"2023-08-31T02:01:22.472783+0000","last_peered":"2023-08-31T02:01:22.472783+0000","last_clean":"2023-08-31T02:01:22.472783+0000","last_became_active":"2023-08-31T02:01:21.493676+0000","last_became_peered":"2023-08-31T02:01:21.493676+0000","last_unstale":"2023-08-31T02:01:22.472783+0000","last_undegraded":"2023-08-31T02:01:22.472783+0000","last_fullsized":"2023-08-31T02:01:22.472783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474583+0000","last_change":"2023-08-31T02:01:20.477508+0000","last_active":"2023-08-31T02:01:22.474583+0000","last_peered":"2023-08-31T02:01:22.474583+0000","last_clean":"2023-08-31T02:01:22.474583+0000","last_became_active":"2023-08-31T02:01:20.477260+0000","last_became_peered":"2023-08-31T02:01:20.477260+0000","last_unstale":"2023-08-31T02:01:22.474583+0000","last_undegraded":"2023-08-31T02:01:22.474583+0000","last_fullsized":"2023-08-31T02:01:22.474583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:44:05.421419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474724+0000","last_change":"2023-08-31T02:01:21.491870+0000","last_active":"2023-08-31T02:01:22.474724+0000","last_peered":"2023-08-31T02:01:22.474724+0000","last_clean":"2023-08-31T02:01:22.474724+0000","last_became_active":"2023-08-31T02:01:21.491592+0000","last_became_peered":"2023-08-31T02:01:21.491592+0000","last_unstale":"2023-08-31T02:01:22.474724+0000","last_undegraded":"2023-08-31T02:01:22.474724+0000","last_fullsized":"2023-08-31T02:01:22.474724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473493+0000","last_change":"2023-08-31T02:01:20.475956+0000","last_active":"2023-08-31T02:01:22.473493+0000","last_peered":"2023-08-31T02:01:22.473493+0000","last_clean":"2023-08-31T02:01:22.473493+0000","last_became_active":"2023-08-31T02:01:20.475694+0000","last_became_peered":"2023-08-31T02:01:20.475694+0000","last_unstale":"2023-08-31T02:01:22.473493+0000","last_undegraded":"2023-08-31T02:01:22.473493+0000","last_fullsized":"2023-08-31T02:01:22.473493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473616+0000","last_change":"2023-08-31T02:01:21.491382+0000","last_active":"2023-08-31T02:01:22.473616+0000","last_peered":"2023-08-31T02:01:22.473616+0000","last_clean":"2023-08-31T02:01:22.473616+0000","last_became_active":"2023-08-31T02:01:21.491114+0000","last_became_peered":"2023-08-31T02:01:21.491114+0000","last_unstale":"2023-08-31T02:01:22.473616+0000","last_undegraded":"2023-08-31T02:01:22.473616+0000","last_fullsized":"2023-08-31T02:01:22.473616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154526+0000","last_change":"2023-08-31T02:01:20.474505+0000","last_active":"2023-08-31T02:01:23.154526+0000","last_peered":"2023-08-31T02:01:23.154526+0000","last_clean":"2023-08-31T02:01:23.154526+0000","last_became_active":"2023-08-31T02:01:20.474179+0000","last_became_peered":"2023-08-31T02:01:20.474179+0000","last_unstale":"2023-08-31T02:01:23.154526+0000","last_undegraded":"2023-08-31T02:01:23.154526+0000","last_fullsized":"2023-08-31T02:01:23.154526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:02:02.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154570+0000","last_change":"2023-08-31T02:01:21.491206+0000","last_active":"2023-08-31T02:01:23.154570+0000","last_peered":"2023-08-31T02:01:23.154570+0000","last_clean":"2023-08-31T02:01:23.154570+0000","last_became_active":"2023-08-31T02:01:21.490947+0000","last_became_peered":"2023-08-31T02:01:21.490947+0000","last_unstale":"2023-08-31T02:01:23.154570+0000","last_undegraded":"2023-08-31T02:01:23.154570+0000","last_fullsized":"2023-08-31T02:01:23.154570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:55.955512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480898+0000","last_change":"2023-08-31T02:01:20.475069+0000","last_active":"2023-08-31T02:01:21.480898+0000","last_peered":"2023-08-31T02:01:21.480898+0000","last_clean":"2023-08-31T02:01:21.480898+0000","last_became_active":"2023-08-31T02:01:20.474780+0000","last_became_peered":"2023-08-31T02:01:20.474780+0000","last_unstale":"2023-08-31T02:01:21.480898+0000","last_undegraded":"2023-08-31T02:01:21.480898+0000","last_fullsized":"2023-08-31T02:01:21.480898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:16.303270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155214+0000","last_change":"2023-08-31T02:01:21.494374+0000","last_active":"2023-08-31T02:01:23.155214+0000","last_peered":"2023-08-31T02:01:23.155214+0000","last_clean":"2023-08-31T02:01:23.155214+0000","last_became_active":"2023-08-31T02:01:21.494077+0000","last_became_peered":"2023-08-31T02:01:21.494077+0000","last_unstale":"2023-08-31T02:01:23.155214+0000","last_undegraded":"2023-08-31T02:01:23.155214+0000","last_fullsized":"2023-08-31T02:01:23.155214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:19:25.263827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154576+0000","last_change":"2023-08-31T02:01:20.467838+0000","last_active":"2023-08-31T02:01:23.154576+0000","last_peered":"2023-08-31T02:01:23.154576+0000","last_clean":"2023-08-31T02:01:23.154576+0000","last_became_active":"2023-08-31T02:01:20.467567+0000","last_became_peered":"2023-08-31T02:01:20.467567+0000","last_unstale":"2023-08-31T02:01:23.154576+0000","last_undegraded":"2023-08-31T02:01:23.154576+0000","last_fullsized":"2023-08-31T02:01:23.154576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:27:02.795050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154093+0000","last_change":"2023-08-31T02:01:21.491262+0000","last_active":"2023-08-31T02:01:23.154093+0000","last_peered":"2023-08-31T02:01:23.154093+0000","last_clean":"2023-08-31T02:01:23.154093+0000","last_became_active":"2023-08-31T02:01:21.490982+0000","last_became_peered":"2023-08-31T02:01:21.490982+0000","last_unstale":"2023-08-31T02:01:23.154093+0000","last_undegraded":"2023-08-31T02:01:23.154093+0000","last_fullsized":"2023-08-31T02:01:23.154093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154338+0000","last_change":"2023-08-31T02:01:20.469596+0000","last_active":"2023-08-31T02:01:23.154338+0000","last_peered":"2023-08-31T02:01:23.154338+0000","last_clean":"2023-08-31T02:01:23.154338+0000","last_became_active":"2023-08-31T02:01:20.469290+0000","last_became_peered":"2023-08-31T02:01:20.469290+0000","last_unstale":"2023-08-31T02:01:23.154338+0000","last_undegraded":"2023-08-31T02:01:23.154338+0000","last_fullsized":"2023-08-31T02:01:23.154338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:27:42.568205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474353+0000","last_change":"2023-08-31T02:01:21.493623+0000","last_active":"2023-08-31T02:01:22.474353+0000","last_peered":"2023-08-31T02:01:22.474353+0000","last_clean":"2023-08-31T02:01:22.474353+0000","last_became_active":"2023-08-31T02:01:21.493369+0000","last_became_peered":"2023-08-31T02:01:21.493369+0000","last_unstale":"2023-08-31T02:01:22.474353+0000","last_undegraded":"2023-08-31T02:01:22.474353+0000","last_fullsized":"2023-08-31T02:01:22.474353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:20.474557+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:20.474269+0000","last_became_peered":"2023-08-31T02:01:20.474269+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472721+0000","last_change":"2023-08-31T02:01:21.488629+0000","last_active":"2023-08-31T02:01:22.472721+0000","last_peered":"2023-08-31T02:01:22.472721+0000","last_clean":"2023-08-31T02:01:22.472721+0000","last_became_active":"2023-08-31T02:01:21.487877+0000","last_became_peered":"2023-08-31T02:01:21.487877+0000","last_unstale":"2023-08-31T02:01:22.472721+0000","last_undegraded":"2023-08-31T02:01:22.472721+0000","last_fullsized":"2023-08-31T02:01:22.472721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153853+0000","last_change":"2023-08-31T02:01:20.474084+0000","last_active":"2023-08-31T02:01:23.153853+0000","last_peered":"2023-08-31T02:01:23.153853+0000","last_clean":"2023-08-31T02:01:23.153853+0000","last_became_active":"2023-08-31T02:01:20.473811+0000","last_became_peered":"2023-08-31T02:01:20.473811+0000","last_unstale":"2023-08-31T02:01:23.153853+0000","last_undegraded":"2023-08-31T02:01:23.153853+0000","last_fullsized":"2023-08-31T02:01:23.153853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:18:30.609765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154520+0000","last_change":"2023-08-31T02:01:21.490256+0000","last_active":"2023-08-31T02:01:23.154520+0000","last_peered":"2023-08-31T02:01:23.154520+0000","last_clean":"2023-08-31T02:01:23.154520+0000","last_became_active":"2023-08-31T02:01:21.489987+0000","last_became_peered":"2023-08-31T02:01:21.489987+0000","last_unstale":"2023-08-31T02:01:23.154520+0000","last_undegraded":"2023-08-31T02:01:23.154520+0000","last_fullsized":"2023-08-31T02:01:23.154520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474465+0000","last_change":"2023-08-31T02:01:20.474116+0000","last_active":"2023-08-31T02:01:22.474465+0000","last_peered":"2023-08-31T02:01:22.474465+0000","last_clean":"2023-08-31T02:01:22.474465+0000","last_became_active":"2023-08-31T02:01:20.473855+0000","last_became_peered":"2023-08-31T02:01:20.473855+0000","last_unstale":"2023-08-31T02:01:22.474465+0000","last_undegraded":"2023-08-31T02:01:22.474465+0000","last_fullsized":"2023-08-31T02:01:22.474465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:41:18.994166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:21.494457+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:21.493732+0000","last_became_peered":"2023-08-31T02:01:21.493732+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.600588+0000","last_change":"2023-08-31T02:01:20.474656+0000","last_active":"2023-08-31T02:01:23.600588+0000","last_peered":"2023-08-31T02:01:23.600588+0000","last_clean":"2023-08-31T02:01:23.600588+0000","last_became_active":"2023-08-31T02:01:20.474369+0000","last_became_peered":"2023-08-31T02:01:20.474369+0000","last_unstale":"2023-08-31T02:01:23.600588+0000","last_undegraded":"2023-08-31T02:01:23.600588+0000","last_fullsized":"2023-08-31T02:01:23.600588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:45:00.848193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473070+0000","last_change":"2023-08-31T02:01:21.477794+0000","last_active":"2023-08-31T02:01:22.473070+0000","last_peered":"2023-08-31T02:01:22.473070+0000","last_clean":"2023-08-31T02:01:22.473070+0000","last_became_active":"2023-08-31T02:01:21.477508+0000","last_became_peered":"2023-08-31T02:01:21.477508+0000","last_unstale":"2023-08-31T02:01:22.473070+0000","last_undegraded":"2023-08-31T02:01:22.473070+0000","last_fullsized":"2023-08-31T02:01:22.473070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154313+0000","last_change":"2023-08-31T02:01:20.474392+0000","last_active":"2023-08-31T02:01:23.154313+0000","last_peered":"2023-08-31T02:01:23.154313+0000","last_clean":"2023-08-31T02:01:23.154313+0000","last_became_active":"2023-08-31T02:01:20.473883+0000","last_became_peered":"2023-08-31T02:01:20.473883+0000","last_unstale":"2023-08-31T02:01:23.154313+0000","last_undegraded":"2023-08-31T02:01:23.154313+0000","last_fullsized":"2023-08-31T02:01:23.154313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:36.309094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153979+0000","last_change":"2023-08-31T02:01:21.484480+0000","last_active":"2023-08-31T02:01:23.153979+0000","last_peered":"2023-08-31T02:01:23.153979+0000","last_clean":"2023-08-31T02:01:23.153979+0000","last_became_active":"2023-08-31T02:01:21.484215+0000","last_became_peered":"2023-08-31T02:01:21.484215+0000","last_unstale":"2023-08-31T02:01:23.153979+0000","last_undegraded":"2023-08-31T02:01:23.153979+0000","last_fullsized":"2023-08-31T02:01:23.153979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154406+0000","last_change":"2023-08-31T02:01:20.470456+0000","last_active":"2023-08-31T02:01:23.154406+0000","last_peered":"2023-08-31T02:01:23.154406+0000","last_clean":"2023-08-31T02:01:23.154406+0000","last_became_active":"2023-08-31T02:01:20.470196+0000","last_became_peered":"2023-08-31T02:01:20.470196+0000","last_unstale":"2023-08-31T02:01:23.154406+0000","last_undegraded":"2023-08-31T02:01:23.154406+0000","last_fullsized":"2023-08-31T02:01:23.154406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155409+0000","last_change":"2023-08-31T02:01:21.491660+0000","last_active":"2023-08-31T02:01:23.155409+0000","last_peered":"2023-08-31T02:01:23.155409+0000","last_clean":"2023-08-31T02:01:23.155409+0000","last_became_active":"2023-08-31T02:01:21.491382+0000","last_became_peered":"2023-08-31T02:01:21.491382+0000","last_unstale":"2023-08-31T02:01:23.155409+0000","last_undegraded":"2023-08-31T02:01:23.155409+0000","last_fullsized":"2023-08-31T02:01:23.155409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155067+0000","last_change":"2023-08-31T02:01:20.473075+0000","last_active":"2023-08-31T02:01:23.155067+0000","last_peered":"2023-08-31T02:01:23.155067+0000","last_clean":"2023-08-31T02:01:23.155067+0000","last_became_active":"2023-08-31T02:01:20.472816+0000","last_became_peered":"2023-08-31T02:01:20.472816+0000","last_unstale":"2023-08-31T02:01:23.155067+0000","last_undegraded":"2023-08-31T02:01:23.155067+0000","last_fullsized":"2023-08-31T02:01:23.155067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473306+0000","last_change":"2023-08-31T02:01:21.480979+0000","last_active":"2023-08-31T02:01:22.473306+0000","last_peered":"2023-08-31T02:01:22.473306+0000","last_clean":"2023-08-31T02:01:22.473306+0000","last_became_active":"2023-08-31T02:01:21.480663+0000","last_became_peered":"2023-08-31T02:01:21.480663+0000","last_unstale":"2023-08-31T02:01:22.473306+0000","last_undegraded":"2023-08-31T02:01:22.473306+0000","last_fullsized":"2023-08-31T02:01:22.473306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472970+0000","last_change":"2023-08-31T02:01:20.471925+0000","last_active":"2023-08-31T02:01:22.472970+0000","last_peered":"2023-08-31T02:01:22.472970+0000","last_clean":"2023-08-31T02:01:22.472970+0000","last_became_active":"2023-08-31T02:01:20.471633+0000","last_became_peered":"2023-08-31T02:01:20.471633+0000","last_unstale":"2023-08-31T02:01:22.472970+0000","last_undegraded":"2023-08-31T02:01:22.472970+0000","last_fullsized":"2023-08-31T02:01:22.472970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155077+0000","last_change":"2023-08-31T02:01:21.490803+0000","last_active":"2023-08-31T02:01:23.155077+0000","last_peered":"2023-08-31T02:01:23.155077+0000","last_clean":"2023-08-31T02:01:23.155077+0000","last_became_active":"2023-08-31T02:01:21.490535+0000","last_became_peered":"2023-08-31T02:01:21.490535+0000","last_unstale":"2023-08-31T02:01:23.155077+0000","last_undegraded":"2023-08-31T02:01:23.155077+0000","last_fullsized":"2023-08-31T02:01:23.155077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:17:07.573441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472499+0000","last_change":"2023-08-31T02:01:20.473424+0000","last_active":"2023-08-31T02:01:22.472499+0000","last_peered":"2023-08-31T02:01:22.472499+0000","last_clean":"2023-08-31T02:01:22.472499+0000","last_became_active":"2023-08-31T02:01:20.473069+0000","last_became_peered":"2023-08-31T02:01:20.473069+0000","last_unstale":"2023-08-31T02:01:22.472499+0000","last_undegraded":"2023-08-31T02:01:22.472499+0000","last_fullsized":"2023-08-31T02:01:22.472499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:19:53.569012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474460+0000","last_change":"2023-08-31T02:01:21.478455+0000","last_active":"2023-08-31T02:01:22.474460+0000","last_peered":"2023-08-31T02:01:22.474460+0000","last_clean":"2023-08-31T02:01:22.474460+0000","last_became_active":"2023-08-31T02:01:21.476993+0000","last_became_peered":"2023-08-31T02:01:21.476993+0000","last_unstale":"2023-08-31T02:01:22.474460+0000","last_undegraded":"2023-08-31T02:01:22.474460+0000","last_fullsized":"2023-08-31T02:01:22.474460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155095+0000","last_change":"2023-08-31T02:01:20.477325+0000","last_active":"2023-08-31T02:01:23.155095+0000","last_peered":"2023-08-31T02:01:23.155095+0000","last_clean":"2023-08-31T02:01:23.155095+0000","last_became_active":"2023-08-31T02:01:20.476450+0000","last_became_peered":"2023-08-31T02:01:20.476450+0000","last_unstale":"2023-08-31T02:01:23.155095+0000","last_undegraded":"2023-08-31T02:01:23.155095+0000","last_fullsized":"2023-08-31T02:01:23.155095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480301+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:21.480301+0000","last_peered":"2023-08-31T02:01:21.480301+0000","last_clean":"2023-08-31T02:01:21.480301+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:21.480301+0000","last_undegraded":"2023-08-31T02:01:21.480301+0000","last_fullsized":"2023-08-31T02:01:21.480301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.495}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.74,"5min":11.74,"15min":11.74},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.879},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":11.707000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.659000000000001,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.747},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":11.628,"5min":11.628,"15min":11.628},"last":0.82699999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1069056,"data_stored":789651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":788003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.62}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.309},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.6799999999999997,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.71,"5min":5.71,"15min":5.71},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.621},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.8579999999999997,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.64900000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":199247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.308}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.372},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.45300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.495},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.627}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":198183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.8460000000000001,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:28.058 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:01:28.061 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:01:30.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:30.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.275+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1842077127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 msgr2=0x7f5a380b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.275+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1842077127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 0x7f5a380b08a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5a3806ffd0 tx=0x7f5a28009ba0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.275+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1842077127 shutdown_connections 2023-08-31T02:01:30.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.275+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1842077127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 0x7f5a380b08a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.275+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1842077127 >> v2:172.21.15.170:3300/0 conn(0x7f5a380c8f20 0x7f5a380b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.275+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1842077127 >> 172.21.15.84:0/1842077127 conn(0x7f5a380cd740 msgr2=0x7f5a380cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:30.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.276+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1842077127 shutdown_connections 2023-08-31T02:01:30.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.276+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1842077127 wait complete. 2023-08-31T02:01:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.277+0000 7f5a3fc7d700 1 Processor -- start 2023-08-31T02:01:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.277+0000 7f5a3fc7d700 1 -- start start 2023-08-31T02:01:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.277+0000 7f5a3fc7d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 0x7f5a38069c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3fc7d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a380b1950 0x7f5a381df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3fc7d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a380c8f20 0x7f5a381dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3fc7d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3806c6d0 con 0x7f5a380b1030 2023-08-31T02:01:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3fc7d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a381de980 con 0x7f5a380b1950 2023-08-31T02:01:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3fc7d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3806bda0 con 0x7f5a380c8f20 2023-08-31T02:01:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 0x7f5a38069c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 0x7f5a38069c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54010/0 (socket says 172.21.15.84:54010) 2023-08-31T02:01:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 -- 172.21.15.84:0/1167641615 learned_addr learned my addr 172.21.15.84:0/1167641615 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 -- 172.21.15.84:0/1167641615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a380c8f20 msgr2=0x7f5a381dfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a380c8f20 0x7f5a381dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 -- 172.21.15.84:0/1167641615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a380b1950 msgr2=0x7f5a381df5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a380b1950 0x7f5a381df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 -- 172.21.15.84:0/1167641615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28009520 con 0x7f5a380b1030 2023-08-31T02:01:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3da19700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 0x7f5a38069c10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009810 tx=0x7f5a28011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a2e7fc700 1 -- 172.21.15.84:0/1167641615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2801d070 con 0x7f5a380b1030 2023-08-31T02:01:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a2e7fc700 1 -- 172.21.15.84:0/1167641615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5a28011e00 con 0x7f5a380b1030 2023-08-31T02:01:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a2e7fc700 1 -- 172.21.15.84:0/1167641615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a280226d0 con 0x7f5a380b1030 2023-08-31T02:01:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3806c080 con 0x7f5a380b1030 2023-08-31T02:01:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.278+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3806ba90 con 0x7f5a380b1030 2023-08-31T02:01:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.279+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3804e7c0 con 0x7f5a380b1030 2023-08-31T02:01:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.280+0000 7f5a2e7fc700 1 -- 172.21.15.84:0/1167641615 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a28017400 con 0x7f5a380b1030 2023-08-31T02:01:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.280+0000 7f5a2e7fc700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.280+0000 7f5a3d218700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.280+0000 7f5a2e7fc700 1 -- 172.21.15.84:0/1167641615 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5a2808bd60 con 0x7f5a380b1030 2023-08-31T02:01:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.281+0000 7f5a3d218700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5a34005950 tx=0x7f5a340058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.285+0000 7f5a2e7fc700 1 -- 172.21.15.84:0/1167641615 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5a28057490 con 0x7f5a380b1030 2023-08-31T02:01:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.469+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a380b1e20 con 0x7f5a1c06a0e0 2023-08-31T02:01:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.477+0000 7f5a2e7fc700 1 -- 172.21.15.84:0/1167641615 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289469 (secure 0 0 0) 0x7f5a34009730 con 0x7f5a1c06a0e0 2023-08-31T02:01:30.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:30.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5a1c06a0e0 msgr2=0x7f5a1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5a34005950 tx=0x7f5a340058e0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 msgr2=0x7f5a38069c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 0x7f5a38069c10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009810 tx=0x7f5a28011950 comp rx=0 tx=0).stop 2023-08-31T02:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 shutdown_connections 2023-08-31T02:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a380c8f20 0x7f5a381dfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a380b1030 0x7f5a38069c10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 --2- 172.21.15.84:0/1167641615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a380b1950 0x7f5a381df5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 >> 172.21.15.84:0/1167641615 conn(0x7f5a380cd740 msgr2=0x7f5a380c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 shutdown_connections 2023-08-31T02:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.480+0000 7f5a3fc7d700 1 -- 172.21.15.84:0/1167641615 wait complete. 2023-08-31T02:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:30.485 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-08-31T02:01:29.068784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220988,"kb_used_data":4808,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753732,"statfs":{"total":773094113280,"available":772867821568,"internally_reserved":0,"allocated":4923392,"data_stored":2766364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001736"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472865+0000","last_change":"2023-08-31T02:01:21.483607+0000","last_active":"2023-08-31T02:01:22.472865+0000","last_peered":"2023-08-31T02:01:22.472865+0000","last_clean":"2023-08-31T02:01:22.472865+0000","last_became_active":"2023-08-31T02:01:21.483386+0000","last_became_peered":"2023-08-31T02:01:21.483386+0000","last_unstale":"2023-08-31T02:01:22.472865+0000","last_undegraded":"2023-08-31T02:01:22.472865+0000","last_fullsized":"2023-08-31T02:01:22.472865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472940+0000","last_change":"2023-08-31T02:01:21.479696+0000","last_active":"2023-08-31T02:01:22.472940+0000","last_peered":"2023-08-31T02:01:22.472940+0000","last_clean":"2023-08-31T02:01:22.472940+0000","last_became_active":"2023-08-31T02:01:21.479422+0000","last_became_peered":"2023-08-31T02:01:21.479422+0000","last_unstale":"2023-08-31T02:01:22.472940+0000","last_undegraded":"2023-08-31T02:01:22.472940+0000","last_fullsized":"2023-08-31T02:01:22.472940+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154224+0000","last_change":"2023-08-31T02:01:21.487277+0000","last_active":"2023-08-31T02:01:23.154224+0000","last_peered":"2023-08-31T02:01:23.154224+0000","last_clean":"2023-08-31T02:01:23.154224+0000","last_became_active":"2023-08-31T02:01:21.486976+0000","last_became_peered":"2023-08-31T02:01:21.486976+0000","last_unstale":"2023-08-31T02:01:23.154224+0000","last_undegraded":"2023-08-31T02:01:23.154224+0000","last_fullsized":"2023-08-31T02:01:23.154224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154614+0000","last_change":"2023-08-31T02:01:21.494288+0000","last_active":"2023-08-31T02:01:23.154614+0000","last_peered":"2023-08-31T02:01:23.154614+0000","last_clean":"2023-08-31T02:01:23.154614+0000","last_became_active":"2023-08-31T02:01:21.493886+0000","last_became_peered":"2023-08-31T02:01:21.493886+0000","last_unstale":"2023-08-31T02:01:23.154614+0000","last_undegraded":"2023-08-31T02:01:23.154614+0000","last_fullsized":"2023-08-31T02:01:23.154614+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:40:06.925751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154293+0000","last_change":"2023-08-31T02:01:21.490804+0000","last_active":"2023-08-31T02:01:23.154293+0000","last_peered":"2023-08-31T02:01:23.154293+0000","last_clean":"2023-08-31T02:01:23.154293+0000","last_became_active":"2023-08-31T02:01:21.490531+0000","last_became_peered":"2023-08-31T02:01:21.490531+0000","last_unstale":"2023-08-31T02:01:23.154293+0000","last_undegraded":"2023-08-31T02:01:23.154293+0000","last_fullsized":"2023-08-31T02:01:23.154293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:16:12.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154799+0000","last_change":"2023-08-31T02:01:21.493828+0000","last_active":"2023-08-31T02:01:23.154799+0000","last_peered":"2023-08-31T02:01:23.154799+0000","last_clean":"2023-08-31T02:01:23.154799+0000","last_became_active":"2023-08-31T02:01:21.493553+0000","last_became_peered":"2023-08-31T02:01:21.493553+0000","last_unstale":"2023-08-31T02:01:23.154799+0000","last_undegraded":"2023-08-31T02:01:23.154799+0000","last_fullsized":"2023-08-31T02:01:23.154799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474162+0000","last_change":"2023-08-31T02:01:21.477335+0000","last_active":"2023-08-31T02:01:22.474162+0000","last_peered":"2023-08-31T02:01:22.474162+0000","last_clean":"2023-08-31T02:01:22.474162+0000","last_became_active":"2023-08-31T02:01:21.476978+0000","last_became_peered":"2023-08-31T02:01:21.476978+0000","last_unstale":"2023-08-31T02:01:22.474162+0000","last_undegraded":"2023-08-31T02:01:22.474162+0000","last_fullsized":"2023-08-31T02:01:22.474162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472523+0000","last_change":"2023-08-31T02:01:21.479618+0000","last_active":"2023-08-31T02:01:22.472523+0000","last_peered":"2023-08-31T02:01:22.472523+0000","last_clean":"2023-08-31T02:01:22.472523+0000","last_became_active":"2023-08-31T02:01:21.479344+0000","last_became_peered":"2023-08-31T02:01:21.479344+0000","last_unstale":"2023-08-31T02:01:22.472523+0000","last_undegraded":"2023-08-31T02:01:22.472523+0000","last_fullsized":"2023-08-31T02:01:22.472523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154346+0000","last_change":"2023-08-31T02:01:21.487087+0000","last_active":"2023-08-31T02:01:23.154346+0000","last_peered":"2023-08-31T02:01:23.154346+0000","last_clean":"2023-08-31T02:01:23.154346+0000","last_became_active":"2023-08-31T02:01:21.486783+0000","last_became_peered":"2023-08-31T02:01:21.486783+0000","last_unstale":"2023-08-31T02:01:23.154346+0000","last_undegraded":"2023-08-31T02:01:23.154346+0000","last_fullsized":"2023-08-31T02:01:23.154346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474348+0000","last_change":"2023-08-31T02:01:21.485931+0000","last_active":"2023-08-31T02:01:22.474348+0000","last_peered":"2023-08-31T02:01:22.474348+0000","last_clean":"2023-08-31T02:01:22.474348+0000","last_became_active":"2023-08-31T02:01:21.485666+0000","last_became_peered":"2023-08-31T02:01:21.485666+0000","last_unstale":"2023-08-31T02:01:22.474348+0000","last_undegraded":"2023-08-31T02:01:22.474348+0000","last_fullsized":"2023-08-31T02:01:22.474348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474466+0000","last_change":"2023-08-31T02:01:21.481313+0000","last_active":"2023-08-31T02:01:22.474466+0000","last_peered":"2023-08-31T02:01:22.474466+0000","last_clean":"2023-08-31T02:01:22.474466+0000","last_became_active":"2023-08-31T02:01:21.481052+0000","last_became_peered":"2023-08-31T02:01:21.481052+0000","last_unstale":"2023-08-31T02:01:22.474466+0000","last_undegraded":"2023-08-31T02:01:22.474466+0000","last_fullsized":"2023-08-31T02:01:22.474466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:36:26.506119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154140+0000","last_change":"2023-08-31T02:01:21.487451+0000","last_active":"2023-08-31T02:01:23.154140+0000","last_peered":"2023-08-31T02:01:23.154140+0000","last_clean":"2023-08-31T02:01:23.154140+0000","last_became_active":"2023-08-31T02:01:21.486899+0000","last_became_peered":"2023-08-31T02:01:21.486899+0000","last_unstale":"2023-08-31T02:01:23.154140+0000","last_undegraded":"2023-08-31T02:01:23.154140+0000","last_fullsized":"2023-08-31T02:01:23.154140+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474198+0000","last_change":"2023-08-31T02:01:21.490530+0000","last_active":"2023-08-31T02:01:22.474198+0000","last_peered":"2023-08-31T02:01:22.474198+0000","last_clean":"2023-08-31T02:01:22.474198+0000","last_became_active":"2023-08-31T02:01:21.490216+0000","last_became_peered":"2023-08-31T02:01:21.490216+0000","last_unstale":"2023-08-31T02:01:22.474198+0000","last_undegraded":"2023-08-31T02:01:22.474198+0000","last_fullsized":"2023-08-31T02:01:22.474198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473438+0000","last_change":"2023-08-31T02:01:21.486405+0000","last_active":"2023-08-31T02:01:22.473438+0000","last_peered":"2023-08-31T02:01:22.473438+0000","last_clean":"2023-08-31T02:01:22.473438+0000","last_became_active":"2023-08-31T02:01:21.485996+0000","last_became_peered":"2023-08-31T02:01:21.485996+0000","last_unstale":"2023-08-31T02:01:22.473438+0000","last_undegraded":"2023-08-31T02:01:22.473438+0000","last_fullsized":"2023-08-31T02:01:22.473438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473444+0000","last_change":"2023-08-31T02:01:21.485585+0000","last_active":"2023-08-31T02:01:22.473444+0000","last_peered":"2023-08-31T02:01:22.473444+0000","last_clean":"2023-08-31T02:01:22.473444+0000","last_became_active":"2023-08-31T02:01:21.484565+0000","last_became_peered":"2023-08-31T02:01:21.484565+0000","last_unstale":"2023-08-31T02:01:22.473444+0000","last_undegraded":"2023-08-31T02:01:22.473444+0000","last_fullsized":"2023-08-31T02:01:22.473444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:22:22.347703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154531+0000","last_change":"2023-08-31T02:01:21.486621+0000","last_active":"2023-08-31T02:01:23.154531+0000","last_peered":"2023-08-31T02:01:23.154531+0000","last_clean":"2023-08-31T02:01:23.154531+0000","last_became_active":"2023-08-31T02:01:21.486282+0000","last_became_peered":"2023-08-31T02:01:21.486282+0000","last_unstale":"2023-08-31T02:01:23.154531+0000","last_undegraded":"2023-08-31T02:01:23.154531+0000","last_fullsized":"2023-08-31T02:01:23.154531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155145+0000","last_change":"2023-08-31T02:01:21.490357+0000","last_active":"2023-08-31T02:01:23.155145+0000","last_peered":"2023-08-31T02:01:23.155145+0000","last_clean":"2023-08-31T02:01:23.155145+0000","last_became_active":"2023-08-31T02:01:21.487866+0000","last_became_peered":"2023-08-31T02:01:21.487866+0000","last_unstale":"2023-08-31T02:01:23.155145+0000","last_undegraded":"2023-08-31T02:01:23.155145+0000","last_fullsized":"2023-08-31T02:01:23.155145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154508+0000","last_change":"2023-08-31T02:01:21.495399+0000","last_active":"2023-08-31T02:01:23.154508+0000","last_peered":"2023-08-31T02:01:23.154508+0000","last_clean":"2023-08-31T02:01:23.154508+0000","last_became_active":"2023-08-31T02:01:21.495110+0000","last_became_peered":"2023-08-31T02:01:21.495110+0000","last_unstale":"2023-08-31T02:01:23.154508+0000","last_undegraded":"2023-08-31T02:01:23.154508+0000","last_fullsized":"2023-08-31T02:01:23.154508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:17.307517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154441+0000","last_change":"2023-08-31T02:01:21.488517+0000","last_active":"2023-08-31T02:01:23.154441+0000","last_peered":"2023-08-31T02:01:23.154441+0000","last_clean":"2023-08-31T02:01:23.154441+0000","last_became_active":"2023-08-31T02:01:21.488239+0000","last_became_peered":"2023-08-31T02:01:21.488239+0000","last_unstale":"2023-08-31T02:01:23.154441+0000","last_undegraded":"2023-08-31T02:01:23.154441+0000","last_fullsized":"2023-08-31T02:01:23.154441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:33.898751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154306+0000","last_change":"2023-08-31T02:01:21.490976+0000","last_active":"2023-08-31T02:01:23.154306+0000","last_peered":"2023-08-31T02:01:23.154306+0000","last_clean":"2023-08-31T02:01:23.154306+0000","last_became_active":"2023-08-31T02:01:21.490707+0000","last_became_peered":"2023-08-31T02:01:21.490707+0000","last_unstale":"2023-08-31T02:01:23.154306+0000","last_undegraded":"2023-08-31T02:01:23.154306+0000","last_fullsized":"2023-08-31T02:01:23.154306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:21:01.584279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474281+0000","last_change":"2023-08-31T02:01:21.487315+0000","last_active":"2023-08-31T02:01:22.474281+0000","last_peered":"2023-08-31T02:01:22.474281+0000","last_clean":"2023-08-31T02:01:22.474281+0000","last_became_active":"2023-08-31T02:01:21.487028+0000","last_became_peered":"2023-08-31T02:01:21.487028+0000","last_unstale":"2023-08-31T02:01:22.474281+0000","last_undegraded":"2023-08-31T02:01:22.474281+0000","last_fullsized":"2023-08-31T02:01:22.474281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473190+0000","last_change":"2023-08-31T02:01:21.486242+0000","last_active":"2023-08-31T02:01:22.473190+0000","last_peered":"2023-08-31T02:01:22.473190+0000","last_clean":"2023-08-31T02:01:22.473190+0000","last_became_active":"2023-08-31T02:01:21.485620+0000","last_became_peered":"2023-08-31T02:01:21.485620+0000","last_unstale":"2023-08-31T02:01:22.473190+0000","last_undegraded":"2023-08-31T02:01:22.473190+0000","last_fullsized":"2023-08-31T02:01:22.473190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154800+0000","last_change":"2023-08-31T02:01:21.495072+0000","last_active":"2023-08-31T02:01:23.154800+0000","last_peered":"2023-08-31T02:01:23.154800+0000","last_clean":"2023-08-31T02:01:23.154800+0000","last_became_active":"2023-08-31T02:01:21.494263+0000","last_became_peered":"2023-08-31T02:01:21.494263+0000","last_unstale":"2023-08-31T02:01:23.154800+0000","last_undegraded":"2023-08-31T02:01:23.154800+0000","last_fullsized":"2023-08-31T02:01:23.154800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153910+0000","last_change":"2023-08-31T02:01:21.494001+0000","last_active":"2023-08-31T02:01:23.153910+0000","last_peered":"2023-08-31T02:01:23.153910+0000","last_clean":"2023-08-31T02:01:23.153910+0000","last_became_active":"2023-08-31T02:01:21.493742+0000","last_became_peered":"2023-08-31T02:01:21.493742+0000","last_unstale":"2023-08-31T02:01:23.153910+0000","last_undegraded":"2023-08-31T02:01:23.153910+0000","last_fullsized":"2023-08-31T02:01:23.153910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:53:45.076676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154521+0000","last_change":"2023-08-31T02:01:21.491466+0000","last_active":"2023-08-31T02:01:23.154521+0000","last_peered":"2023-08-31T02:01:23.154521+0000","last_clean":"2023-08-31T02:01:23.154521+0000","last_became_active":"2023-08-31T02:01:21.488906+0000","last_became_peered":"2023-08-31T02:01:21.488906+0000","last_unstale":"2023-08-31T02:01:23.154521+0000","last_undegraded":"2023-08-31T02:01:23.154521+0000","last_fullsized":"2023-08-31T02:01:23.154521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:53.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154713+0000","last_change":"2023-08-31T02:01:21.486091+0000","last_active":"2023-08-31T02:01:23.154713+0000","last_peered":"2023-08-31T02:01:23.154713+0000","last_clean":"2023-08-31T02:01:23.154713+0000","last_became_active":"2023-08-31T02:01:21.485760+0000","last_became_peered":"2023-08-31T02:01:21.485760+0000","last_unstale":"2023-08-31T02:01:23.154713+0000","last_undegraded":"2023-08-31T02:01:23.154713+0000","last_fullsized":"2023-08-31T02:01:23.154713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154435+0000","last_change":"2023-08-31T02:01:21.495374+0000","last_active":"2023-08-31T02:01:23.154435+0000","last_peered":"2023-08-31T02:01:23.154435+0000","last_clean":"2023-08-31T02:01:23.154435+0000","last_became_active":"2023-08-31T02:01:21.494511+0000","last_became_peered":"2023-08-31T02:01:21.494511+0000","last_unstale":"2023-08-31T02:01:23.154435+0000","last_undegraded":"2023-08-31T02:01:23.154435+0000","last_fullsized":"2023-08-31T02:01:23.154435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:37.313340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474483+0000","last_change":"2023-08-31T02:01:21.486431+0000","last_active":"2023-08-31T02:01:22.474483+0000","last_peered":"2023-08-31T02:01:22.474483+0000","last_clean":"2023-08-31T02:01:22.474483+0000","last_became_active":"2023-08-31T02:01:21.486138+0000","last_became_peered":"2023-08-31T02:01:21.486138+0000","last_unstale":"2023-08-31T02:01:22.474483+0000","last_undegraded":"2023-08-31T02:01:22.474483+0000","last_fullsized":"2023-08-31T02:01:22.474483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154708+0000","last_change":"2023-08-31T02:01:21.492203+0000","last_active":"2023-08-31T02:01:23.154708+0000","last_peered":"2023-08-31T02:01:23.154708+0000","last_clean":"2023-08-31T02:01:23.154708+0000","last_became_active":"2023-08-31T02:01:21.491853+0000","last_became_peered":"2023-08-31T02:01:21.491853+0000","last_unstale":"2023-08-31T02:01:23.154708+0000","last_undegraded":"2023-08-31T02:01:23.154708+0000","last_fullsized":"2023-08-31T02:01:23.154708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:12.582057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155112+0000","last_change":"2023-08-31T02:01:21.489782+0000","last_active":"2023-08-31T02:01:23.155112+0000","last_peered":"2023-08-31T02:01:23.155112+0000","last_clean":"2023-08-31T02:01:23.155112+0000","last_became_active":"2023-08-31T02:01:21.489511+0000","last_became_peered":"2023-08-31T02:01:21.489511+0000","last_unstale":"2023-08-31T02:01:23.155112+0000","last_undegraded":"2023-08-31T02:01:23.155112+0000","last_fullsized":"2023-08-31T02:01:23.155112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:29.822747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154808+0000","last_change":"2023-08-31T02:01:21.494310+0000","last_active":"2023-08-31T02:01:23.154808+0000","last_peered":"2023-08-31T02:01:23.154808+0000","last_clean":"2023-08-31T02:01:23.154808+0000","last_became_active":"2023-08-31T02:01:21.493693+0000","last_became_peered":"2023-08-31T02:01:21.493693+0000","last_unstale":"2023-08-31T02:01:23.154808+0000","last_undegraded":"2023-08-31T02:01:23.154808+0000","last_fullsized":"2023-08-31T02:01:23.154808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154984+0000","last_change":"2023-08-31T02:01:21.490055+0000","last_active":"2023-08-31T02:01:23.154984+0000","last_peered":"2023-08-31T02:01:23.154984+0000","last_clean":"2023-08-31T02:01:23.154984+0000","last_became_active":"2023-08-31T02:01:21.489759+0000","last_became_peered":"2023-08-31T02:01:21.489759+0000","last_unstale":"2023-08-31T02:01:23.154984+0000","last_undegraded":"2023-08-31T02:01:23.154984+0000","last_fullsized":"2023-08-31T02:01:23.154984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154938+0000","last_change":"2023-08-31T02:01:21.488296+0000","last_active":"2023-08-31T02:01:23.154938+0000","last_peered":"2023-08-31T02:01:23.154938+0000","last_clean":"2023-08-31T02:01:23.154938+0000","last_became_active":"2023-08-31T02:01:21.487819+0000","last_became_peered":"2023-08-31T02:01:21.487819+0000","last_unstale":"2023-08-31T02:01:23.154938+0000","last_undegraded":"2023-08-31T02:01:23.154938+0000","last_fullsized":"2023-08-31T02:01:23.154938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:25:18.019269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154497+0000","last_change":"2023-08-31T02:01:20.465896+0000","last_active":"2023-08-31T02:01:23.154497+0000","last_peered":"2023-08-31T02:01:23.154497+0000","last_clean":"2023-08-31T02:01:23.154497+0000","last_became_active":"2023-08-31T02:01:20.465615+0000","last_became_peered":"2023-08-31T02:01:20.465615+0000","last_unstale":"2023-08-31T02:01:23.154497+0000","last_undegraded":"2023-08-31T02:01:23.154497+0000","last_fullsized":"2023-08-31T02:01:23.154497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154718+0000","last_change":"2023-08-31T02:01:21.484891+0000","last_active":"2023-08-31T02:01:23.154718+0000","last_peered":"2023-08-31T02:01:23.154718+0000","last_clean":"2023-08-31T02:01:23.154718+0000","last_became_active":"2023-08-31T02:01:21.484626+0000","last_became_peered":"2023-08-31T02:01:21.484626+0000","last_unstale":"2023-08-31T02:01:23.154718+0000","last_undegraded":"2023-08-31T02:01:23.154718+0000","last_fullsized":"2023-08-31T02:01:23.154718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154252+0000","last_change":"2023-08-31T02:01:20.473610+0000","last_active":"2023-08-31T02:01:23.154252+0000","last_peered":"2023-08-31T02:01:23.154252+0000","last_clean":"2023-08-31T02:01:23.154252+0000","last_became_active":"2023-08-31T02:01:20.473370+0000","last_became_peered":"2023-08-31T02:01:20.473370+0000","last_unstale":"2023-08-31T02:01:23.154252+0000","last_undegraded":"2023-08-31T02:01:23.154252+0000","last_fullsized":"2023-08-31T02:01:23.154252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473534+0000","last_change":"2023-08-31T02:01:21.489900+0000","last_active":"2023-08-31T02:01:22.473534+0000","last_peered":"2023-08-31T02:01:22.473534+0000","last_clean":"2023-08-31T02:01:22.473534+0000","last_became_active":"2023-08-31T02:01:21.489618+0000","last_became_peered":"2023-08-31T02:01:21.489618+0000","last_unstale":"2023-08-31T02:01:22.473534+0000","last_undegraded":"2023-08-31T02:01:22.473534+0000","last_fullsized":"2023-08-31T02:01:22.473534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:20:04.767310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.505391+0000","last_change":"2023-08-31T02:01:20.471317+0000","last_active":"2023-08-31T02:01:21.505391+0000","last_peered":"2023-08-31T02:01:21.505391+0000","last_clean":"2023-08-31T02:01:21.505391+0000","last_became_active":"2023-08-31T02:01:20.471011+0000","last_became_peered":"2023-08-31T02:01:20.471011+0000","last_unstale":"2023-08-31T02:01:21.505391+0000","last_undegraded":"2023-08-31T02:01:21.505391+0000","last_fullsized":"2023-08-31T02:01:21.505391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:21:00.580032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473009+0000","last_change":"2023-08-31T02:01:21.494971+0000","last_active":"2023-08-31T02:01:22.473009+0000","last_peered":"2023-08-31T02:01:22.473009+0000","last_clean":"2023-08-31T02:01:22.473009+0000","last_became_active":"2023-08-31T02:01:21.494720+0000","last_became_peered":"2023-08-31T02:01:21.494720+0000","last_unstale":"2023-08-31T02:01:22.473009+0000","last_undegraded":"2023-08-31T02:01:22.473009+0000","last_fullsized":"2023-08-31T02:01:22.473009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473465+0000","last_change":"2023-08-31T02:01:20.473405+0000","last_active":"2023-08-31T02:01:22.473465+0000","last_peered":"2023-08-31T02:01:22.473465+0000","last_clean":"2023-08-31T02:01:22.473465+0000","last_became_active":"2023-08-31T02:01:20.473136+0000","last_became_peered":"2023-08-31T02:01:20.473136+0000","last_unstale":"2023-08-31T02:01:22.473465+0000","last_undegraded":"2023-08-31T02:01:22.473465+0000","last_fullsized":"2023-08-31T02:01:22.473465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:41:52.204278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154011+0000","last_change":"2023-08-31T02:01:21.492984+0000","last_active":"2023-08-31T02:01:23.154011+0000","last_peered":"2023-08-31T02:01:23.154011+0000","last_clean":"2023-08-31T02:01:23.154011+0000","last_became_active":"2023-08-31T02:01:21.492715+0000","last_became_peered":"2023-08-31T02:01:21.492715+0000","last_unstale":"2023-08-31T02:01:23.154011+0000","last_undegraded":"2023-08-31T02:01:23.154011+0000","last_fullsized":"2023-08-31T02:01:23.154011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474381+0000","last_change":"2023-08-31T02:01:20.473298+0000","last_active":"2023-08-31T02:01:22.474381+0000","last_peered":"2023-08-31T02:01:22.474381+0000","last_clean":"2023-08-31T02:01:22.474381+0000","last_became_active":"2023-08-31T02:01:20.473015+0000","last_became_peered":"2023-08-31T02:01:20.473015+0000","last_unstale":"2023-08-31T02:01:22.474381+0000","last_undegraded":"2023-08-31T02:01:22.474381+0000","last_fullsized":"2023-08-31T02:01:22.474381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:30:14.876894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474030+0000","last_change":"2023-08-31T02:01:21.490644+0000","last_active":"2023-08-31T02:01:22.474030+0000","last_peered":"2023-08-31T02:01:22.474030+0000","last_clean":"2023-08-31T02:01:22.474030+0000","last_became_active":"2023-08-31T02:01:21.490332+0000","last_became_peered":"2023-08-31T02:01:21.490332+0000","last_unstale":"2023-08-31T02:01:22.474030+0000","last_undegraded":"2023-08-31T02:01:22.474030+0000","last_fullsized":"2023-08-31T02:01:22.474030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:45:38.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154648+0000","last_change":"2023-08-31T02:01:20.477111+0000","last_active":"2023-08-31T02:01:23.154648+0000","last_peered":"2023-08-31T02:01:23.154648+0000","last_clean":"2023-08-31T02:01:23.154648+0000","last_became_active":"2023-08-31T02:01:20.476863+0000","last_became_peered":"2023-08-31T02:01:20.476863+0000","last_unstale":"2023-08-31T02:01:23.154648+0000","last_undegraded":"2023-08-31T02:01:23.154648+0000","last_fullsized":"2023-08-31T02:01:23.154648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:07:00.980903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473095+0000","last_change":"2023-08-31T02:01:21.487297+0000","last_active":"2023-08-31T02:01:22.473095+0000","last_peered":"2023-08-31T02:01:22.473095+0000","last_clean":"2023-08-31T02:01:22.473095+0000","last_became_active":"2023-08-31T02:01:21.487044+0000","last_became_peered":"2023-08-31T02:01:21.487044+0000","last_unstale":"2023-08-31T02:01:22.473095+0000","last_undegraded":"2023-08-31T02:01:22.473095+0000","last_fullsized":"2023-08-31T02:01:22.473095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480555+0000","last_change":"2023-08-31T02:01:20.476124+0000","last_active":"2023-08-31T02:01:21.480555+0000","last_peered":"2023-08-31T02:01:21.480555+0000","last_clean":"2023-08-31T02:01:21.480555+0000","last_became_active":"2023-08-31T02:01:20.475839+0000","last_became_peered":"2023-08-31T02:01:20.475839+0000","last_unstale":"2023-08-31T02:01:21.480555+0000","last_undegraded":"2023-08-31T02:01:21.480555+0000","last_fullsized":"2023-08-31T02:01:21.480555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473036+0000","last_change":"2023-08-31T02:01:21.488464+0000","last_active":"2023-08-31T02:01:22.473036+0000","last_peered":"2023-08-31T02:01:22.473036+0000","last_clean":"2023-08-31T02:01:22.473036+0000","last_became_active":"2023-08-31T02:01:21.487547+0000","last_became_peered":"2023-08-31T02:01:21.487547+0000","last_unstale":"2023-08-31T02:01:22.473036+0000","last_undegraded":"2023-08-31T02:01:22.473036+0000","last_fullsized":"2023-08-31T02:01:22.473036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472884+0000","last_change":"2023-08-31T02:01:20.463335+0000","last_active":"2023-08-31T02:01:22.472884+0000","last_peered":"2023-08-31T02:01:22.472884+0000","last_clean":"2023-08-31T02:01:22.472884+0000","last_became_active":"2023-08-31T02:01:20.463073+0000","last_became_peered":"2023-08-31T02:01:20.463073+0000","last_unstale":"2023-08-31T02:01:22.472884+0000","last_undegraded":"2023-08-31T02:01:22.472884+0000","last_fullsized":"2023-08-31T02:01:22.472884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:35:51.541453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154755+0000","last_change":"2023-08-31T02:01:21.494127+0000","last_active":"2023-08-31T02:01:23.154755+0000","last_peered":"2023-08-31T02:01:23.154755+0000","last_clean":"2023-08-31T02:01:23.154755+0000","last_became_active":"2023-08-31T02:01:21.491465+0000","last_became_peered":"2023-08-31T02:01:21.491465+0000","last_unstale":"2023-08-31T02:01:23.154755+0000","last_undegraded":"2023-08-31T02:01:23.154755+0000","last_fullsized":"2023-08-31T02:01:23.154755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:36:48.080941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473047+0000","last_change":"2023-08-31T02:01:20.472411+0000","last_active":"2023-08-31T02:01:22.473047+0000","last_peered":"2023-08-31T02:01:22.473047+0000","last_clean":"2023-08-31T02:01:22.473047+0000","last_became_active":"2023-08-31T02:01:20.472124+0000","last_became_peered":"2023-08-31T02:01:20.472124+0000","last_unstale":"2023-08-31T02:01:22.473047+0000","last_undegraded":"2023-08-31T02:01:22.473047+0000","last_fullsized":"2023-08-31T02:01:22.473047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154748+0000","last_change":"2023-08-31T02:01:21.494040+0000","last_active":"2023-08-31T02:01:23.154748+0000","last_peered":"2023-08-31T02:01:23.154748+0000","last_clean":"2023-08-31T02:01:23.154748+0000","last_became_active":"2023-08-31T02:01:21.493350+0000","last_became_peered":"2023-08-31T02:01:21.493350+0000","last_unstale":"2023-08-31T02:01:23.154748+0000","last_undegraded":"2023-08-31T02:01:23.154748+0000","last_fullsized":"2023-08-31T02:01:23.154748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474606+0000","last_change":"2023-08-31T02:01:20.475643+0000","last_active":"2023-08-31T02:01:22.474606+0000","last_peered":"2023-08-31T02:01:22.474606+0000","last_clean":"2023-08-31T02:01:22.474606+0000","last_became_active":"2023-08-31T02:01:20.475359+0000","last_became_peered":"2023-08-31T02:01:20.475359+0000","last_unstale":"2023-08-31T02:01:22.474606+0000","last_undegraded":"2023-08-31T02:01:22.474606+0000","last_fullsized":"2023-08-31T02:01:22.474606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:55:58.223598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154159+0000","last_change":"2023-08-31T02:01:21.486994+0000","last_active":"2023-08-31T02:01:23.154159+0000","last_peered":"2023-08-31T02:01:23.154159+0000","last_clean":"2023-08-31T02:01:23.154159+0000","last_became_active":"2023-08-31T02:01:21.485891+0000","last_became_peered":"2023-08-31T02:01:21.485891+0000","last_unstale":"2023-08-31T02:01:23.154159+0000","last_undegraded":"2023-08-31T02:01:23.154159+0000","last_fullsized":"2023-08-31T02:01:23.154159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474693+0000","last_change":"2023-08-31T02:01:20.474688+0000","last_active":"2023-08-31T02:01:22.474693+0000","last_peered":"2023-08-31T02:01:22.474693+0000","last_clean":"2023-08-31T02:01:22.474693+0000","last_became_active":"2023-08-31T02:01:20.474417+0000","last_became_peered":"2023-08-31T02:01:20.474417+0000","last_unstale":"2023-08-31T02:01:22.474693+0000","last_undegraded":"2023-08-31T02:01:22.474693+0000","last_fullsized":"2023-08-31T02:01:22.474693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473576+0000","last_change":"2023-08-31T02:01:21.481153+0000","last_active":"2023-08-31T02:01:22.473576+0000","last_peered":"2023-08-31T02:01:22.473576+0000","last_clean":"2023-08-31T02:01:22.473576+0000","last_became_active":"2023-08-31T02:01:21.480678+0000","last_became_peered":"2023-08-31T02:01:21.480678+0000","last_unstale":"2023-08-31T02:01:22.473576+0000","last_undegraded":"2023-08-31T02:01:22.473576+0000","last_fullsized":"2023-08-31T02:01:22.473576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:57:05.075975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472919+0000","last_change":"2023-08-31T02:01:20.474897+0000","last_active":"2023-08-31T02:01:22.472919+0000","last_peered":"2023-08-31T02:01:22.472919+0000","last_clean":"2023-08-31T02:01:22.472919+0000","last_became_active":"2023-08-31T02:01:20.474227+0000","last_became_peered":"2023-08-31T02:01:20.474227+0000","last_unstale":"2023-08-31T02:01:22.472919+0000","last_undegraded":"2023-08-31T02:01:22.472919+0000","last_fullsized":"2023-08-31T02:01:22.472919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:27:01.281075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153851+0000","last_change":"2023-08-31T02:01:21.487392+0000","last_active":"2023-08-31T02:01:23.153851+0000","last_peered":"2023-08-31T02:01:23.153851+0000","last_clean":"2023-08-31T02:01:23.153851+0000","last_became_active":"2023-08-31T02:01:21.487162+0000","last_became_peered":"2023-08-31T02:01:21.487162+0000","last_unstale":"2023-08-31T02:01:23.153851+0000","last_undegraded":"2023-08-31T02:01:23.153851+0000","last_fullsized":"2023-08-31T02:01:23.153851+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:03:14.004941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472807+0000","last_change":"2023-08-31T02:01:20.480632+0000","last_active":"2023-08-31T02:01:22.472807+0000","last_peered":"2023-08-31T02:01:22.472807+0000","last_clean":"2023-08-31T02:01:22.472807+0000","last_became_active":"2023-08-31T02:01:20.480307+0000","last_became_peered":"2023-08-31T02:01:20.480307+0000","last_unstale":"2023-08-31T02:01:22.472807+0000","last_undegraded":"2023-08-31T02:01:22.472807+0000","last_fullsized":"2023-08-31T02:01:22.472807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:27:43.975042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472537+0000","last_change":"2023-08-31T02:01:21.492360+0000","last_active":"2023-08-31T02:01:22.472537+0000","last_peered":"2023-08-31T02:01:22.472537+0000","last_clean":"2023-08-31T02:01:22.472537+0000","last_became_active":"2023-08-31T02:01:21.492055+0000","last_became_peered":"2023-08-31T02:01:21.492055+0000","last_unstale":"2023-08-31T02:01:22.472537+0000","last_undegraded":"2023-08-31T02:01:22.472537+0000","last_fullsized":"2023-08-31T02:01:22.472537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:11:26.379116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.483785+0000","last_change":"2023-08-31T02:01:20.476024+0000","last_active":"2023-08-31T02:01:21.483785+0000","last_peered":"2023-08-31T02:01:21.483785+0000","last_clean":"2023-08-31T02:01:21.483785+0000","last_became_active":"2023-08-31T02:01:20.475698+0000","last_became_peered":"2023-08-31T02:01:20.475698+0000","last_unstale":"2023-08-31T02:01:21.483785+0000","last_undegraded":"2023-08-31T02:01:21.483785+0000","last_fullsized":"2023-08-31T02:01:21.483785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154659+0000","last_change":"2023-08-31T02:01:21.494582+0000","last_active":"2023-08-31T02:01:23.154659+0000","last_peered":"2023-08-31T02:01:23.154659+0000","last_clean":"2023-08-31T02:01:23.154659+0000","last_became_active":"2023-08-31T02:01:21.494273+0000","last_became_peered":"2023-08-31T02:01:21.494273+0000","last_unstale":"2023-08-31T02:01:23.154659+0000","last_undegraded":"2023-08-31T02:01:23.154659+0000","last_fullsized":"2023-08-31T02:01:23.154659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154231+0000","last_change":"2023-08-31T02:01:20.466640+0000","last_active":"2023-08-31T02:01:23.154231+0000","last_peered":"2023-08-31T02:01:23.154231+0000","last_clean":"2023-08-31T02:01:23.154231+0000","last_became_active":"2023-08-31T02:01:20.466315+0000","last_became_peered":"2023-08-31T02:01:20.466315+0000","last_unstale":"2023-08-31T02:01:23.154231+0000","last_undegraded":"2023-08-31T02:01:23.154231+0000","last_fullsized":"2023-08-31T02:01:23.154231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472600+0000","last_change":"2023-08-31T02:01:21.488792+0000","last_active":"2023-08-31T02:01:22.472600+0000","last_peered":"2023-08-31T02:01:22.472600+0000","last_clean":"2023-08-31T02:01:22.472600+0000","last_became_active":"2023-08-31T02:01:21.488218+0000","last_became_peered":"2023-08-31T02:01:21.488218+0000","last_unstale":"2023-08-31T02:01:22.472600+0000","last_undegraded":"2023-08-31T02:01:22.472600+0000","last_fullsized":"2023-08-31T02:01:22.472600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:52:33.978805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155040+0000","last_change":"2023-08-31T02:01:20.476965+0000","last_active":"2023-08-31T02:01:23.155040+0000","last_peered":"2023-08-31T02:01:23.155040+0000","last_clean":"2023-08-31T02:01:23.155040+0000","last_became_active":"2023-08-31T02:01:20.476698+0000","last_became_peered":"2023-08-31T02:01:20.476698+0000","last_unstale":"2023-08-31T02:01:23.155040+0000","last_undegraded":"2023-08-31T02:01:23.155040+0000","last_fullsized":"2023-08-31T02:01:23.155040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:48:01.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472783+0000","last_change":"2023-08-31T02:01:21.493915+0000","last_active":"2023-08-31T02:01:22.472783+0000","last_peered":"2023-08-31T02:01:22.472783+0000","last_clean":"2023-08-31T02:01:22.472783+0000","last_became_active":"2023-08-31T02:01:21.493676+0000","last_became_peered":"2023-08-31T02:01:21.493676+0000","last_unstale":"2023-08-31T02:01:22.472783+0000","last_undegraded":"2023-08-31T02:01:22.472783+0000","last_fullsized":"2023-08-31T02:01:22.472783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:51.003199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474583+0000","last_change":"2023-08-31T02:01:20.477508+0000","last_active":"2023-08-31T02:01:22.474583+0000","last_peered":"2023-08-31T02:01:22.474583+0000","last_clean":"2023-08-31T02:01:22.474583+0000","last_became_active":"2023-08-31T02:01:20.477260+0000","last_became_peered":"2023-08-31T02:01:20.477260+0000","last_unstale":"2023-08-31T02:01:22.474583+0000","last_undegraded":"2023-08-31T02:01:22.474583+0000","last_fullsized":"2023-08-31T02:01:22.474583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:44:05.421419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474724+0000","last_change":"2023-08-31T02:01:21.491870+0000","last_active":"2023-08-31T02:01:22.474724+0000","last_peered":"2023-08-31T02:01:22.474724+0000","last_clean":"2023-08-31T02:01:22.474724+0000","last_became_active":"2023-08-31T02:01:21.491592+0000","last_became_peered":"2023-08-31T02:01:21.491592+0000","last_unstale":"2023-08-31T02:01:22.474724+0000","last_undegraded":"2023-08-31T02:01:22.474724+0000","last_fullsized":"2023-08-31T02:01:22.474724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:33.804656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473493+0000","last_change":"2023-08-31T02:01:20.475956+0000","last_active":"2023-08-31T02:01:22.473493+0000","last_peered":"2023-08-31T02:01:22.473493+0000","last_clean":"2023-08-31T02:01:22.473493+0000","last_became_active":"2023-08-31T02:01:20.475694+0000","last_became_peered":"2023-08-31T02:01:20.475694+0000","last_unstale":"2023-08-31T02:01:22.473493+0000","last_undegraded":"2023-08-31T02:01:22.473493+0000","last_fullsized":"2023-08-31T02:01:22.473493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473616+0000","last_change":"2023-08-31T02:01:21.491382+0000","last_active":"2023-08-31T02:01:22.473616+0000","last_peered":"2023-08-31T02:01:22.473616+0000","last_clean":"2023-08-31T02:01:22.473616+0000","last_became_active":"2023-08-31T02:01:21.491114+0000","last_became_peered":"2023-08-31T02:01:21.491114+0000","last_unstale":"2023-08-31T02:01:22.473616+0000","last_undegraded":"2023-08-31T02:01:22.473616+0000","last_fullsized":"2023-08-31T02:01:22.473616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154526+0000","last_change":"2023-08-31T02:01:20.474505+0000","last_active":"2023-08-31T02:01:23.154526+0000","last_peered":"2023-08-31T02:01:23.154526+0000","last_clean":"2023-08-31T02:01:23.154526+0000","last_became_active":"2023-08-31T02:01:20.474179+0000","last_became_peered":"2023-08-31T02:01:20.474179+0000","last_unstale":"2023-08-31T02:01:23.154526+0000","last_undegraded":"2023-08-31T02:01:23.154526+0000","last_fullsized":"2023-08-31T02:01:23.154526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:02:02.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154570+0000","last_change":"2023-08-31T02:01:21.491206+0000","last_active":"2023-08-31T02:01:23.154570+0000","last_peered":"2023-08-31T02:01:23.154570+0000","last_clean":"2023-08-31T02:01:23.154570+0000","last_became_active":"2023-08-31T02:01:21.490947+0000","last_became_peered":"2023-08-31T02:01:21.490947+0000","last_unstale":"2023-08-31T02:01:23.154570+0000","last_undegraded":"2023-08-31T02:01:23.154570+0000","last_fullsized":"2023-08-31T02:01:23.154570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:33:55.955512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480898+0000","last_change":"2023-08-31T02:01:20.475069+0000","last_active":"2023-08-31T02:01:21.480898+0000","last_peered":"2023-08-31T02:01:21.480898+0000","last_clean":"2023-08-31T02:01:21.480898+0000","last_became_active":"2023-08-31T02:01:20.474780+0000","last_became_peered":"2023-08-31T02:01:20.474780+0000","last_unstale":"2023-08-31T02:01:21.480898+0000","last_undegraded":"2023-08-31T02:01:21.480898+0000","last_fullsized":"2023-08-31T02:01:21.480898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:16.303270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155214+0000","last_change":"2023-08-31T02:01:21.494374+0000","last_active":"2023-08-31T02:01:23.155214+0000","last_peered":"2023-08-31T02:01:23.155214+0000","last_clean":"2023-08-31T02:01:23.155214+0000","last_became_active":"2023-08-31T02:01:21.494077+0000","last_became_peered":"2023-08-31T02:01:21.494077+0000","last_unstale":"2023-08-31T02:01:23.155214+0000","last_undegraded":"2023-08-31T02:01:23.155214+0000","last_fullsized":"2023-08-31T02:01:23.155214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:19:25.263827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154576+0000","last_change":"2023-08-31T02:01:20.467838+0000","last_active":"2023-08-31T02:01:23.154576+0000","last_peered":"2023-08-31T02:01:23.154576+0000","last_clean":"2023-08-31T02:01:23.154576+0000","last_became_active":"2023-08-31T02:01:20.467567+0000","last_became_peered":"2023-08-31T02:01:20.467567+0000","last_unstale":"2023-08-31T02:01:23.154576+0000","last_undegraded":"2023-08-31T02:01:23.154576+0000","last_fullsized":"2023-08-31T02:01:23.154576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:27:02.795050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154093+0000","last_change":"2023-08-31T02:01:21.491262+0000","last_active":"2023-08-31T02:01:23.154093+0000","last_peered":"2023-08-31T02:01:23.154093+0000","last_clean":"2023-08-31T02:01:23.154093+0000","last_became_active":"2023-08-31T02:01:21.490982+0000","last_became_peered":"2023-08-31T02:01:21.490982+0000","last_unstale":"2023-08-31T02:01:23.154093+0000","last_undegraded":"2023-08-31T02:01:23.154093+0000","last_fullsized":"2023-08-31T02:01:23.154093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:38:48.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154338+0000","last_change":"2023-08-31T02:01:20.469596+0000","last_active":"2023-08-31T02:01:23.154338+0000","last_peered":"2023-08-31T02:01:23.154338+0000","last_clean":"2023-08-31T02:01:23.154338+0000","last_became_active":"2023-08-31T02:01:20.469290+0000","last_became_peered":"2023-08-31T02:01:20.469290+0000","last_unstale":"2023-08-31T02:01:23.154338+0000","last_undegraded":"2023-08-31T02:01:23.154338+0000","last_fullsized":"2023-08-31T02:01:23.154338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:27:42.568205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474353+0000","last_change":"2023-08-31T02:01:21.493623+0000","last_active":"2023-08-31T02:01:22.474353+0000","last_peered":"2023-08-31T02:01:22.474353+0000","last_clean":"2023-08-31T02:01:22.474353+0000","last_became_active":"2023-08-31T02:01:21.493369+0000","last_became_peered":"2023-08-31T02:01:21.493369+0000","last_unstale":"2023-08-31T02:01:22.474353+0000","last_undegraded":"2023-08-31T02:01:22.474353+0000","last_fullsized":"2023-08-31T02:01:22.474353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:07:26.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:20.474557+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:20.474269+0000","last_became_peered":"2023-08-31T02:01:20.474269+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472721+0000","last_change":"2023-08-31T02:01:21.488629+0000","last_active":"2023-08-31T02:01:22.472721+0000","last_peered":"2023-08-31T02:01:22.472721+0000","last_clean":"2023-08-31T02:01:22.472721+0000","last_became_active":"2023-08-31T02:01:21.487877+0000","last_became_peered":"2023-08-31T02:01:21.487877+0000","last_unstale":"2023-08-31T02:01:22.472721+0000","last_undegraded":"2023-08-31T02:01:22.472721+0000","last_fullsized":"2023-08-31T02:01:22.472721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:14:52.730169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153853+0000","last_change":"2023-08-31T02:01:20.474084+0000","last_active":"2023-08-31T02:01:23.153853+0000","last_peered":"2023-08-31T02:01:23.153853+0000","last_clean":"2023-08-31T02:01:23.153853+0000","last_became_active":"2023-08-31T02:01:20.473811+0000","last_became_peered":"2023-08-31T02:01:20.473811+0000","last_unstale":"2023-08-31T02:01:23.153853+0000","last_undegraded":"2023-08-31T02:01:23.153853+0000","last_fullsized":"2023-08-31T02:01:23.153853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:18:30.609765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154520+0000","last_change":"2023-08-31T02:01:21.490256+0000","last_active":"2023-08-31T02:01:23.154520+0000","last_peered":"2023-08-31T02:01:23.154520+0000","last_clean":"2023-08-31T02:01:23.154520+0000","last_became_active":"2023-08-31T02:01:21.489987+0000","last_became_peered":"2023-08-31T02:01:21.489987+0000","last_unstale":"2023-08-31T02:01:23.154520+0000","last_undegraded":"2023-08-31T02:01:23.154520+0000","last_fullsized":"2023-08-31T02:01:23.154520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474465+0000","last_change":"2023-08-31T02:01:20.474116+0000","last_active":"2023-08-31T02:01:22.474465+0000","last_peered":"2023-08-31T02:01:22.474465+0000","last_clean":"2023-08-31T02:01:22.474465+0000","last_became_active":"2023-08-31T02:01:20.473855+0000","last_became_peered":"2023-08-31T02:01:20.473855+0000","last_unstale":"2023-08-31T02:01:22.474465+0000","last_undegraded":"2023-08-31T02:01:22.474465+0000","last_fullsized":"2023-08-31T02:01:22.474465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:41:18.994166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154931+0000","last_change":"2023-08-31T02:01:21.494457+0000","last_active":"2023-08-31T02:01:23.154931+0000","last_peered":"2023-08-31T02:01:23.154931+0000","last_clean":"2023-08-31T02:01:23.154931+0000","last_became_active":"2023-08-31T02:01:21.493732+0000","last_became_peered":"2023-08-31T02:01:21.493732+0000","last_unstale":"2023-08-31T02:01:23.154931+0000","last_undegraded":"2023-08-31T02:01:23.154931+0000","last_fullsized":"2023-08-31T02:01:23.154931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:35:31.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.600588+0000","last_change":"2023-08-31T02:01:20.474656+0000","last_active":"2023-08-31T02:01:23.600588+0000","last_peered":"2023-08-31T02:01:23.600588+0000","last_clean":"2023-08-31T02:01:23.600588+0000","last_became_active":"2023-08-31T02:01:20.474369+0000","last_became_peered":"2023-08-31T02:01:20.474369+0000","last_unstale":"2023-08-31T02:01:23.600588+0000","last_undegraded":"2023-08-31T02:01:23.600588+0000","last_fullsized":"2023-08-31T02:01:23.600588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:45:00.848193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473070+0000","last_change":"2023-08-31T02:01:21.477794+0000","last_active":"2023-08-31T02:01:22.473070+0000","last_peered":"2023-08-31T02:01:22.473070+0000","last_clean":"2023-08-31T02:01:22.473070+0000","last_became_active":"2023-08-31T02:01:21.477508+0000","last_became_peered":"2023-08-31T02:01:21.477508+0000","last_unstale":"2023-08-31T02:01:22.473070+0000","last_undegraded":"2023-08-31T02:01:22.473070+0000","last_fullsized":"2023-08-31T02:01:22.473070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:46:12.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154313+0000","last_change":"2023-08-31T02:01:20.474392+0000","last_active":"2023-08-31T02:01:23.154313+0000","last_peered":"2023-08-31T02:01:23.154313+0000","last_clean":"2023-08-31T02:01:23.154313+0000","last_became_active":"2023-08-31T02:01:20.473883+0000","last_became_peered":"2023-08-31T02:01:20.473883+0000","last_unstale":"2023-08-31T02:01:23.154313+0000","last_undegraded":"2023-08-31T02:01:23.154313+0000","last_fullsized":"2023-08-31T02:01:23.154313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:45:36.309094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.153979+0000","last_change":"2023-08-31T02:01:21.484480+0000","last_active":"2023-08-31T02:01:23.153979+0000","last_peered":"2023-08-31T02:01:23.153979+0000","last_clean":"2023-08-31T02:01:23.153979+0000","last_became_active":"2023-08-31T02:01:21.484215+0000","last_became_peered":"2023-08-31T02:01:21.484215+0000","last_unstale":"2023-08-31T02:01:23.153979+0000","last_undegraded":"2023-08-31T02:01:23.153979+0000","last_fullsized":"2023-08-31T02:01:23.153979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:19.236598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.154406+0000","last_change":"2023-08-31T02:01:20.470456+0000","last_active":"2023-08-31T02:01:23.154406+0000","last_peered":"2023-08-31T02:01:23.154406+0000","last_clean":"2023-08-31T02:01:23.154406+0000","last_became_active":"2023-08-31T02:01:20.470196+0000","last_became_peered":"2023-08-31T02:01:20.470196+0000","last_unstale":"2023-08-31T02:01:23.154406+0000","last_undegraded":"2023-08-31T02:01:23.154406+0000","last_fullsized":"2023-08-31T02:01:23.154406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155409+0000","last_change":"2023-08-31T02:01:21.491660+0000","last_active":"2023-08-31T02:01:23.155409+0000","last_peered":"2023-08-31T02:01:23.155409+0000","last_clean":"2023-08-31T02:01:23.155409+0000","last_became_active":"2023-08-31T02:01:21.491382+0000","last_became_peered":"2023-08-31T02:01:21.491382+0000","last_unstale":"2023-08-31T02:01:23.155409+0000","last_undegraded":"2023-08-31T02:01:23.155409+0000","last_fullsized":"2023-08-31T02:01:23.155409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:38:07.636282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155067+0000","last_change":"2023-08-31T02:01:20.473075+0000","last_active":"2023-08-31T02:01:23.155067+0000","last_peered":"2023-08-31T02:01:23.155067+0000","last_clean":"2023-08-31T02:01:23.155067+0000","last_became_active":"2023-08-31T02:01:20.472816+0000","last_became_peered":"2023-08-31T02:01:20.472816+0000","last_unstale":"2023-08-31T02:01:23.155067+0000","last_undegraded":"2023-08-31T02:01:23.155067+0000","last_fullsized":"2023-08-31T02:01:23.155067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.473306+0000","last_change":"2023-08-31T02:01:21.480979+0000","last_active":"2023-08-31T02:01:22.473306+0000","last_peered":"2023-08-31T02:01:22.473306+0000","last_clean":"2023-08-31T02:01:22.473306+0000","last_became_active":"2023-08-31T02:01:21.480663+0000","last_became_peered":"2023-08-31T02:01:21.480663+0000","last_unstale":"2023-08-31T02:01:22.473306+0000","last_undegraded":"2023-08-31T02:01:22.473306+0000","last_fullsized":"2023-08-31T02:01:22.473306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:22:31.377063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472970+0000","last_change":"2023-08-31T02:01:20.471925+0000","last_active":"2023-08-31T02:01:22.472970+0000","last_peered":"2023-08-31T02:01:22.472970+0000","last_clean":"2023-08-31T02:01:22.472970+0000","last_became_active":"2023-08-31T02:01:20.471633+0000","last_became_peered":"2023-08-31T02:01:20.471633+0000","last_unstale":"2023-08-31T02:01:22.472970+0000","last_undegraded":"2023-08-31T02:01:22.472970+0000","last_fullsized":"2023-08-31T02:01:22.472970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:01:06.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155077+0000","last_change":"2023-08-31T02:01:21.490803+0000","last_active":"2023-08-31T02:01:23.155077+0000","last_peered":"2023-08-31T02:01:23.155077+0000","last_clean":"2023-08-31T02:01:23.155077+0000","last_became_active":"2023-08-31T02:01:21.490535+0000","last_became_peered":"2023-08-31T02:01:21.490535+0000","last_unstale":"2023-08-31T02:01:23.155077+0000","last_undegraded":"2023-08-31T02:01:23.155077+0000","last_fullsized":"2023-08-31T02:01:23.155077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:17:07.573441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.472499+0000","last_change":"2023-08-31T02:01:20.473424+0000","last_active":"2023-08-31T02:01:22.472499+0000","last_peered":"2023-08-31T02:01:22.472499+0000","last_clean":"2023-08-31T02:01:22.472499+0000","last_became_active":"2023-08-31T02:01:20.473069+0000","last_became_peered":"2023-08-31T02:01:20.473069+0000","last_unstale":"2023-08-31T02:01:22.472499+0000","last_undegraded":"2023-08-31T02:01:22.472499+0000","last_fullsized":"2023-08-31T02:01:22.472499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:19:53.569012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:22.474460+0000","last_change":"2023-08-31T02:01:21.478455+0000","last_active":"2023-08-31T02:01:22.474460+0000","last_peered":"2023-08-31T02:01:22.474460+0000","last_clean":"2023-08-31T02:01:22.474460+0000","last_became_active":"2023-08-31T02:01:21.476993+0000","last_became_peered":"2023-08-31T02:01:21.476993+0000","last_unstale":"2023-08-31T02:01:22.474460+0000","last_undegraded":"2023-08-31T02:01:22.474460+0000","last_fullsized":"2023-08-31T02:01:22.474460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:20.452593+0000","last_clean_scrub_stamp":"2023-08-31T02:01:20.452593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:26:06.176307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155095+0000","last_change":"2023-08-31T02:01:20.477325+0000","last_active":"2023-08-31T02:01:23.155095+0000","last_peered":"2023-08-31T02:01:23.155095+0000","last_clean":"2023-08-31T02:01:23.155095+0000","last_became_active":"2023-08-31T02:01:20.476450+0000","last_became_peered":"2023-08-31T02:01:20.476450+0000","last_unstale":"2023-08-31T02:01:23.155095+0000","last_undegraded":"2023-08-31T02:01:23.155095+0000","last_fullsized":"2023-08-31T02:01:23.155095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T02:01:19.448346+0000","last_clean_scrub_stamp":"2023-08-31T02:01:19.448346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:57:11.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T02:01:21.480301+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:21.480301+0000","last_peered":"2023-08-31T02:01:21.480301+0000","last_clean":"2023-08-31T02:01:21.480301+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:21.480301+0000","last_undegraded":"2023-08-31T02:01:21.480301+0000","last_fullsized":"2023-08-31T02:01:21.480301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.495}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.74,"5min":11.74,"15min":11.74},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.879},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":11.707000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.659000000000001,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.747},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":11.628,"5min":11.628,"15min":11.628},"last":0.82699999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1069056,"data_stored":789651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":788003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.62}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":197713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.626},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57699999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.309},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.6799999999999997,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.71,"5min":5.71,"15min":5.71},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.621},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.8579999999999997,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.64900000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":199247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.308}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.372},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.45300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.495},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.627}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":198183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.8460000000000001,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:30.491 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T02:01:30.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T02:01:30.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.662+0000 7f176002b700 1 -- 172.21.15.84:0/465111777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175815b790 msgr2=0x7f175806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.662+0000 7f176002b700 1 --2- 172.21.15.84:0/465111777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175815b790 0x7f175806c720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17480098c0 tx=0x7f1748009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.662+0000 7f176002b700 1 -- 172.21.15.84:0/465111777 shutdown_connections 2023-08-31T02:01:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.662+0000 7f176002b700 1 --2- 172.21.15.84:0/465111777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175815b790 0x7f175806c720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.662+0000 7f176002b700 1 --2- 172.21.15.84:0/465111777 >> v2:172.21.15.170:3300/0 conn(0x7f17580ca2d0 0x7f17580cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.662+0000 7f176002b700 1 -- 172.21.15.84:0/465111777 >> 172.21.15.84:0/465111777 conn(0x7f17580afb00 msgr2=0x7f17580aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.662+0000 7f176002b700 1 -- 172.21.15.84:0/465111777 shutdown_connections 2023-08-31T02:01:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.662+0000 7f176002b700 1 -- 172.21.15.84:0/465111777 wait complete. 2023-08-31T02:01:30.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.663+0000 7f176002b700 1 Processor -- start 2023-08-31T02:01:30.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.663+0000 7f176002b700 1 -- start start 2023-08-31T02:01:30.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f176002b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17580ca2d0 0x7f175806a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:30.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f176002b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175815b790 0x7f1758157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f176002b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175815bce0 0x7f17580ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f176002b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758158e10 con 0x7f17580ca2d0 2023-08-31T02:01:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f176002b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758158200 con 0x7f175815bce0 2023-08-31T02:01:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f176002b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17581584e0 con 0x7f175815b790 2023-08-31T02:01:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17580ca2d0 0x7f175806a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17580ca2d0 0x7f175806a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54024/0 (socket says 172.21.15.84:54024) 2023-08-31T02:01:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 -- 172.21.15.84:0/1156022528 learned_addr learned my addr 172.21.15.84:0/1156022528 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175d5c6700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175815b790 0x7f1758157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175e5c8700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175815bce0 0x7f17580ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 -- 172.21.15.84:0/1156022528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175815b790 msgr2=0x7f1758157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175815b790 0x7f1758157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 -- 172.21.15.84:0/1156022528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175815bce0 msgr2=0x7f17580ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175815bce0 0x7f17580ab3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 -- 172.21.15.84:0/1156022528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750009c40 con 0x7f17580ca2d0 2023-08-31T02:01:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f175ddc7700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17580ca2d0 0x7f175806a4a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c00 tx=0x7f174800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f174e7fc700 1 -- 172.21.15.84:0/1156022528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174800fbc0 con 0x7f17580ca2d0 2023-08-31T02:01:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f174e7fc700 1 -- 172.21.15.84:0/1156022528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f174800fd20 con 0x7f17580ca2d0 2023-08-31T02:01:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1748009520 con 0x7f17580ca2d0 2023-08-31T02:01:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f174e7fc700 1 -- 172.21.15.84:0/1156022528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748017660 con 0x7f17580ca2d0 2023-08-31T02:01:30.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.664+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1758158aa0 con 0x7f17580ca2d0 2023-08-31T02:01:30.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.665+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17581590f0 con 0x7f17580ca2d0 2023-08-31T02:01:30.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.666+0000 7f174e7fc700 1 -- 172.21.15.84:0/1156022528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f17480177c0 con 0x7f17580ca2d0 2023-08-31T02:01:30.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.666+0000 7f174e7fc700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f173c06a0e0 0x7f173c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:30.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.666+0000 7f174e7fc700 1 -- 172.21.15.84:0/1156022528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f174808a3c0 con 0x7f17580ca2d0 2023-08-31T02:01:30.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.666+0000 7f175d5c6700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f173c06a0e0 0x7f173c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:30.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.667+0000 7f175d5c6700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f173c06a0e0 0x7f173c06c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f17580aa980 tx=0x7f1754009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:30.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.671+0000 7f174e7fc700 1 -- 172.21.15.84:0/1156022528 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1748055a70 con 0x7f17580ca2d0 2023-08-31T02:01:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.937+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f175804e7c0 con 0x7f17580ca2d0 2023-08-31T02:01:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.941+0000 7f174e7fc700 1 -- 172.21.15.84:0/1156022528 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1748059090 con 0x7f17580ca2d0 2023-08-31T02:01:30.934 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-08-31T02:01:30.934 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDk8+9kFvODMBAAcqtqFr0KcUWEckdfvqYq2A== 2023-08-31T02:01:30.934 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-08-31T02:01:30.935 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-08-31T02:01:30.935 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-31T02:01:30.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f173c06a0e0 msgr2=0x7f173c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f173c06a0e0 0x7f173c06c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f17580aa980 tx=0x7f1754009040 comp rx=0 tx=0).stop 2023-08-31T02:01:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17580ca2d0 msgr2=0x7f175806a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17580ca2d0 0x7f175806a4a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c00 tx=0x7f174800f710 comp rx=0 tx=0).stop 2023-08-31T02:01:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 shutdown_connections 2023-08-31T02:01:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f173c06a0e0 0x7f173c06c5a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175815bce0 0x7f17580ab3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17580ca2d0 0x7f175806a4a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 --2- 172.21.15.84:0/1156022528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175815b790 0x7f1758157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:30.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 >> 172.21.15.84:0/1156022528 conn(0x7f17580afb00 msgr2=0x7f17580afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:30.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 shutdown_connections 2023-08-31T02:01:30.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:30.943+0000 7f176002b700 1 -- 172.21.15.84:0/1156022528 wait complete. 2023-08-31T02:01:30.939 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-08-31T02:01:30.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:31.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.078+0000 7faec760e700 1 -- 172.21.15.84:0/1802343558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 msgr2=0x7faec00cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.078+0000 7faec760e700 1 --2- 172.21.15.84:0/1802343558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 0x7faec00cc920 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7faec00cd570 tx=0x7faeb0009ba0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.078+0000 7faec760e700 1 -- 172.21.15.84:0/1802343558 shutdown_connections 2023-08-31T02:01:31.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.078+0000 7faec760e700 1 --2- 172.21.15.84:0/1802343558 >> v2:172.21.15.170:3300/0 conn(0x7faec00707c0 0x7faec0070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.078+0000 7faec760e700 1 --2- 172.21.15.84:0/1802343558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 0x7faec00cc920 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.078+0000 7faec760e700 1 -- 172.21.15.84:0/1802343558 >> 172.21.15.84:0/1802343558 conn(0x7faec00caa20 msgr2=0x7faec00cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:31.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.078+0000 7faec760e700 1 -- 172.21.15.84:0/1802343558 shutdown_connections 2023-08-31T02:01:31.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.078+0000 7faec760e700 1 -- 172.21.15.84:0/1802343558 wait complete. 2023-08-31T02:01:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.079+0000 7faec760e700 1 Processor -- start 2023-08-31T02:01:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.079+0000 7faec760e700 1 -- start start 2023-08-31T02:01:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec760e700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec00707c0 0x7faec014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec760e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faec00b0df0 0x7faec00c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec760e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 0x7faec00c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec760e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec01e3240 con 0x7faec0158220 2023-08-31T02:01:31.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec760e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec01e21a0 con 0x7faec00b0df0 2023-08-31T02:01:31.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec760e700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec01e2480 con 0x7faec00707c0 2023-08-31T02:01:31.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 0x7faec00c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 0x7faec00c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54042/0 (socket says 172.21.15.84:54042) 2023-08-31T02:01:31.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 -- 172.21.15.84:0/724822788 learned_addr learned my addr 172.21.15.84:0/724822788 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:31.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec4ba9700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faec00b0df0 0x7faec00c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec53aa700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec00707c0 0x7faec014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 -- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec00707c0 msgr2=0x7faec014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec00707c0 0x7faec014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 -- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faec00b0df0 msgr2=0x7faec00c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faec00b0df0 0x7faec00c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 -- 172.21.15.84:0/724822788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0009520 con 0x7faec0158220 2023-08-31T02:01:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec53aa700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec00707c0 0x7faec014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec5bab700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 0x7faec00c4220 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7faeb800b970 tx=0x7faeb800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faeb5ffb700 1 -- 172.21.15.84:0/724822788 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb800c9b0 con 0x7faec0158220 2023-08-31T02:01:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faeb5ffb700 1 -- 172.21.15.84:0/724822788 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faeb800cc20 con 0x7faec0158220 2023-08-31T02:01:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec01e2760 con 0x7faec0158220 2023-08-31T02:01:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.080+0000 7faeb5ffb700 1 -- 172.21.15.84:0/724822788 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8014440 con 0x7faec0158220 2023-08-31T02:01:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.081+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec01e2d20 con 0x7faec0158220 2023-08-31T02:01:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.081+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec006b100 con 0x7faec0158220 2023-08-31T02:01:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.082+0000 7faeb5ffb700 1 -- 172.21.15.84:0/724822788 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faeb801d3b0 con 0x7faec0158220 2023-08-31T02:01:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.082+0000 7faeb5ffb700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faea406a0e0 0x7faea406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.083+0000 7faec53aa700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faea406a0e0 0x7faea406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.083+0000 7faeb5ffb700 1 -- 172.21.15.84:0/724822788 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faeb8006e40 con 0x7faec0158220 2023-08-31T02:01:31.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.083+0000 7faec53aa700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faea406a0e0 0x7faea406c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faec00b2f10 tx=0x7faeb0019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:31.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.087+0000 7faeb5ffb700 1 -- 172.21.15.84:0/724822788 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faec006b100 con 0x7faec0158220 2023-08-31T02:01:31.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.323+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faec006b100 con 0x7faec0158220 2023-08-31T02:01:31.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.323+0000 7faeb5ffb700 1 -- 172.21.15.84:0/724822788 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7faec006b100 con 0x7faec0158220 2023-08-31T02:01:31.316 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:31.317 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5009,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3211732680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3211732680},{"type":"v1","addr":"172.21.15.170:6834","nonce":3211732680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5012,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2965794759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2965794759},{"type":"v1","addr":"172.21.15.170:6835","nonce":2965794759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2457559549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2457559549},{"type":"v1","addr":"172.21.15.84:6837","nonce":2457559549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T02:01:20.870197+0000","modified":"2023-08-31T02:01:24.485132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/915893970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":915893970},{"type":"v1","addr":"172.21.15.84:6836","nonce":915893970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T02:01:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faea406a0e0 msgr2=0x7faea406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faea406a0e0 0x7faea406c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faec00b2f10 tx=0x7faeb0019040 comp rx=0 tx=0).stop 2023-08-31T02:01:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 msgr2=0x7faec00c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 0x7faec00c4220 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7faeb800b970 tx=0x7faeb800bd30 comp rx=0 tx=0).stop 2023-08-31T02:01:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 shutdown_connections 2023-08-31T02:01:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7faea406a0e0 0x7faea406c5a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faec0158220 0x7faec00c4220 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec00707c0 0x7faec014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 --2- 172.21.15.84:0/724822788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faec00b0df0 0x7faec00c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.325+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 >> 172.21.15.84:0/724822788 conn(0x7faec00caa20 msgr2=0x7faec00b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:31.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.326+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 shutdown_connections 2023-08-31T02:01:31.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.326+0000 7faec760e700 1 -- 172.21.15.84:0/724822788 wait complete. 2023-08-31T02:01:31.321 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-08-31T02:01:31.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T02:01:20.870197+0000', 'modified': '2023-08-31T02:01:24.485132+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5583}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5583': {'gid': 5583, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6836/915893970', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 915893970}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 915893970}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-31T02:01:31.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T02:01:31.734 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-31T02:01:31.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.870+0000 7f068b02b700 1 -- 172.21.15.84:0/1545431586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 msgr2=0x7f0674004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.870+0000 7f068b02b700 1 --2- 172.21.15.84:0/1545431586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 0x7f0674004850 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0670009bb0 tx=0x7f0674005880 comp rx=0 tx=0).stop 2023-08-31T02:01:31.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.870+0000 7f06895c8700 1 -- 172.21.15.84:0/1545431586 reap_dead start 2023-08-31T02:01:31.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.870+0000 7f068b02b700 1 -- 172.21.15.84:0/1545431586 shutdown_connections 2023-08-31T02:01:31.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.870+0000 7f068b02b700 1 -- 172.21.15.84:0/1545431586 >> 172.21.15.84:0/1545431586 conn(0x7f06840cde90 msgr2=0x7f06840ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:31.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.870+0000 7f068b02b700 1 -- 172.21.15.84:0/1545431586 shutdown_connections 2023-08-31T02:01:31.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.870+0000 7f068b02b700 1 -- 172.21.15.84:0/1545431586 wait complete. 2023-08-31T02:01:31.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.872+0000 7f068b02b700 1 Processor -- start 2023-08-31T02:01:31.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.872+0000 7f068b02b700 1 -- start start 2023-08-31T02:01:31.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f068b02b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 0x7f0684155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f068b02b700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06840c3c10 0x7f06840c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f068b02b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0684158680 0x7f0684158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f068b02b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06840c2890 con 0x7f0674003fb0 2023-08-31T02:01:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f068b02b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06840c2b70 con 0x7f0684158680 2023-08-31T02:01:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f068b02b700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06840c2e50 con 0x7f06840c3c10 2023-08-31T02:01:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 0x7f0684155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 0x7f0684155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54058/0 (socket says 172.21.15.84:54058) 2023-08-31T02:01:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 -- 172.21.15.84:0/1625114981 learned_addr learned my addr 172.21.15.84:0/1625114981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f06895c8700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0684158680 0x7f0684158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0683fff700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06840c3c10 0x7f06840c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 -- 172.21.15.84:0/1625114981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06840c3c10 msgr2=0x7f06840c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06840c3c10 0x7f06840c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 -- 172.21.15.84:0/1625114981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0684158680 msgr2=0x7f0684158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0684158680 0x7f0684158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 -- 172.21.15.84:0/1625114981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840c3130 con 0x7f0674003fb0 2023-08-31T02:01:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f0688dc7700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 0x7f0684155880 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0678004eb0 tx=0x7f0678004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f06817fa700 1 -- 172.21.15.84:0/1625114981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678011660 con 0x7f0674003fb0 2023-08-31T02:01:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f06817fa700 1 -- 172.21.15.84:0/1625114981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f06780118b0 con 0x7f0674003fb0 2023-08-31T02:01:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f068b02b700 1 -- 172.21.15.84:0/1625114981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06840c3410 con 0x7f0674003fb0 2023-08-31T02:01:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f06817fa700 1 -- 172.21.15.84:0/1625114981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678011ca0 con 0x7f0674003fb0 2023-08-31T02:01:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.873+0000 7f068b02b700 1 -- 172.21.15.84:0/1625114981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06841e23b0 con 0x7f0674003fb0 2023-08-31T02:01:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.875+0000 7f06817fa700 1 -- 172.21.15.84:0/1625114981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f067801a400 con 0x7f0674003fb0 2023-08-31T02:01:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.875+0000 7f06817fa700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f066806a0e0 0x7f066806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.875+0000 7f06817fa700 1 -- 172.21.15.84:0/1625114981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0678089150 con 0x7f0674003fb0 2023-08-31T02:01:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.875+0000 7f0683fff700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f066806a0e0 0x7f066806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.876+0000 7f0683fff700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f066806a0e0 0x7f066806c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0670009230 tx=0x7f0670004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.877+0000 7f06971ceb80 1 Processor -- start 2023-08-31T02:01:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.877+0000 7f06971ceb80 1 -- start start 2023-08-31T02:01:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bfa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 0x55ba58bd0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bd08a0 0x55ba58bd1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f06971ceb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58b2b730 con 0x55ba58bf6900 2023-08-31T02:01:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f06971ceb80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58b29050 con 0x55ba58bd08a0 2023-08-31T02:01:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f06971ceb80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba58b24940 con 0x55ba58bf6ce0 2023-08-31T02:01:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bfa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bfa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54066/0 (socket says 172.21.15.84:54066) 2023-08-31T02:01:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 -- 172.21.15.84:0/1148945803 learned_addr learned my addr 172.21.15.84:0/1148945803 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f06895c8700 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bd08a0 0x55ba58bd1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0683fff700 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 0x55ba58bd0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 -- 172.21.15.84:0/1148945803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 msgr2=0x55ba58bd0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:01:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 0x55ba58bd0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 -- 172.21.15.84:0/1148945803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bd08a0 msgr2=0x55ba58bd1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:01:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bd08a0 0x55ba58bd1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 -- 172.21.15.84:0/1148945803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba589a45e0 con 0x55ba58bf6900 2023-08-31T02:01:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f0688dc7700 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bfa680 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0678001b10 tx=0x7f0678058150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f307d43341fdcc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f066e7fc700 1 -- 172.21.15.84:0/1148945803 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067805c170 con 0x55ba58bf6900 2023-08-31T02:01:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.878+0000 7f066e7fc700 1 -- 172.21.15.84:0/1148945803 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0678058540 con 0x55ba58bf6900 2023-08-31T02:01:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f066e7fc700 1 -- 172.21.15.84:0/1148945803 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067805c370 con 0x55ba58bf6900 2023-08-31T02:01:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 -- 172.21.15.84:0/1148945803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 msgr2=0x55ba58bfa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bfa680 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0678001b10 tx=0x7f0678058150 comp rx=0 tx=0).stop 2023-08-31T02:01:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 -- 172.21.15.84:0/1148945803 shutdown_connections 2023-08-31T02:01:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bd08a0 0x55ba58bd1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bfa680 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 --2- 172.21.15.84:0/1148945803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 0x55ba58bd0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 -- 172.21.15.84:0/1148945803 >> 172.21.15.84:0/1148945803 conn(0x55ba58b47090 msgr2=0x55ba58c181c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 -- 172.21.15.84:0/1148945803 shutdown_connections 2023-08-31T02:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.879+0000 7f06971ceb80 1 -- 172.21.15.84:0/1148945803 wait complete. 2023-08-31T02:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.880+0000 7f06971ceb80 1 -- start start 2023-08-31T02:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.880+0000 7f06971ceb80 1 Processor -- start 2023-08-31T02:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd08a0 0x55ba58bf7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6900 0x55ba58bf87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 0x55ba58c2d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06971ceb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58ac2b60 con 0x55ba58bd08a0 2023-08-31T02:01:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06971ceb80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58ac2860 con 0x55ba58bf6ce0 2023-08-31T02:01:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06971ceb80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba589a68d0 con 0x55ba58bf6900 2023-08-31T02:01:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06971ceb80 10 client.0 _ll_register_callbacks cb 0x55ba58a0ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T02:01:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd08a0 0x55ba58bf7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd08a0 0x55ba58bf7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54072/0 (socket says 172.21.15.84:54072) 2023-08-31T02:01:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 -- 172.21.15.84:0/3994315885 learned_addr learned my addr 172.21.15.84:0/3994315885 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0683fff700 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6900 0x55ba58bf87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06895c8700 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 0x55ba58c2d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 -- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6900 msgr2=0x55ba58bf87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6900 0x55ba58bf87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 -- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 msgr2=0x55ba58c2d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 0x55ba58c2d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 -- 172.21.15.84:0/3994315885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06841e23b0 con 0x55ba58bd08a0 2023-08-31T02:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06895c8700 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 0x55ba58c2d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f0688dc7700 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd08a0 0x55ba58bf7d40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0678001b10 tx=0x7f067805c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c912899a9d69ec server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06637fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-08-31T02:01:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06637fe700 1 -- 172.21.15.84:0/3994315885 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067805c370 con 0x55ba58bd08a0 2023-08-31T02:01:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06637fe700 1 -- 172.21.15.84:0/3994315885 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f06780568e0 con 0x55ba58bd08a0 2023-08-31T02:01:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.881+0000 7f06971ceb80 1 -- 172.21.15.84:0/3994315885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba58bc5970 con 0x55ba58bd08a0 2023-08-31T02:01:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06637fe700 1 -- 172.21.15.84:0/3994315885 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f067805fe30 con 0x55ba58bd08a0 2023-08-31T02:01:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06971ceb80 10 client.5772 fetch_fsmap learned FSMap version 17 2023-08-31T02:01:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06971ceb80 1 -- 172.21.15.84:0/3994315885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ba58950d90 con 0x55ba58bd08a0 2023-08-31T02:01:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06637fe700 1 -- 172.21.15.84:0/3994315885 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f067807b020 con 0x55ba58bd08a0 2023-08-31T02:01:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06637fe700 1 -- 172.21.15.84:0/3994315885 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f06780587a0 con 0x55ba58bd08a0 2023-08-31T02:01:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06971ceb80 10 client.5772 fetch_fsmap finished waiting for FSMap version 17 2023-08-31T02:01:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06971ceb80 10 client.5772 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-31T02:01:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06971ceb80 20 client.5772 populate_metadata read hostname 'smithi084' 2023-08-31T02:01:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06971ceb80 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] conn(0x55ba58bc7260 0x55ba58bc7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06971ceb80 4 client.5772 mds_command: new command op to 5583 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T02:01:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06971ceb80 1 -- 172.21.15.84:0/3994315885 --> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba58b1d920 con 0x55ba58bc7260 2023-08-31T02:01:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f0683fff700 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] conn(0x55ba58bc7260 0x55ba58bc7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f06637fe700 10 client.5772 ms_handle_connect on v2:172.21.15.84:6834/915893970 2023-08-31T02:01:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.882+0000 7f0683fff700 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] conn(0x55ba58bc7260 0x55ba58bc7640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f2a7ce1806598b server_cookie=93367ac06e925fb1 in_seq=0 out_seq=0 2023-08-31T02:01:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06637fe700 1 -- 172.21.15.84:0/3994315885 <== mds.0 v2:172.21.15.84:6834/915893970 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ba58b1d920 con 0x55ba58bc7260 2023-08-31T02:01:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06637fe700 10 client.5772 handle_command_reply: tid=0 2023-08-31T02:01:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 client.5772 shutdown 2023-08-31T02:01:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 -- 172.21.15.84:0/3994315885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd08a0 msgr2=0x55ba58bf7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd08a0 0x55ba58bf7d40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0678001b10 tx=0x7f067805c220 comp rx=0 tx=0).stop 2023-08-31T02:01:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 -- 172.21.15.84:0/3994315885 shutdown_connections 2023-08-31T02:01:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 0x55ba58c2d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd08a0 0x55ba58bf7d40 secure :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0678001b10 tx=0x7f067805c220 comp rx=0 tx=0).stop 2023-08-31T02:01:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] conn(0x55ba58bc7260 0x55ba58bc7640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 --2- 172.21.15.84:0/3994315885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6900 0x55ba58bf87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06637fe700 0 client.5772 ms_handle_reset on v2:172.21.15.84:6834/915893970 2023-08-31T02:01:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 -- 172.21.15.84:0/3994315885 >> 172.21.15.84:0/3994315885 conn(0x55ba58b47090 msgr2=0x55ba58bd0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 -- 172.21.15.84:0/3994315885 shutdown_connections 2023-08-31T02:01:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 1 -- 172.21.15.84:0/3994315885 wait complete. 2023-08-31T02:01:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.883+0000 7f06971ceb80 20 client.5772 trim_cache size 0 max 16384 2023-08-31T02:01:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.901+0000 7f06971ceb80 1 Processor -- start 2023-08-31T02:01:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.901+0000 7f06971ceb80 1 -- start start 2023-08-31T02:01:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bc7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 0x55ba58bc7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bd2130 0x55ba58bd25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f06971ceb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58c18d40 con 0x55ba58bf6900 2023-08-31T02:01:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f06971ceb80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58bf9010 con 0x55ba58bf6ce0 2023-08-31T02:01:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f06971ceb80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba58bcd3b0 con 0x55ba58bd2130 2023-08-31T02:01:31.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bc7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bc7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54080/0 (socket says 172.21.15.84:54080) 2023-08-31T02:01:31.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 -- 172.21.15.84:0/406565277 learned_addr learned my addr 172.21.15.84:0/406565277 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:31.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 -- 172.21.15.84:0/406565277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bd2130 msgr2=0x55ba58bd25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:01:31.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 --2- 172.21.15.84:0/406565277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bd2130 0x55ba58bd25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 -- 172.21.15.84:0/406565277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 msgr2=0x55ba58bc7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:01:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 --2- 172.21.15.84:0/406565277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 0x55ba58bc7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 -- 172.21.15.84:0/406565277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba58939c10 con 0x55ba58bf6900 2023-08-31T02:01:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f0688dc7700 1 --2- 172.21.15.84:0/406565277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bc7640 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0678004e80 tx=0x7f0678058150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cab3285e45998fb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f066effd700 1 -- 172.21.15.84:0/406565277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780600f0 con 0x55ba58bf6900 2023-08-31T02:01:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f066effd700 1 -- 172.21.15.84:0/406565277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f067807b070 con 0x55ba58bf6900 2023-08-31T02:01:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.902+0000 7f066effd700 1 -- 172.21.15.84:0/406565277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678054880 con 0x55ba58bf6900 2023-08-31T02:01:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 -- 172.21.15.84:0/406565277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 msgr2=0x55ba58bc7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 --2- 172.21.15.84:0/406565277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bc7640 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0678004e80 tx=0x7f0678058150 comp rx=0 tx=0).stop 2023-08-31T02:01:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 -- 172.21.15.84:0/406565277 shutdown_connections 2023-08-31T02:01:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 --2- 172.21.15.84:0/406565277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bd2130 0x55ba58bd25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 --2- 172.21.15.84:0/406565277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bf6900 0x55ba58bc7640 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 --2- 172.21.15.84:0/406565277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6ce0 0x55ba58bc7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 -- 172.21.15.84:0/406565277 >> 172.21.15.84:0/406565277 conn(0x55ba58b47090 msgr2=0x55ba58c3e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 -- 172.21.15.84:0/406565277 shutdown_connections 2023-08-31T02:01:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 -- 172.21.15.84:0/406565277 wait complete. 2023-08-31T02:01:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.903+0000 7f06971ceb80 1 -- start start 2023-08-31T02:01:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.904+0000 7f06971ceb80 1 Processor -- start 2023-08-31T02:01:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.904+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd2130 0x55ba58c1b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.904+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6900 0x55ba58bf3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.904+0000 7f06971ceb80 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 0x55ba58bf4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.904+0000 7f06971ceb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58bfb0c0 con 0x55ba58bd2130 2023-08-31T02:01:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.904+0000 7f06971ceb80 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58c1c480 con 0x55ba58bf6900 2023-08-31T02:01:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.904+0000 7f06971ceb80 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba58bf8b30 con 0x55ba58bf6ce0 2023-08-31T02:01:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06971ceb80 10 client.0 _ll_register_callbacks cb 0x7f0678058400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T02:01:31.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd2130 0x55ba58c1b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd2130 0x55ba58c1b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54086/0 (socket says 172.21.15.84:54086) 2023-08-31T02:01:31.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 -- 172.21.15.84:0/2931943560 learned_addr learned my addr 172.21.15.84:0/2931943560 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:31.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06895c8700 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 0x55ba58bf4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0683fff700 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6900 0x55ba58bf3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 -- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 msgr2=0x55ba58bf4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:01:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 0x55ba58bf4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 -- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6900 msgr2=0x55ba58bf3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T02:01:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6900 0x55ba58bf3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 -- 172.21.15.84:0/2931943560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba58950d90 con 0x55ba58bd2130 2023-08-31T02:01:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0683fff700 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6900 0x55ba58bf3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f0688dc7700 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd2130 0x55ba58c1b9d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0678004e80 tx=0x7f06780874a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fdd660ea15f10d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06637fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-08-31T02:01:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06637fe700 1 -- 172.21.15.84:0/2931943560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780600f0 con 0x55ba58bd2130 2023-08-31T02:01:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06637fe700 1 -- 172.21.15.84:0/2931943560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f067807c080 con 0x55ba58bd2130 2023-08-31T02:01:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06971ceb80 1 -- 172.21.15.84:0/2931943560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0678058540 con 0x55ba58bd2130 2023-08-31T02:01:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06637fe700 1 -- 172.21.15.84:0/2931943560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0678054880 con 0x55ba58bd2130 2023-08-31T02:01:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06971ceb80 10 client.5778 fetch_fsmap learned FSMap version 17 2023-08-31T02:01:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06971ceb80 1 -- 172.21.15.84:0/2931943560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ba58977200 con 0x55ba58bd2130 2023-08-31T02:01:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06637fe700 1 -- 172.21.15.84:0/2931943560 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0678058540 con 0x55ba58bd2130 2023-08-31T02:01:31.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06637fe700 1 -- 172.21.15.84:0/2931943560 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f06780587a0 con 0x55ba58bd2130 2023-08-31T02:01:31.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06971ceb80 10 client.5778 fetch_fsmap finished waiting for FSMap version 17 2023-08-31T02:01:31.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06971ceb80 10 client.5778 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-31T02:01:31.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06971ceb80 20 client.5778 populate_metadata read hostname 'smithi084' 2023-08-31T02:01:31.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.905+0000 7f06971ceb80 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] conn(0x55ba58c2d450 0x55ba58c85dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:31.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 4 client.5778 mds_command: new command op to 5583 tid=0[{"prefix": "status"}] 2023-08-31T02:01:31.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 -- 172.21.15.84:0/2931943560 --> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ba58ade000 con 0x55ba58c2d450 2023-08-31T02:01:31.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f0683fff700 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] conn(0x55ba58c2d450 0x55ba58c85dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:31.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06637fe700 10 client.5778 ms_handle_connect on v2:172.21.15.84:6834/915893970 2023-08-31T02:01:31.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f0683fff700 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] conn(0x55ba58c2d450 0x55ba58c85dc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9072e43e0c0413a2 server_cookie=9501dae1858d0e12 in_seq=0 out_seq=0 2023-08-31T02:01:31.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06637fe700 1 -- 172.21.15.84:0/2931943560 <== mds.0 v2:172.21.15.84:6834/915893970 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ba58ade000 con 0x55ba58c2d450 2023-08-31T02:01:31.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06637fe700 10 client.5778 handle_command_reply: tid=0 2023-08-31T02:01:31.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 client.5778 shutdown 2023-08-31T02:01:31.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 -- 172.21.15.84:0/2931943560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd2130 msgr2=0x55ba58c1b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd2130 0x55ba58c1b9d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0678004e80 tx=0x7f06780874a0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 -- 172.21.15.84:0/2931943560 shutdown_connections 2023-08-31T02:01:31.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.84:6834/915893970,v1:172.21.15.84:6836/915893970] conn(0x55ba58c2d450 0x55ba58c85dc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ba58bf6ce0 0x55ba58bf4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06637fe700 0 client.5778 ms_handle_reset on v2:172.21.15.84:6834/915893970 2023-08-31T02:01:31.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba58bd2130 0x55ba58c1b9d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 --2- 172.21.15.84:0/2931943560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ba58bf6900 0x55ba58bf3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 -- 172.21.15.84:0/2931943560 >> 172.21.15.84:0/2931943560 conn(0x55ba58b47090 msgr2=0x55ba58bd25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:31.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 -- 172.21.15.84:0/2931943560 shutdown_connections 2023-08-31T02:01:31.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.906+0000 7f06971ceb80 1 -- 172.21.15.84:0/2931943560 wait complete. 2023-08-31T02:01:31.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f06971ceb80 20 client.5778 trim_cache size 0 max 16384 2023-08-31T02:01:31.935 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:31.935 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3192a6ac-325f-4185-9b3a-d848f695e6dd", 2023-08-31T02:01:31.935 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-08-31T02:01:31.936 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5583, 2023-08-31T02:01:31.936 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-08-31T02:01:31.936 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-08-31T02:01:31.936 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-08-31T02:01:31.936 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 10.428329755, 2023-08-31T02:01:31.937 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 17, 2023-08-31T02:01:31.937 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 40, 2023-08-31T02:01:31.937 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 40, 2023-08-31T02:01:31.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 18.311621035999998 2023-08-31T02:01:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:31.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 -- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f066806a0e0 msgr2=0x7f066806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f066806a0e0 0x7f066806c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0670009230 tx=0x7f0670004750 comp rx=0 tx=0).stop 2023-08-31T02:01:31.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 -- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 msgr2=0x7f0684155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:31.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 0x7f0684155880 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0678004eb0 tx=0x7f0678004f90 comp rx=0 tx=0).stop 2023-08-31T02:01:31.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 -- 172.21.15.84:0/1625114981 shutdown_connections 2023-08-31T02:01:31.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f066806a0e0 0x7f066806c5a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0684158680 0x7f0684158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0674003fb0 0x7f0684155880 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 --2- 172.21.15.84:0/1625114981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06840c3c10 0x7f06840c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:31.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 -- 172.21.15.84:0/1625114981 >> 172.21.15.84:0/1625114981 conn(0x7f06840cde90 msgr2=0x7f068415bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:31.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 -- 172.21.15.84:0/1625114981 shutdown_connections 2023-08-31T02:01:31.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:31.907+0000 7f068b02b700 1 -- 172.21.15.84:0/1625114981 wait complete. 2023-08-31T02:01:31.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T02:01:32.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.073+0000 7f89aa74a700 1 -- 172.21.15.84:0/3891106827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40b12c0 msgr2=0x7f89a4159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:32.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.073+0000 7f89aa74a700 1 --2- 172.21.15.84:0/3891106827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40b12c0 0x7f89a4159a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f899c009f60 tx=0x7f899c009f90 comp rx=0 tx=0).stop 2023-08-31T02:01:32.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.073+0000 7f89aa74a700 1 -- 172.21.15.84:0/3891106827 shutdown_connections 2023-08-31T02:01:32.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.073+0000 7f89aa74a700 1 --2- 172.21.15.84:0/3891106827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a40af3d0 0x7f89a415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:32.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.073+0000 7f89aa74a700 1 --2- 172.21.15.84:0/3891106827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40b12c0 0x7f89a4159a00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:32.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.073+0000 7f89aa74a700 1 -- 172.21.15.84:0/3891106827 >> 172.21.15.84:0/3891106827 conn(0x7f89a406fca0 msgr2=0x7f89a40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:32.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.073+0000 7f89aa74a700 1 -- 172.21.15.84:0/3891106827 shutdown_connections 2023-08-31T02:01:32.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.073+0000 7f89aa74a700 1 -- 172.21.15.84:0/3891106827 wait complete. 2023-08-31T02:01:32.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.074+0000 7f89aa74a700 1 Processor -- start 2023-08-31T02:01:32.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.074+0000 7f89aa74a700 1 -- start start 2023-08-31T02:01:32.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89aa74a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40af3d0 0x7f89a406eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:32.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89aa74a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40b12c0 0x7f89a4147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:32.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89aa74a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a40ce570 0x7f89a415ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:32.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89aa74a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4158f10 con 0x7f89a40b12c0 2023-08-31T02:01:32.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89aa74a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a406f080 con 0x7f89a40af3d0 2023-08-31T02:01:32.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89aa74a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a406f2b0 con 0x7f89a40ce570 2023-08-31T02:01:32.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40b12c0 0x7f89a4147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:32.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40b12c0 0x7f89a4147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54102/0 (socket says 172.21.15.84:54102) 2023-08-31T02:01:32.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89a37fe700 1 -- 172.21.15.84:0/2798632096 learned_addr learned my addr 172.21.15.84:0/2798632096 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:32.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89a3fff700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40af3d0 0x7f89a406eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:32.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.075+0000 7f89a8ce7700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a40ce570 0x7f89a415ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:32.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a37fe700 1 -- 172.21.15.84:0/2798632096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a40ce570 msgr2=0x7f89a415ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:32.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a37fe700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a40ce570 0x7f89a415ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:32.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a37fe700 1 -- 172.21.15.84:0/2798632096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40af3d0 msgr2=0x7f89a406eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:32.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a37fe700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40af3d0 0x7f89a406eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:32.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a37fe700 1 -- 172.21.15.84:0/2798632096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8994009520 con 0x7f89a40b12c0 2023-08-31T02:01:32.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a37fe700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40b12c0 0x7f89a4147390 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f899800c500 tx=0x7f899800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:32.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a0ff9700 1 -- 172.21.15.84:0/2798632096 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998004230 con 0x7f89a40b12c0 2023-08-31T02:01:32.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a0ff9700 1 -- 172.21.15.84:0/2798632096 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f89980043b0 con 0x7f89a40b12c0 2023-08-31T02:01:32.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c009c40 con 0x7f89a40b12c0 2023-08-31T02:01:32.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89a0ff9700 1 -- 172.21.15.84:0/2798632096 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980038e0 con 0x7f89a40b12c0 2023-08-31T02:01:32.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.076+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a4158850 con 0x7f89a40b12c0 2023-08-31T02:01:32.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.077+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a4159050 con 0x7f89a40b12c0 2023-08-31T02:01:32.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.077+0000 7f89a0ff9700 1 -- 172.21.15.84:0/2798632096 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8998003a40 con 0x7f89a40b12c0 2023-08-31T02:01:32.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.078+0000 7f89a0ff9700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f899006a0e0 0x7f899006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:32.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.078+0000 7f89a0ff9700 1 -- 172.21.15.84:0/2798632096 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8998087a90 con 0x7f89a40b12c0 2023-08-31T02:01:32.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.078+0000 7f89a3fff700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f899006a0e0 0x7f899006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.078+0000 7f89a3fff700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f899006a0e0 0x7f899006c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8994009d50 tx=0x7f8994009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.082+0000 7f89a0ff9700 1 -- 172.21.15.84:0/2798632096 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f89a4159050 con 0x7f89a40b12c0 2023-08-31T02:01:32.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.317+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89a4159050 con 0x7f89a40b12c0 2023-08-31T02:01:32.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.317+0000 7f89a0ff9700 1 -- 172.21.15.84:0/2798632096 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f89a4159050 con 0x7f89a40b12c0 2023-08-31T02:01:32.311 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T02:01:32.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f899006a0e0 msgr2=0x7f899006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:32.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f899006a0e0 0x7f899006c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8994009d50 tx=0x7f8994009260 comp rx=0 tx=0).stop 2023-08-31T02:01:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40b12c0 msgr2=0x7f89a4147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40b12c0 0x7f89a4147390 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f899800c500 tx=0x7f899800c810 comp rx=0 tx=0).stop 2023-08-31T02:01:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 shutdown_connections 2023-08-31T02:01:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f899006a0e0 0x7f899006c5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a40ce570 0x7f89a415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40af3d0 0x7f89a406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 --2- 172.21.15.84:0/2798632096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40b12c0 0x7f89a4147390 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 >> 172.21.15.84:0/2798632096 conn(0x7f89a406fca0 msgr2=0x7f89a415b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.319+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 shutdown_connections 2023-08-31T02:01:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:32.320+0000 7f89aa74a700 1 -- 172.21.15.84:0/2798632096 wait complete. 2023-08-31T02:01:32.324 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T02:01:32.324 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T02:01:32.325 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-08-31T02:01:32.325 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T02:01:32.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T02:01:32.326 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T02:01:32.326 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T02:01:32.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T02:01:32.327 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T02:01:32.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:32.328 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-08-31T02:01:32.346 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:01:32.347 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:01:32.347 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:01:32.347 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:32.348 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-08-31T02:01:32.348 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:32.349 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:01:32.349 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:32.349 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:01:32.350 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:32.350 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:01:32.351 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:32.351 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T02:01:32.351 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:32.352 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T02:01:32.352 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42312sec preferred_lft 42312sec 2023-08-31T02:01:32.352 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ecad:a98e:85e8:7ebe/64 scope link noprefixroute 2023-08-31T02:01:32.353 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:32.353 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T02:01:32.353 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 32:c2:88:e6:3c:fb brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:32.354 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T02:01:32.354 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:32.354 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::fccd:8bff:feab:d4e0/64 scope link 2023-08-31T02:01:32.355 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:32.355 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T02:01:32.356 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether b6:b6:7b:67:62:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T02:01:32.356 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::b4b6:7bff:fe67:6275/64 scope link 2023-08-31T02:01:32.356 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:32.357 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T02:01:32.357 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 32:c2:88:e6:3c:fb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T02:01:32.357 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::30c2:88ff:fee6:3cfb/64 scope link 2023-08-31T02:01:32.358 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:32.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:32.359 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T02:01:32.411 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-08-31T02:01:32.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:32.413 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-08-31T02:01:32.472 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-08-31T02:01:32.472 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T02:01:32.473 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T02:01:32.473 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T02:01:32.473 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T02:01:32.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:32.474 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-08-31T02:01:32.474 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-08-31T02:01:32.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T02:01:32.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T02:01:32.476 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T02:01:32.476 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-08-31T02:01:32.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:32.577 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-08-31T02:01:32.593 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T02:01:32.594 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T02:01:32.594 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T02:01:32.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:32.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-08-31T02:01:32.660 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-31T02:01:32.660 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:01:32.661 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-31T02:01:32.717 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-31T02:01:32.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:01:32.718 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-31T02:01:32.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-08-31T02:01:32.841 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:01:32.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:01:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:01:32.909 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:01:32.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:32.910 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-08-31T02:01:32.967 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T02:01:32.967 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-31T02:01:33.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-08-31T02:01:33.036 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:01:33.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:01:33.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-08-31T02:01:33.103+0000 7f854ad075c0 -1 init, newargv = 0x556f44f321c0 newargc=15 2023-08-31T02:01:33.096 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[122501]: starting ceph client 2023-08-31T02:01:33.101 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[122501]: starting fuse 2023-08-31T02:01:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:01:33.104 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:01:33.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:33.105 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-08-31T02:01:33.162 INFO:teuthology.orchestra.run.smithi084.stdout:47 2023-08-31T02:01:33.162 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-31T02:01:33.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-08-31T02:01:33.163 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-08-31T02:01:33.164 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-08-31T02:01:33.164 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-08-31T02:01:33.165 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-08-31T02:01:33.165 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:01:33.165 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-08-31T02:01:33.166 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-31T02:01:33.166 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-08-31T02:01:33.166 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-31T02:01:33.167 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:01:33.167 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-08-31T02:01:33.168 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-08-31T02:01:33.168 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-08-31T02:01:33.168 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-08-31T02:01:33.169 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:01:33.169 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-08-31T02:01:33.169 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T02:01:33.170 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T02:01:33.170 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T02:01:33.171 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-08-31T02:01:33.171 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-08-31T02:01:33.171 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-08-31T02:01:33.172 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T02:01:33.172 DEBUG:teuthology.orchestra.run.smithi084:> 2023-08-31T02:01:33.172 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-08-31T02:01:33.173 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-08-31T02:01:33.285 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.122501.asok 2023-08-31T02:01:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T02:01:33.295 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.122501.asok 2023-08-31T02:01:33.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:33.296 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.122501.asok status 2023-08-31T02:01:33.450 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:33.450 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-08-31T02:01:33.451 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T02:01:33.451 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T02:01:33.451 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-08-31T02:01:33.451 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-08-31T02:01:33.451 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-31T02:01:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "122501", 2023-08-31T02:01:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-08-31T02:01:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-08-31T02:01:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-08-31T02:01:33.453 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5787, 2023-08-31T02:01:33.453 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-08-31T02:01:33.453 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-08-31T02:01:33.453 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-08-31T02:01:33.454 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 5787 2023-08-31T02:01:33.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:33.454 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-08-31T02:01:33.454 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-08-31T02:01:33.454 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:01:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 883100644 2023-08-31T02:01:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-08-31T02:01:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-08-31T02:01:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-08-31T02:01:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:01:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 883100644 2023-08-31T02:01:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-08-31T02:01:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.5787 192.168.0.1:0/883100644", 2023-08-31T02:01:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/883100644", 2023-08-31T02:01:33.457 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-08-31T02:01:33.457 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 17, 2023-08-31T02:01:33.457 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 40, 2023-08-31T02:01:33.457 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-08-31T02:01:33.457 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-08-31T02:01:33.458 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-08-31T02:01:33.458 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:33.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:33.460 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-08-31T02:01:33.461 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-31T02:01:33.478 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-08-31T02:01:33.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-31T02:01:33.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:33.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T02:01:33.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T02:01:33.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.716+0000 7fca8649f700 1 -- 172.21.15.84:0/2103508233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 msgr2=0x7fca68004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.716+0000 7fca8649f700 1 --2- 172.21.15.84:0/2103508233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 0x7fca68004850 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c310 tx=0x7fca68005880 comp rx=0 tx=0).stop 2023-08-31T02:01:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.716+0000 7fca84a3c700 1 -- 172.21.15.84:0/2103508233 reap_dead start 2023-08-31T02:01:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.716+0000 7fca8649f700 1 -- 172.21.15.84:0/2103508233 shutdown_connections 2023-08-31T02:01:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.716+0000 7fca8649f700 1 -- 172.21.15.84:0/2103508233 >> 172.21.15.84:0/2103508233 conn(0x7fca800cdf00 msgr2=0x7fca800ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.716+0000 7fca8649f700 1 -- 172.21.15.84:0/2103508233 shutdown_connections 2023-08-31T02:01:33.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.716+0000 7fca8649f700 1 -- 172.21.15.84:0/2103508233 wait complete. 2023-08-31T02:01:33.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.717+0000 7fca8649f700 1 Processor -- start 2023-08-31T02:01:33.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.718+0000 7fca8649f700 1 -- start start 2023-08-31T02:01:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.718+0000 7fca8649f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 0x7fca801e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.718+0000 7fca8649f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca80154b80 0x7fca80158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.718+0000 7fca8649f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca801588a0 0x7fca8006a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.718+0000 7fca8649f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca80158d20 con 0x7fca68003f80 2023-08-31T02:01:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.718+0000 7fca8649f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca801546f0 con 0x7fca801588a0 2023-08-31T02:01:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.718+0000 7fca8649f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8006af00 con 0x7fca80154b80 2023-08-31T02:01:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 0x7fca801e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 0x7fca801e30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54132/0 (socket says 172.21.15.84:54132) 2023-08-31T02:01:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 -- 172.21.15.84:0/3392630752 learned_addr learned my addr 172.21.15.84:0/3392630752 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7f7fe700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca80154b80 0x7fca80158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca84a3c700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca801588a0 0x7fca8006a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 -- 172.21.15.84:0/3392630752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca80154b80 msgr2=0x7fca80158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca80154b80 0x7fca80158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 -- 172.21.15.84:0/3392630752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca801588a0 msgr2=0x7fca8006a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca801588a0 0x7fca8006a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 -- 172.21.15.84:0/3392630752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca80153dc0 con 0x7fca68003f80 2023-08-31T02:01:33.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7ffff700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 0x7fca801e30d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fca70010a40 tx=0x7fca70010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:33.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7cff9700 1 -- 172.21.15.84:0/3392630752 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000ec50 con 0x7fca68003f80 2023-08-31T02:01:33.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7cff9700 1 -- 172.21.15.84:0/3392630752 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca70015070 con 0x7fca68003f80 2023-08-31T02:01:33.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca801540a0 con 0x7fca68003f80 2023-08-31T02:01:33.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca7cff9700 1 -- 172.21.15.84:0/3392630752 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000eee0 con 0x7fca68003f80 2023-08-31T02:01:33.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.719+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca80155000 con 0x7fca68003f80 2023-08-31T02:01:33.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.720+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca801549d0 con 0x7fca68003f80 2023-08-31T02:01:33.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.720+0000 7fca7cff9700 1 -- 172.21.15.84:0/3392630752 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fca700116a0 con 0x7fca68003f80 2023-08-31T02:01:33.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.721+0000 7fca7cff9700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca6c06a110 0x7fca6c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:33.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.721+0000 7fca7cff9700 1 -- 172.21.15.84:0/3392630752 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca70088b10 con 0x7fca68003f80 2023-08-31T02:01:33.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.721+0000 7fca7f7fe700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca6c06a110 0x7fca6c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:33.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.721+0000 7fca7f7fe700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca6c06a110 0x7fca6c06c5d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca74012040 tx=0x7fca74001a70 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:33.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.725+0000 7fca7cff9700 1 -- 172.21.15.84:0/3392630752 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fca70054240 con 0x7fca68003f80 2023-08-31T02:01:33.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.956+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca80151740 con 0x7fca68003f80 2023-08-31T02:01:33.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.956+0000 7fca7cff9700 1 -- 172.21.15.84:0/3392630752 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca70057860 con 0x7fca68003f80 2023-08-31T02:01:33.949 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T02:01:33.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca6c06a110 msgr2=0x7fca6c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:33.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca6c06a110 0x7fca6c06c5d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca74012040 tx=0x7fca74001a70 comp rx=0 tx=0).stop 2023-08-31T02:01:33.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 msgr2=0x7fca801e30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:33.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 0x7fca801e30d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fca70010a40 tx=0x7fca70010e00 comp rx=0 tx=0).stop 2023-08-31T02:01:33.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 shutdown_connections 2023-08-31T02:01:33.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fca6c06a110 0x7fca6c06c5d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:33.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca801588a0 0x7fca8006a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:33.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca68003f80 0x7fca801e30d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:33.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 --2- 172.21.15.84:0/3392630752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca80154b80 0x7fca80158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:33.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 >> 172.21.15.84:0/3392630752 conn(0x7fca800cdf00 msgr2=0x7fca80151030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:33.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 shutdown_connections 2023-08-31T02:01:33.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:33.958+0000 7fca8649f700 1 -- 172.21.15.84:0/3392630752 wait complete. 2023-08-31T02:01:33.962 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T02:01:33.963 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T02:01:33.963 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2023-08-31T02:01:33.964 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-31T02:01:33.964 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T02:01:33.964 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T02:01:33.965 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T02:01:33.965 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T02:01:33.965 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-31T02:01:33.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:33.966 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2023-08-31T02:01:33.988 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T02:01:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T02:01:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T02:01:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-08-31T02:01:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:33.989 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:01:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:33.990 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:01:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:33.990 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T02:01:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:33.991 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T02:01:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T02:01:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42315sec preferred_lft 42315sec 2023-08-31T02:01:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c8f4:6f89:3509:f73e/64 scope link noprefixroute 2023-08-31T02:01:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:33.992 INFO:teuthology.orchestra.run.smithi170.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T02:01:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0a:7d:1b:30:47:e9 brd ff:ff:ff:ff:ff:ff 2023-08-31T02:01:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T02:01:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::1cc6:a0ff:fea2:6748/64 scope link 2023-08-31T02:01:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:33.993 INFO:teuthology.orchestra.run.smithi170.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T02:01:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether aa:28:1b:9a:0e:9d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T02:01:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::a828:1bff:fe9a:e9d/64 scope link 2023-08-31T02:01:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:33.994 INFO:teuthology.orchestra.run.smithi170.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T02:01:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0a:7d:1b:30:47:e9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T02:01:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::87d:1bff:fe30:47e9/64 scope link 2023-08-31T02:01:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-08-31T02:01:33.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:33.995 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T02:01:34.060 INFO:teuthology.orchestra.run.smithi170.stdout:1 2023-08-31T02:01:34.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:34.063 DEBUG:teuthology.orchestra.run.smithi170:> route 2023-08-31T02:01:34.124 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2023-08-31T02:01:34.124 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T02:01:34.125 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T02:01:34.125 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T02:01:34.125 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T02:01:34.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:34.126 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-08-31T02:01:34.126 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-08-31T02:01:34.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T02:01:34.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T02:01:34.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T02:01:34.128 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-08-31T02:01:34.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:34.235 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-08-31T02:01:34.252 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-31T02:01:34.252 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T02:01:34.253 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-31T02:01:34.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:34.254 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2023-08-31T02:01:34.320 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-08-31T02:01:34.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:01:34.321 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-31T02:01:34.376 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-31T02:01:34.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T02:01:34.377 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-31T02:01:34.433 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-08-31T02:01:34.500 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:01:34.501 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:01:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:01:34.567 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:01:34.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:34.569 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-08-31T02:01:34.625 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T02:01:34.626 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-08-31T02:01:34.668 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-08-31T02:01:34.695 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T02:01:34.695 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T02:01:34.755 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2023-08-31T02:01:34.762+0000 7fc47b3f15c0 -1 init, newargv = 0x55f4afee7200 newargc=15 2023-08-31T02:01:34.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[110980]: starting ceph client 2023-08-31T02:01:34.760 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[110980]: starting fuse 2023-08-31T02:01:34.766 INFO:teuthology.orchestra.run.smithi170.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T02:01:34.767 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T02:01:34.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:34.768 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-08-31T02:01:34.825 INFO:teuthology.orchestra.run.smithi170.stdout:47 2023-08-31T02:01:34.825 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-31T02:01:34.826 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2023-08-31T02:01:34.826 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2023-08-31T02:01:34.827 DEBUG:teuthology.orchestra.run.smithi170:> import re 2023-08-31T02:01:34.827 DEBUG:teuthology.orchestra.run.smithi170:> import os 2023-08-31T02:01:34.827 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2023-08-31T02:01:34.828 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:01:34.828 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2023-08-31T02:01:34.829 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-08-31T02:01:34.829 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2023-08-31T02:01:34.829 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-08-31T02:01:34.830 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:01:34.830 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2023-08-31T02:01:34.830 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2023-08-31T02:01:34.831 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2023-08-31T02:01:34.831 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2023-08-31T02:01:34.832 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:01:34.832 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2023-08-31T02:01:34.832 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T02:01:34.833 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T02:01:34.833 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T02:01:34.833 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2023-08-31T02:01:34.834 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2023-08-31T02:01:34.834 DEBUG:teuthology.orchestra.run.smithi170:> return f 2023-08-31T02:01:34.835 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T02:01:34.835 DEBUG:teuthology.orchestra.run.smithi170:> 2023-08-31T02:01:34.836 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.1")) 2023-08-31T02:01:34.836 DEBUG:teuthology.orchestra.run.smithi170:> ' 2023-08-31T02:01:34.948 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.1.110980.asok 2023-08-31T02:01:34.951 INFO:teuthology.orchestra.run.smithi170.stderr:2023-08-31T02:01:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T02:01:34.957 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.110980.asok 2023-08-31T02:01:34.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:34.958 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.110980.asok status 2023-08-31T02:01:35.112 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2023-08-31T02:01:35.113 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2023-08-31T02:01:35.113 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T02:01:35.113 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T02:01:35.113 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "1", 2023-08-31T02:01:35.113 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2023-08-31T02:01:35.114 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-08-31T02:01:35.114 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "110980", 2023-08-31T02:01:35.114 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2023-08-31T02:01:35.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:01:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2023-08-31T02:01:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2023-08-31T02:01:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 5419, 2023-08-31T02:01:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2023-08-31T02:01:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2023-08-31T02:01:35.116 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2023-08-31T02:01:35.116 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 5419 2023-08-31T02:01:35.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:01:35.117 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-08-31T02:01:35.117 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-08-31T02:01:35.117 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:01:35.117 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 681457529 2023-08-31T02:01:35.118 INFO:teuthology.orchestra.run.smithi170.stdout: } 2023-08-31T02:01:35.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:01:35.118 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-08-31T02:01:35.118 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-08-31T02:01:35.118 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2023-08-31T02:01:35.119 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 681457529 2023-08-31T02:01:35.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-08-31T02:01:35.119 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.5419 192.168.0.1:0/681457529", 2023-08-31T02:01:35.119 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.1:0/681457529", 2023-08-31T02:01:35.119 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2023-08-31T02:01:35.120 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 17, 2023-08-31T02:01:35.120 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 40, 2023-08-31T02:01:35.120 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2023-08-31T02:01:35.120 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2023-08-31T02:01:35.120 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2023-08-31T02:01:35.120 INFO:teuthology.orchestra.run.smithi170.stdout:} 2023-08-31T02:01:35.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:35.123 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2023-08-31T02:01:35.123 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.1 2023-08-31T02:01:35.140 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2023-08-31T02:01:35.140 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-08-31T02:01:35.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:35.141 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-31T02:01:35.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:35.208 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-08-31T02:01:35.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:35.236 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0 ./subdir) 2023-08-31T02:01:35.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:35.299 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2023-08-31T02:01:35.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:01:35.359 INFO:teuthology.orchestra.run.smithi084.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2023-08-31T02:01:35.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:35.360 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir) 2023-08-31T02:01:35.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:01:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:setfattr: ./subdir: Invalid argument 2023-08-31T02:01:35.420 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T02:01:35.420 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T02:01:35.504 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T02:01:35.547 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T02:01:35.548 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:01:35.548 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:35.569 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:35.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.743+0000 7f4478aef700 1 -- 172.21.15.84:0/44497031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 msgr2=0x7f445c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:35.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.743+0000 7f4478aef700 1 --2- 172.21.15.84:0/44497031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 0x7f445c004cd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f446400c290 tx=0x7f445c005880 comp rx=0 tx=0).stop 2023-08-31T02:01:35.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.743+0000 7f4478aef700 1 -- 172.21.15.84:0/44497031 shutdown_connections 2023-08-31T02:01:35.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.743+0000 7f4478aef700 1 --2- 172.21.15.84:0/44497031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 0x7f445c004cd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:35.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.743+0000 7f4478aef700 1 -- 172.21.15.84:0/44497031 >> 172.21.15.84:0/44497031 conn(0x7f44740699a0 msgr2=0x7f4474069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:35.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.743+0000 7f4478aef700 1 -- 172.21.15.84:0/44497031 shutdown_connections 2023-08-31T02:01:35.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.743+0000 7f4478aef700 1 -- 172.21.15.84:0/44497031 wait complete. 2023-08-31T02:01:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.744+0000 7f4478aef700 1 Processor -- start 2023-08-31T02:01:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f4478aef700 1 -- start start 2023-08-31T02:01:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f4478aef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 0x7f447414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f4478aef700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4474149f90 0x7f44741488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f4478aef700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447414e490 0x7f447414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f4478aef700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447414ee50 con 0x7f445c004850 2023-08-31T02:01:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f4478aef700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741ef540 con 0x7f447414e490 2023-08-31T02:01:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f4478aef700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4474148e30 con 0x7f4474149f90 2023-08-31T02:01:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f447259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 0x7f447414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:35.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f447259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 0x7f447414c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54152/0 (socket says 172.21.15.84:54152) 2023-08-31T02:01:35.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.745+0000 7f447259c700 1 -- 172.21.15.84:0/1910023853 learned_addr learned my addr 172.21.15.84:0/1910023853 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:35.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f447259c700 1 -- 172.21.15.84:0/1910023853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4474149f90 msgr2=0x7f44741488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:35.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f447259c700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4474149f90 0x7f44741488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:35.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f447259c700 1 -- 172.21.15.84:0/1910023853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447414e490 msgr2=0x7f447414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:35.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f4472d9d700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447414e490 0x7f447414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:35.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f447259c700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447414e490 0x7f447414e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:35.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f447259c700 1 -- 172.21.15.84:0/1910023853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447414aff0 con 0x7f445c004850 2023-08-31T02:01:35.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f447259c700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 0x7f447414c3c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4468011b10 tx=0x7f4468011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:35.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f4462ffd700 1 -- 172.21.15.84:0/1910023853 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800fb00 con 0x7f445c004850 2023-08-31T02:01:35.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f4462ffd700 1 -- 172.21.15.84:0/1910023853 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f446800fc60 con 0x7f445c004850 2023-08-31T02:01:35.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447414a750 con 0x7f445c004850 2023-08-31T02:01:35.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f4462ffd700 1 -- 172.21.15.84:0/1910023853 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468019410 con 0x7f445c004850 2023-08-31T02:01:35.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.746+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447414ad10 con 0x7f445c004850 2023-08-31T02:01:35.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.747+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447404e7c0 con 0x7f445c004850 2023-08-31T02:01:35.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.747+0000 7f4462ffd700 1 -- 172.21.15.84:0/1910023853 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4468019570 con 0x7f445c004850 2023-08-31T02:01:35.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.748+0000 7f4462ffd700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f445406a0e0 0x7f445406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:35.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.748+0000 7f4462ffd700 1 -- 172.21.15.84:0/1910023853 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4468088f60 con 0x7f445c004850 2023-08-31T02:01:35.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.748+0000 7f4471d9b700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f445406a0e0 0x7f445406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:35.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.748+0000 7f4471d9b700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f445406a0e0 0x7f445406c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f447414bec0 tx=0x7f4464001b10 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:35.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.752+0000 7f4462ffd700 1 -- 172.21.15.84:0/1910023853 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4468054620 con 0x7f445c004850 2023-08-31T02:01:35.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.944+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f447406d9b0 con 0x7f445c004850 2023-08-31T02:01:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.946+0000 7f4462ffd700 1 -- 172.21.15.84:0/1910023853 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f446801e020 con 0x7f445c004850 2023-08-31T02:01:35.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:35.939 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:22.468991+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T02:01:18.799026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T02:01:19.825366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f445406a0e0 msgr2=0x7f445406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f445406a0e0 0x7f445406c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f447414bec0 tx=0x7f4464001b10 comp rx=0 tx=0).stop 2023-08-31T02:01:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 msgr2=0x7f447414c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 0x7f447414c3c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4468011b10 tx=0x7f4468011ed0 comp rx=0 tx=0).stop 2023-08-31T02:01:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 shutdown_connections 2023-08-31T02:01:35.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f445406a0e0 0x7f445406c5a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:35.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447414e490 0x7f447414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:35.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f445c004850 0x7f447414c3c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:35.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 --2- 172.21.15.84:0/1910023853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4474149f90 0x7f44741488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:35.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 >> 172.21.15.84:0/1910023853 conn(0x7f44740699a0 msgr2=0x7f447406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:35.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 shutdown_connections 2023-08-31T02:01:35.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:35.948+0000 7f4478aef700 1 -- 172.21.15.84:0/1910023853 wait complete. 2023-08-31T02:01:35.952 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T02:01:18.799026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T02:01:19.825366+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T02:01:35.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:01:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.086+0000 7f78c2547700 1 -- 172.21.15.84:0/2908777991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0ca030 msgr2=0x7f78bc0c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.086+0000 7f78c2547700 1 --2- 172.21.15.84:0/2908777991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0ca030 0x7f78bc0c8e20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0ca890 tx=0x7f78b400b380 comp rx=0 tx=0).stop 2023-08-31T02:01:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.086+0000 7f78c2547700 1 -- 172.21.15.84:0/2908777991 shutdown_connections 2023-08-31T02:01:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.086+0000 7f78c2547700 1 --2- 172.21.15.84:0/2908777991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0ca030 0x7f78bc0c8e20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.086+0000 7f78c2547700 1 --2- 172.21.15.84:0/2908777991 >> v2:172.21.15.170:3300/0 conn(0x7f78bc0c8500 0x7f78bc0c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.086+0000 7f78c2547700 1 -- 172.21.15.84:0/2908777991 >> 172.21.15.84:0/2908777991 conn(0x7f78bc0ca930 msgr2=0x7f78bc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.086+0000 7f78c2547700 1 -- 172.21.15.84:0/2908777991 shutdown_connections 2023-08-31T02:01:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.086+0000 7f78c2547700 1 -- 172.21.15.84:0/2908777991 wait complete. 2023-08-31T02:01:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.087+0000 7f78c2547700 1 Processor -- start 2023-08-31T02:01:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.087+0000 7f78c2547700 1 -- start start 2023-08-31T02:01:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78c2547700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0c8500 0x7f78bc154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78c2547700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78bc0c9c00 0x7f78bc06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78c2547700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78bc0ca030 0x7f78bc06c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78c2547700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc06ac10 con 0x7f78bc0c8500 2023-08-31T02:01:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78c2547700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc06ae50 con 0x7f78bc0c9c00 2023-08-31T02:01:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78c2547700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc06b130 con 0x7f78bc0ca030 2023-08-31T02:01:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0c8500 0x7f78bc154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0c8500 0x7f78bc154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54166/0 (socket says 172.21.15.84:54166) 2023-08-31T02:01:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 -- 172.21.15.84:0/3328051036 learned_addr learned my addr 172.21.15.84:0/3328051036 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bb7fe700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78bc0c9c00 0x7f78bc06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78c0ae4700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78bc0ca030 0x7f78bc06c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 -- 172.21.15.84:0/3328051036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78bc0ca030 msgr2=0x7f78bc06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78bc0ca030 0x7f78bc06c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 -- 172.21.15.84:0/3328051036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78bc0c9c00 msgr2=0x7f78bc06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78bc0c9c00 0x7f78bc06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 -- 172.21.15.84:0/3328051036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4009d00 con 0x7f78bc0c8500 2023-08-31T02:01:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.088+0000 7f78bbfff700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0c8500 0x7f78bc154fe0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00b530 tx=0x7f78ac00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.089+0000 7f78b8ff9700 1 -- 172.21.15.84:0/3328051036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011830 con 0x7f78bc0c8500 2023-08-31T02:01:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.089+0000 7f78b8ff9700 1 -- 172.21.15.84:0/3328051036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f78ac011a80 con 0x7f78bc0c8500 2023-08-31T02:01:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.089+0000 7f78b8ff9700 1 -- 172.21.15.84:0/3328051036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011e90 con 0x7f78bc0c8500 2023-08-31T02:01:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.089+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc06b410 con 0x7f78bc0c8500 2023-08-31T02:01:36.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.089+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc06b9d0 con 0x7f78bc0c8500 2023-08-31T02:01:36.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.090+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0c1540 con 0x7f78bc0c8500 2023-08-31T02:01:36.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.090+0000 7f78b8ff9700 1 -- 172.21.15.84:0/3328051036 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f78ac01a400 con 0x7f78bc0c8500 2023-08-31T02:01:36.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.090+0000 7f78b8ff9700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f78a806a110 0x7f78a806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.091+0000 7f78b8ff9700 1 -- 172.21.15.84:0/3328051036 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f78ac088720 con 0x7f78bc0c8500 2023-08-31T02:01:36.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.091+0000 7f78bb7fe700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f78a806a110 0x7f78a806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.091+0000 7f78bb7fe700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f78a806a110 0x7f78a806c5d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f78bc155e50 tx=0x7f78b0009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:36.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.095+0000 7f78b8ff9700 1 -- 172.21.15.84:0/3328051036 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f78ac053de0 con 0x7f78bc0c8500 2023-08-31T02:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.286+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78bc04e7c0 con 0x7f78bc0c8500 2023-08-31T02:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.286+0000 7f78b8ff9700 1 -- 172.21.15.84:0/3328051036 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78ac01e1b0 con 0x7f78bc0c8500 2023-08-31T02:01:36.279 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:01:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.288+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f78a806a110 msgr2=0x7f78a806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.288+0000 7f78c2547700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f78a806a110 0x7f78a806c5d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f78bc155e50 tx=0x7f78b0009040 comp rx=0 tx=0).stop 2023-08-31T02:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.288+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0c8500 msgr2=0x7f78bc154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.288+0000 7f78c2547700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0c8500 0x7f78bc154fe0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00b530 tx=0x7f78ac00b840 comp rx=0 tx=0).stop 2023-08-31T02:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.288+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 shutdown_connections 2023-08-31T02:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.289+0000 7f78c2547700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f78a806a110 0x7f78a806c5d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.289+0000 7f78c2547700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78bc0ca030 0x7f78bc06c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.289+0000 7f78c2547700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78bc0c8500 0x7f78bc154fe0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.289+0000 7f78c2547700 1 --2- 172.21.15.84:0/3328051036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78bc0c9c00 0x7f78bc06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.289+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 >> 172.21.15.84:0/3328051036 conn(0x7f78bc0ca930 msgr2=0x7f78bc070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.289+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 shutdown_connections 2023-08-31T02:01:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.289+0000 7f78c2547700 1 -- 172.21.15.84:0/3328051036 wait complete. 2023-08-31T02:01:36.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:01:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.425+0000 7ff637b42700 1 -- 172.21.15.84:0/2412115348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6301593b0 msgr2=0x7ff6300b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.425+0000 7ff637b42700 1 --2- 172.21.15.84:0/2412115348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6301593b0 0x7ff6300b0620 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff620005fd0 tx=0x7ff620009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.425+0000 7ff637b42700 1 -- 172.21.15.84:0/2412115348 shutdown_connections 2023-08-31T02:01:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.425+0000 7ff637b42700 1 --2- 172.21.15.84:0/2412115348 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6300b23e0 0x7ff6300b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.425+0000 7ff637b42700 1 --2- 172.21.15.84:0/2412115348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6301593b0 0x7ff6300b0620 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.425+0000 7ff637b42700 1 -- 172.21.15.84:0/2412115348 >> 172.21.15.84:0/2412115348 conn(0x7ff6300afb00 msgr2=0x7ff6300aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.425+0000 7ff637b42700 1 -- 172.21.15.84:0/2412115348 shutdown_connections 2023-08-31T02:01:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.425+0000 7ff637b42700 1 -- 172.21.15.84:0/2412115348 wait complete. 2023-08-31T02:01:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.426+0000 7ff637b42700 1 Processor -- start 2023-08-31T02:01:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff637b42700 1 -- start start 2023-08-31T02:01:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff637b42700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63006db90 0x7ff630152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff637b42700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6300b23e0 0x7ff63015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff637b42700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6301593b0 0x7ff6300c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff637b42700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6300cc7f0 con 0x7ff63006db90 2023-08-31T02:01:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff637b42700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff630152880 con 0x7ff6300b23e0 2023-08-31T02:01:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff637b42700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6300cbb70 con 0x7ff6301593b0 2023-08-31T02:01:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff6358de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63006db90 0x7ff630152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff6358de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63006db90 0x7ff630152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54180/0 (socket says 172.21.15.84:54180) 2023-08-31T02:01:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.427+0000 7ff6358de700 1 -- 172.21.15.84:0/399247401 learned_addr learned my addr 172.21.15.84:0/399247401 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6358de700 1 -- 172.21.15.84:0/399247401 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6301593b0 msgr2=0x7ff6300c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6358de700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6301593b0 0x7ff6300c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6358de700 1 -- 172.21.15.84:0/399247401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6300b23e0 msgr2=0x7ff63015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6358de700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6300b23e0 0x7ff63015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6358de700 1 -- 172.21.15.84:0/399247401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200095f0 con 0x7ff63006db90 2023-08-31T02:01:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6358de700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63006db90 0x7ff630152340 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff63006e800 tx=0x7ff62000bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6267fc700 1 -- 172.21.15.84:0/399247401 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62001c070 con 0x7ff63006db90 2023-08-31T02:01:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6267fc700 1 -- 172.21.15.84:0/399247401 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff620003990 con 0x7ff63006db90 2023-08-31T02:01:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6300cbe50 con 0x7ff63006db90 2023-08-31T02:01:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff6267fc700 1 -- 172.21.15.84:0/399247401 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff620003da0 con 0x7ff63006db90 2023-08-31T02:01:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.428+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6300cc410 con 0x7ff63006db90 2023-08-31T02:01:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.429+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff630070450 con 0x7ff63006db90 2023-08-31T02:01:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.429+0000 7ff6267fc700 1 -- 172.21.15.84:0/399247401 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff62000f460 con 0x7ff63006db90 2023-08-31T02:01:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.430+0000 7ff6267fc700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff61406a0e0 0x7ff61406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.430+0000 7ff6267fc700 1 -- 172.21.15.84:0/399247401 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff620089a80 con 0x7ff63006db90 2023-08-31T02:01:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.430+0000 7ff6350dd700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff61406a0e0 0x7ff61406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.430+0000 7ff6350dd700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff61406a0e0 0x7ff61406c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff6300af840 tx=0x7ff62c007850 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.434+0000 7ff6267fc700 1 -- 172.21.15.84:0/399247401 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff620055260 con 0x7ff63006db90 2023-08-31T02:01:36.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.624+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6300cc5a0 con 0x7ff63006db90 2023-08-31T02:01:36.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.625+0000 7ff6267fc700 1 -- 172.21.15.84:0/399247401 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff620058880 con 0x7ff63006db90 2023-08-31T02:01:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:36.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff61406a0e0 msgr2=0x7ff61406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff61406a0e0 0x7ff61406c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff6300af840 tx=0x7ff62c007850 comp rx=0 tx=0).stop 2023-08-31T02:01:36.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63006db90 msgr2=0x7ff630152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63006db90 0x7ff630152340 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff63006e800 tx=0x7ff62000bec0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 shutdown_connections 2023-08-31T02:01:36.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff61406a0e0 0x7ff61406c5a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6301593b0 0x7ff6300c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63006db90 0x7ff630152340 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 --2- 172.21.15.84:0/399247401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6300b23e0 0x7ff63015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 >> 172.21.15.84:0/399247401 conn(0x7ff6300afb00 msgr2=0x7ff6300c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:36.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 shutdown_connections 2023-08-31T02:01:36.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.627+0000 7ff637b42700 1 -- 172.21.15.84:0/399247401 wait complete. 2023-08-31T02:01:36.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:01:36.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.763+0000 7ff134186700 1 -- 172.21.15.84:0/2854749019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b2d0 msgr2=0x7ff12c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.763+0000 7ff134186700 1 --2- 172.21.15.84:0/2854749019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b2d0 0x7ff12c0b4e60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0d22f0 tx=0x7ff11c009ba0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.763+0000 7ff134186700 1 -- 172.21.15.84:0/2854749019 shutdown_connections 2023-08-31T02:01:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.764+0000 7ff134186700 1 --2- 172.21.15.84:0/2854749019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b2d0 0x7ff12c0b4e60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.764+0000 7ff134186700 1 --2- 172.21.15.84:0/2854749019 >> v2:172.21.15.170:3300/0 conn(0x7ff12c15b6b0 0x7ff12c0b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.764+0000 7ff134186700 1 -- 172.21.15.84:0/2854749019 >> 172.21.15.84:0/2854749019 conn(0x7ff12c069d90 msgr2=0x7ff12c06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.764+0000 7ff134186700 1 -- 172.21.15.84:0/2854749019 shutdown_connections 2023-08-31T02:01:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.764+0000 7ff134186700 1 -- 172.21.15.84:0/2854749019 wait complete. 2023-08-31T02:01:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.765+0000 7ff134186700 1 Processor -- start 2023-08-31T02:01:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.765+0000 7ff134186700 1 -- start start 2023-08-31T02:01:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff134186700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff12c0cbf60 0x7ff12c151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff134186700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff12c15b2d0 0x7ff12c158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff134186700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b6b0 0x7ff12c159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff134186700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c15ab10 con 0x7ff12c15b6b0 2023-08-31T02:01:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff134186700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c151c90 con 0x7ff12c15b2d0 2023-08-31T02:01:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff134186700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c59d0 con 0x7ff12c0cbf60 2023-08-31T02:01:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff132723700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b6b0 0x7ff12c159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff132723700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b6b0 0x7ff12c159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54196/0 (socket says 172.21.15.84:54196) 2023-08-31T02:01:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff132723700 1 -- 172.21.15.84:0/2143645625 learned_addr learned my addr 172.21.15.84:0/2143645625 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff131f22700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff12c0cbf60 0x7ff12c151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff131721700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff12c15b2d0 0x7ff12c158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff132723700 1 -- 172.21.15.84:0/2143645625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff12c0cbf60 msgr2=0x7ff12c151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.766+0000 7ff132723700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff12c0cbf60 0x7ff12c151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff132723700 1 -- 172.21.15.84:0/2143645625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff12c15b2d0 msgr2=0x7ff12c158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff132723700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff12c15b2d0 0x7ff12c158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff132723700 1 -- 172.21.15.84:0/2143645625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009520 con 0x7ff12c15b6b0 2023-08-31T02:01:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff132723700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b6b0 0x7ff12c159280 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff12400cb40 tx=0x7ff12400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff1227fc700 1 -- 172.21.15.84:0/2143645625 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400ab50 con 0x7ff12c15b6b0 2023-08-31T02:01:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff1227fc700 1 -- 172.21.15.84:0/2143645625 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff12400ada0 con 0x7ff12c15b6b0 2023-08-31T02:01:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c15bbc0 con 0x7ff12c15b6b0 2023-08-31T02:01:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff1227fc700 1 -- 172.21.15.84:0/2143645625 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124012680 con 0x7ff12c15b6b0 2023-08-31T02:01:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.767+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c15c180 con 0x7ff12c15b6b0 2023-08-31T02:01:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.768+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c04e7c0 con 0x7ff12c15b6b0 2023-08-31T02:01:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.768+0000 7ff1227fc700 1 -- 172.21.15.84:0/2143645625 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff12401a3b0 con 0x7ff12c15b6b0 2023-08-31T02:01:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.769+0000 7ff1227fc700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff11006a0e0 0x7ff11006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.769+0000 7ff1227fc700 1 -- 172.21.15.84:0/2143645625 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff124088ae0 con 0x7ff12c15b6b0 2023-08-31T02:01:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.769+0000 7ff131f22700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff11006a0e0 0x7ff11006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.769+0000 7ff131f22700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff11006a0e0 0x7ff11006c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009810 tx=0x7ff11c019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.773+0000 7ff1227fc700 1 -- 172.21.15.84:0/2143645625 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff124054210 con 0x7ff12c15b6b0 2023-08-31T02:01:36.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.962+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff12c0cb630 con 0x7ff12c15b6b0 2023-08-31T02:01:36.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.963+0000 7ff1227fc700 1 -- 172.21.15.84:0/2143645625 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff12400d150 con 0x7ff12c15b6b0 2023-08-31T02:01:36.956 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:01:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff11006a0e0 msgr2=0x7ff11006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff11006a0e0 0x7ff11006c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009810 tx=0x7ff11c019040 comp rx=0 tx=0).stop 2023-08-31T02:01:36.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b6b0 msgr2=0x7ff12c159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:36.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b6b0 0x7ff12c159280 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff12400cb40 tx=0x7ff12400cf00 comp rx=0 tx=0).stop 2023-08-31T02:01:36.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 shutdown_connections 2023-08-31T02:01:36.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff11006a0e0 0x7ff11006c5a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff12c15b6b0 0x7ff12c159280 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff12c0cbf60 0x7ff12c151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 --2- 172.21.15.84:0/2143645625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff12c15b2d0 0x7ff12c158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:36.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.964+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 >> 172.21.15.84:0/2143645625 conn(0x7ff12c069d90 msgr2=0x7ff12c155940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:36.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.965+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 shutdown_connections 2023-08-31T02:01:36.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:36.965+0000 7ff134186700 1 -- 172.21.15.84:0/2143645625 wait complete. 2023-08-31T02:01:36.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:01:37.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.101+0000 7fb258446700 1 -- 172.21.15.84:0/4028398311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23c003a00 msgr2=0x7fb23c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.101+0000 7fb258446700 1 --2- 172.21.15.84:0/4028398311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23c003a00 0x7fb23c003e20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009bd0 tx=0x7fb23c005880 comp rx=0 tx=0).stop 2023-08-31T02:01:37.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.101+0000 7fb2569e3700 1 -- 172.21.15.84:0/4028398311 reap_dead start 2023-08-31T02:01:37.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.101+0000 7fb258446700 1 -- 172.21.15.84:0/4028398311 shutdown_connections 2023-08-31T02:01:37.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.101+0000 7fb258446700 1 -- 172.21.15.84:0/4028398311 >> 172.21.15.84:0/4028398311 conn(0x7fb2500ca090 msgr2=0x7fb2500ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:37.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.101+0000 7fb258446700 1 -- 172.21.15.84:0/4028398311 shutdown_connections 2023-08-31T02:01:37.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.101+0000 7fb258446700 1 -- 172.21.15.84:0/4028398311 wait complete. 2023-08-31T02:01:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.102+0000 7fb258446700 1 Processor -- start 2023-08-31T02:01:37.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.102+0000 7fb258446700 1 -- start start 2023-08-31T02:01:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb258446700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb23c003a00 0x7fb25014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb258446700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2500c6230 0x7fb25014a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb258446700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2500c1cf0 0x7fb2501567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb258446700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25014a6d0 con 0x7fb2500c6230 2023-08-31T02:01:37.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb258446700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500c1860 con 0x7fb23c003a00 2023-08-31T02:01:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb258446700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25014d110 con 0x7fb2500c1cf0 2023-08-31T02:01:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2500c6230 0x7fb25014a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2500c6230 0x7fb25014a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54214/0 (socket says 172.21.15.84:54214) 2023-08-31T02:01:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 -- 172.21.15.84:0/3057684737 learned_addr learned my addr 172.21.15.84:0/3057684737 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:37.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2561e2700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb23c003a00 0x7fb25014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2569e3700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2500c1cf0 0x7fb2501567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 -- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2500c1cf0 msgr2=0x7fb2501567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2500c1cf0 0x7fb2501567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 -- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb23c003a00 msgr2=0x7fb25014d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb23c003a00 0x7fb25014d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 -- 172.21.15.84:0/3057684737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500c67f0 con 0x7fb2500c6230 2023-08-31T02:01:37.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2569e3700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2500c1cf0 0x7fb2501567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:37.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb2559e1700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2500c6230 0x7fb25014a190 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb240000fb0 tx=0x7fb24000eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:37.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb246ffd700 1 -- 172.21.15.84:0/3057684737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240010890 con 0x7fb2500c6230 2023-08-31T02:01:37.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb246ffd700 1 -- 172.21.15.84:0/3057684737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb240010ae0 con 0x7fb2500c6230 2023-08-31T02:01:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2500c1210 con 0x7fb2500c6230 2023-08-31T02:01:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb246ffd700 1 -- 172.21.15.84:0/3057684737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240011460 con 0x7fb2500c6230 2023-08-31T02:01:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.103+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2500c2170 con 0x7fb2500c6230 2023-08-31T02:01:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.104+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2500c19d0 con 0x7fb2500c6230 2023-08-31T02:01:37.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.105+0000 7fb246ffd700 1 -- 172.21.15.84:0/3057684737 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2400115c0 con 0x7fb2500c6230 2023-08-31T02:01:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.105+0000 7fb246ffd700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb23406a0e0 0x7fb23406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.105+0000 7fb2561e2700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb23406a0e0 0x7fb23406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.105+0000 7fb246ffd700 1 -- 172.21.15.84:0/3057684737 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb240088c40 con 0x7fb2500c6230 2023-08-31T02:01:37.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.105+0000 7fb2561e2700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb23406a0e0 0x7fb23406c5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb2500ad290 tx=0x7fb24c004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:37.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.109+0000 7fb246ffd700 1 -- 172.21.15.84:0/3057684737 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb2400542e0 con 0x7fb2500c6230 2023-08-31T02:01:37.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.317+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb25004e7c0 con 0x7fb2500c6230 2023-08-31T02:01:37.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.317+0000 7fb246ffd700 1 -- 172.21.15.84:0/3057684737 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb24001f020 con 0x7fb2500c6230 2023-08-31T02:01:37.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb23406a0e0 msgr2=0x7fb23406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb23406a0e0 0x7fb23406c5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb2500ad290 tx=0x7fb24c004750 comp rx=0 tx=0).stop 2023-08-31T02:01:37.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2500c6230 msgr2=0x7fb25014a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2500c6230 0x7fb25014a190 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb240000fb0 tx=0x7fb24000eab0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 shutdown_connections 2023-08-31T02:01:37.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb23406a0e0 0x7fb23406c5a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2500c1cf0 0x7fb2501567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb23c003a00 0x7fb25014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 --2- 172.21.15.84:0/3057684737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2500c6230 0x7fb25014a190 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 >> 172.21.15.84:0/3057684737 conn(0x7fb2500ca090 msgr2=0x7fb25015a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 shutdown_connections 2023-08-31T02:01:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.319+0000 7fb258446700 1 -- 172.21.15.84:0/3057684737 wait complete. 2023-08-31T02:01:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:01:37.324 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-08-31T02:01:37.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:37.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-31T02:01:37.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[122501]: fuse finished with error 0 and tester_r 0 2023-08-31T02:01:37.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:01:37.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:37.363 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T02:01:37.489 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:01:37.490 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:37.514 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:37.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.644+0000 7f3f30420700 1 -- 172.21.15.84:0/3947433216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f280cb640 msgr2=0x7f3f280cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.644+0000 7f3f30420700 1 --2- 172.21.15.84:0/3947433216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f280cb640 0x7f3f280cbad0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009fd0 tx=0x7f3f2000b380 comp rx=0 tx=0).stop 2023-08-31T02:01:37.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.644+0000 7f3f30420700 1 -- 172.21.15.84:0/3947433216 shutdown_connections 2023-08-31T02:01:37.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.644+0000 7f3f30420700 1 --2- 172.21.15.84:0/3947433216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f280cb640 0x7f3f280cbad0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.644+0000 7f3f30420700 1 --2- 172.21.15.84:0/3947433216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f2815bd60 0x7f3f2815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.644+0000 7f3f30420700 1 -- 172.21.15.84:0/3947433216 >> 172.21.15.84:0/3947433216 conn(0x7f3f280cd740 msgr2=0x7f3f280cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:37.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.645+0000 7f3f30420700 1 -- 172.21.15.84:0/3947433216 shutdown_connections 2023-08-31T02:01:37.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.645+0000 7f3f30420700 1 -- 172.21.15.84:0/3947433216 wait complete. 2023-08-31T02:01:37.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f30420700 1 Processor -- start 2023-08-31T02:01:37.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f30420700 1 -- start start 2023-08-31T02:01:37.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f30420700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f280cb640 0x7f3f281451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f30420700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f28158260 0x7f3f281ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f30420700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2815bd60 0x7f3f280c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f30420700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f281f0ce0 con 0x7f3f2815bd60 2023-08-31T02:01:37.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f30420700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28145700 con 0x7f3f28158260 2023-08-31T02:01:37.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f30420700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f281f0060 con 0x7f3f280cb640 2023-08-31T02:01:37.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.646+0000 7f3f2e9bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2815bd60 0x7f3f280c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e9bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2815bd60 0x7f3f280c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54230/0 (socket says 172.21.15.84:54230) 2023-08-31T02:01:37.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e9bd700 1 -- 172.21.15.84:0/1470975542 learned_addr learned my addr 172.21.15.84:0/1470975542 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:37.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2d9bb700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f28158260 0x7f3f281ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e1bc700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f280cb640 0x7f3f281451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e9bd700 1 -- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f280cb640 msgr2=0x7f3f281451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e9bd700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f280cb640 0x7f3f281451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e9bd700 1 -- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f28158260 msgr2=0x7f3f281ef5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e9bd700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f28158260 0x7f3f281ef5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e9bd700 1 -- 172.21.15.84:0/1470975542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20009d00 con 0x7f3f2815bd60 2023-08-31T02:01:37.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2d9bb700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f28158260 0x7f3f281ef5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:37.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f2e9bd700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2815bd60 0x7f3f280c4810 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000b780 tx=0x7f3f20003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:37.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f1effd700 1 -- 172.21.15.84:0/1470975542 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000e040 con 0x7f3f2815bd60 2023-08-31T02:01:37.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f1effd700 1 -- 172.21.15.84:0/1470975542 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3f20007ae0 con 0x7f3f2815bd60 2023-08-31T02:01:37.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f281f0340 con 0x7f3f2815bd60 2023-08-31T02:01:37.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f1effd700 1 -- 172.21.15.84:0/1470975542 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20009450 con 0x7f3f2815bd60 2023-08-31T02:01:37.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.647+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f281f0900 con 0x7f3f2815bd60 2023-08-31T02:01:37.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.648+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2804e7c0 con 0x7f3f2815bd60 2023-08-31T02:01:37.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.648+0000 7f3f1effd700 1 -- 172.21.15.84:0/1470975542 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3f20004030 con 0x7f3f2815bd60 2023-08-31T02:01:37.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.649+0000 7f3f1effd700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f0c06a0e0 0x7f3f0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.649+0000 7f3f1effd700 1 -- 172.21.15.84:0/1470975542 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f200899f0 con 0x7f3f2815bd60 2023-08-31T02:01:37.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.649+0000 7f3f2e1bc700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f0c06a0e0 0x7f3f0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.649+0000 7f3f2e1bc700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f0c06a0e0 0x7f3f0c06c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3f18001730 tx=0x7f3f18009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:37.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.653+0000 7f3f1effd700 1 -- 172.21.15.84:0/1470975542 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3f20055120 con 0x7f3f2815bd60 2023-08-31T02:01:37.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.843+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f2815b870 con 0x7f3f2815bd60 2023-08-31T02:01:37.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.844+0000 7f3f1effd700 1 -- 172.21.15.84:0/1470975542 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f3f20017090 con 0x7f3f2815bd60 2023-08-31T02:01:37.837 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:37.838 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:22.468991+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T02:01:18.799026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T02:01:19.825366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:37.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f0c06a0e0 msgr2=0x7f3f0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f0c06a0e0 0x7f3f0c06c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3f18001730 tx=0x7f3f18009040 comp rx=0 tx=0).stop 2023-08-31T02:01:37.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2815bd60 msgr2=0x7f3f280c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2815bd60 0x7f3f280c4810 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000b780 tx=0x7f3f20003d30 comp rx=0 tx=0).stop 2023-08-31T02:01:37.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 shutdown_connections 2023-08-31T02:01:37.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f0c06a0e0 0x7f3f0c06c5a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2815bd60 0x7f3f280c4810 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f280cb640 0x7f3f281451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 --2- 172.21.15.84:0/1470975542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f28158260 0x7f3f281ef5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 >> 172.21.15.84:0/1470975542 conn(0x7f3f280cd740 msgr2=0x7f3f281560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:37.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 shutdown_connections 2023-08-31T02:01:37.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.846+0000 7f3f30420700 1 -- 172.21.15.84:0/1470975542 wait complete. 2023-08-31T02:01:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T02:01:18.799026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T02:01:19.825366+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T02:01:37.852 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:01:37.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.985+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3022597214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac15d750 msgr2=0x7ff8ac0ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.985+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3022597214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac15d750 0x7ff8ac0ccce0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0b1cc0 tx=0x7ff8a0009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:37.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.985+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3022597214 shutdown_connections 2023-08-31T02:01:37.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.985+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3022597214 >> v2:172.21.15.170:3300/0 conn(0x7ff8ac159320 0x7ff8ac0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.985+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3022597214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac15d750 0x7ff8ac0ccce0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.985+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3022597214 >> 172.21.15.84:0/3022597214 conn(0x7ff8ac0b0c40 msgr2=0x7ff8ac0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:37.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.985+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3022597214 shutdown_connections 2023-08-31T02:01:37.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.985+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3022597214 wait complete. 2023-08-31T02:01:37.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.986+0000 7ff8b0a91700 1 Processor -- start 2023-08-31T02:01:37.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.986+0000 7ff8b0a91700 1 -- start start 2023-08-31T02:01:37.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8b0a91700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8ac0cd220 0x7ff8ac0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8b0a91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac159320 0x7ff8ac156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8b0a91700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8ac15d750 0x7ff8ac15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8b0a91700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0ae470 con 0x7ff8ac159320 2023-08-31T02:01:37.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8b0a91700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c6720 con 0x7ff8ac0cd220 2023-08-31T02:01:37.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8b0a91700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac06d170 con 0x7ff8ac15d750 2023-08-31T02:01:37.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac159320 0x7ff8ac156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac159320 0x7ff8ac156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54240/0 (socket says 172.21.15.84:54240) 2023-08-31T02:01:37.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8a9d9b700 1 -- 172.21.15.84:0/3566099853 learned_addr learned my addr 172.21.15.84:0/3566099853 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:37.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8aa59c700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8ac0cd220 0x7ff8ac0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.987+0000 7ff8aad9d700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8ac15d750 0x7ff8ac15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8a9d9b700 1 -- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8ac15d750 msgr2=0x7ff8ac15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8a9d9b700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8ac15d750 0x7ff8ac15b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8a9d9b700 1 -- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8ac0cd220 msgr2=0x7ff8ac0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8a9d9b700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8ac0cd220 0x7ff8ac0c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8a9d9b700 1 -- 172.21.15.84:0/3566099853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00095f0 con 0x7ff8ac159320 2023-08-31T02:01:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8aad9d700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8ac15d750 0x7ff8ac15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8a9d9b700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac159320 0x7ff8ac156c70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0000c00 tx=0x7ff8a0005090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff89affd700 1 -- 172.21.15.84:0/3566099853 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a001c070 con 0x7ff8ac159320 2023-08-31T02:01:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff89affd700 1 -- 172.21.15.84:0/3566099853 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff8a0004320 con 0x7ff8ac159320 2023-08-31T02:01:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff89affd700 1 -- 172.21.15.84:0/3566099853 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000b760 con 0x7ff8ac159320 2023-08-31T02:01:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac0addb0 con 0x7ff8ac159320 2023-08-31T02:01:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.988+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac06ce10 con 0x7ff8ac159320 2023-08-31T02:01:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.989+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac0adc10 con 0x7ff8ac159320 2023-08-31T02:01:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.989+0000 7ff89affd700 1 -- 172.21.15.84:0/3566099853 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff8a000b8c0 con 0x7ff8ac159320 2023-08-31T02:01:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.990+0000 7ff89affd700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff88c06a0b0 0x7ff88c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.990+0000 7ff89affd700 1 -- 172.21.15.84:0/3566099853 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff8a0089af0 con 0x7ff8ac159320 2023-08-31T02:01:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.990+0000 7ff8aa59c700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff88c06a0b0 0x7ff88c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.990+0000 7ff8aa59c700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff88c06a0b0 0x7ff88c06c570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00ac50 tx=0x7ff89c00a380 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:37.994+0000 7ff89affd700 1 -- 172.21.15.84:0/3566099853 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff8ac0adc10 con 0x7ff8ac159320 2023-08-31T02:01:38.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.183+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8ac0adc10 con 0x7ff8ac159320 2023-08-31T02:01:38.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.184+0000 7ff89affd700 1 -- 172.21.15.84:0/3566099853 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8ac0adc10 con 0x7ff8ac159320 2023-08-31T02:01:38.177 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:01:38.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff88c06a0b0 msgr2=0x7ff88c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff88c06a0b0 0x7ff88c06c570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00ac50 tx=0x7ff89c00a380 comp rx=0 tx=0).stop 2023-08-31T02:01:38.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac159320 msgr2=0x7ff8ac156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac159320 0x7ff8ac156c70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0000c00 tx=0x7ff8a0005090 comp rx=0 tx=0).stop 2023-08-31T02:01:38.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 shutdown_connections 2023-08-31T02:01:38.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ff88c06a0b0 0x7ff88c06c570 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8ac15d750 0x7ff8ac15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8ac0cd220 0x7ff8ac0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 --2- 172.21.15.84:0/3566099853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac159320 0x7ff8ac156c70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 >> 172.21.15.84:0/3566099853 conn(0x7ff8ac0b0c40 msgr2=0x7ff8ac158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 shutdown_connections 2023-08-31T02:01:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.186+0000 7ff8b0a91700 1 -- 172.21.15.84:0/3566099853 wait complete. 2023-08-31T02:01:38.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:01:38.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.323+0000 7febb3c9a700 1 -- 172.21.15.84:0/743797603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac157890 msgr2=0x7febac0b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.323+0000 7febb3c9a700 1 --2- 172.21.15.84:0/743797603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac157890 0x7febac0b05f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7feb9c005fd0 tx=0x7feb9c009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:38.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.323+0000 7febb3c9a700 1 -- 172.21.15.84:0/743797603 shutdown_connections 2023-08-31T02:01:38.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.323+0000 7febb3c9a700 1 --2- 172.21.15.84:0/743797603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac157890 0x7febac0b05f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.323+0000 7febb3c9a700 1 --2- 172.21.15.84:0/743797603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febac0b0b30 0x7febac070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.323+0000 7febb3c9a700 1 -- 172.21.15.84:0/743797603 >> 172.21.15.84:0/743797603 conn(0x7febac0cd980 msgr2=0x7febac0cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:38.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.323+0000 7febb3c9a700 1 -- 172.21.15.84:0/743797603 shutdown_connections 2023-08-31T02:01:38.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.323+0000 7febb3c9a700 1 -- 172.21.15.84:0/743797603 wait complete. 2023-08-31T02:01:38.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.324+0000 7febb3c9a700 1 Processor -- start 2023-08-31T02:01:38.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.324+0000 7febb3c9a700 1 -- start start 2023-08-31T02:01:38.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb3c9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac070580 0x7febac06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb3c9a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febac0b0b30 0x7febac151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb3c9a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac157890 0x7febac0c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb3c9a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac152250 con 0x7febac070580 2023-08-31T02:01:38.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb3c9a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac06ad20 con 0x7febac157890 2023-08-31T02:01:38.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb3c9a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c4be0 con 0x7febac0b0b30 2023-08-31T02:01:38.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac070580 0x7febac06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:38.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac070580 0x7febac06a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54252/0 (socket says 172.21.15.84:54252) 2023-08-31T02:01:38.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 -- 172.21.15.84:0/1518492334 learned_addr learned my addr 172.21.15.84:0/1518492334 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:38.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1235700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febac0b0b30 0x7febac151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:38.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb2237700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac157890 0x7febac0c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:38.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 -- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febac0b0b30 msgr2=0x7febac151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febac0b0b30 0x7febac151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 -- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac157890 msgr2=0x7febac0c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac157890 0x7febac0c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 -- 172.21.15.84:0/1518492334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0095f0 con 0x7febac070580 2023-08-31T02:01:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb2237700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac157890 0x7febac0c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:38.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7febb1a36700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac070580 0x7febac06a5a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7febac0710c0 tx=0x7feb9c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:38.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.325+0000 7feba27fc700 1 -- 172.21.15.84:0/1518492334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c01c070 con 0x7febac070580 2023-08-31T02:01:38.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.326+0000 7feba27fc700 1 -- 172.21.15.84:0/1518492334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb9c003890 con 0x7febac070580 2023-08-31T02:01:38.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.326+0000 7feba27fc700 1 -- 172.21.15.84:0/1518492334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0045f0 con 0x7febac070580 2023-08-31T02:01:38.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.326+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac0c4ec0 con 0x7febac070580 2023-08-31T02:01:38.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.326+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac0c5480 con 0x7febac070580 2023-08-31T02:01:38.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.327+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac0c5690 con 0x7febac070580 2023-08-31T02:01:38.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.327+0000 7feba27fc700 1 -- 172.21.15.84:0/1518492334 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb9c003c60 con 0x7febac070580 2023-08-31T02:01:38.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.327+0000 7feba27fc700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feb9006a0e0 0x7feb9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.327+0000 7feba27fc700 1 -- 172.21.15.84:0/1518492334 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb9c0898a0 con 0x7febac070580 2023-08-31T02:01:38.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.327+0000 7febb1235700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feb9006a0e0 0x7feb9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:38.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.328+0000 7febb1235700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feb9006a0e0 0x7feb9006c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7febac155bf0 tx=0x7feba800b410 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:38.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.331+0000 7feba27fc700 1 -- 172.21.15.84:0/1518492334 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb9c054fd0 con 0x7febac070580 2023-08-31T02:01:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.519+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febac04e7c0 con 0x7febac070580 2023-08-31T02:01:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.519+0000 7feba27fc700 1 -- 172.21.15.84:0/1518492334 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb9c0585f0 con 0x7febac070580 2023-08-31T02:01:38.512 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feb9006a0e0 msgr2=0x7feb9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feb9006a0e0 0x7feb9006c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7febac155bf0 tx=0x7feba800b410 comp rx=0 tx=0).stop 2023-08-31T02:01:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac070580 msgr2=0x7febac06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac070580 0x7febac06a5a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7febac0710c0 tx=0x7feb9c009f90 comp rx=0 tx=0).stop 2023-08-31T02:01:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 shutdown_connections 2023-08-31T02:01:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7feb9006a0e0 0x7feb9006c5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac157890 0x7febac0c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac070580 0x7febac06a5a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.521+0000 7febb3c9a700 1 --2- 172.21.15.84:0/1518492334 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febac0b0b30 0x7febac151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.522+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 >> 172.21.15.84:0/1518492334 conn(0x7febac0cd980 msgr2=0x7febac0c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.522+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 shutdown_connections 2023-08-31T02:01:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.522+0000 7febb3c9a700 1 -- 172.21.15.84:0/1518492334 wait complete. 2023-08-31T02:01:38.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:01:38.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2454335466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015bce0 msgr2=0x7f0f000c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2454335466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015bce0 0x7f0f000c9bc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0f000661a0 tx=0x7f0ef0009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:38.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2454335466 shutdown_connections 2023-08-31T02:01:38.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2454335466 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f000ca100 0x7f0f000c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2454335466 >> v2:172.21.15.170:3300/0 conn(0x7f0f0015b790 0x7f0f0006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2454335466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015bce0 0x7f0f000c9bc0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2454335466 >> 172.21.15.84:0/2454335466 conn(0x7f0f000afb00 msgr2=0x7f0f000aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:38.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2454335466 shutdown_connections 2023-08-31T02:01:38.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.660+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2454335466 wait complete. 2023-08-31T02:01:38.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.661+0000 7f0f07e1f700 1 Processor -- start 2023-08-31T02:01:38.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.661+0000 7f0f07e1f700 1 -- start start 2023-08-31T02:01:38.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f07e1f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f000ca100 0x7f0f000c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f07e1f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015b790 0x7f0f000c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f07e1f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0015bce0 0x7f0f00152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f07e1f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00159870 con 0x7f0f0015b790 2023-08-31T02:01:38.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f07e1f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00159dc0 con 0x7f0f000ca100 2023-08-31T02:01:38.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f07e1f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000b0d20 con 0x7f0f0015bce0 2023-08-31T02:01:38.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015b790 0x7f0f000c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:38.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015b790 0x7f0f000c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54268/0 (socket says 172.21.15.84:54268) 2023-08-31T02:01:38.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 -- 172.21.15.84:0/2207602638 learned_addr learned my addr 172.21.15.84:0/2207602638 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:38.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f063bc700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0015bce0 0x7f0f00152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:38.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f05bbb700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f000ca100 0x7f0f000c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:38.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 -- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0015bce0 msgr2=0x7f0f00152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0015bce0 0x7f0f00152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 -- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f000ca100 msgr2=0x7f0f000c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f000ca100 0x7f0f000c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 -- 172.21.15.84:0/2207602638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00095f0 con 0x7f0f0015b790 2023-08-31T02:01:38.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f05bbb700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f000ca100 0x7f0f000c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:38.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f053ba700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015b790 0x7f0f000c6f30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0f0006e800 tx=0x7f0ef0004240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:38.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0ef67fc700 1 -- 172.21.15.84:0/2207602638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef001c070 con 0x7f0f0015b790 2023-08-31T02:01:38.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0ef67fc700 1 -- 172.21.15.84:0/2207602638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ef0003890 con 0x7f0f0015b790 2023-08-31T02:01:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000c7470 con 0x7f0f0015b790 2023-08-31T02:01:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0ef67fc700 1 -- 172.21.15.84:0/2207602638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00045f0 con 0x7f0f0015b790 2023-08-31T02:01:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.662+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f000b0fc0 con 0x7f0f0015b790 2023-08-31T02:01:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.663+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f000b11e0 con 0x7f0f0015b790 2023-08-31T02:01:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.664+0000 7f0ef67fc700 1 -- 172.21.15.84:0/2207602638 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ef0003ca0 con 0x7f0f0015b790 2023-08-31T02:01:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.664+0000 7f0ef67fc700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.664+0000 7f0ef67fc700 1 -- 172.21.15.84:0/2207602638 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0ef0089810 con 0x7f0f0015b790 2023-08-31T02:01:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.664+0000 7f0f05bbb700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.664+0000 7f0f05bbb700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0efc005fd0 tx=0x7f0efc005f60 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:38.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.668+0000 7f0ef67fc700 1 -- 172.21.15.84:0/2207602638 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ef0054f40 con 0x7f0f0015b790 2023-08-31T02:01:38.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.856+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f0004e7c0 con 0x7f0f0015b790 2023-08-31T02:01:38.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.857+0000 7f0ef67fc700 1 -- 172.21.15.84:0/2207602638 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ef0058560 con 0x7f0f0015b790 2023-08-31T02:01:38.850 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:01:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ee406a0e0 msgr2=0x7f0ee406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0efc005fd0 tx=0x7f0efc005f60 comp rx=0 tx=0).stop 2023-08-31T02:01:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015b790 msgr2=0x7f0f000c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015b790 0x7f0f000c6f30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0f0006e800 tx=0x7f0ef0004240 comp rx=0 tx=0).stop 2023-08-31T02:01:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 shutdown_connections 2023-08-31T02:01:38.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0015bce0 0x7f0f00152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f000ca100 0x7f0f000c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 --2- 172.21.15.84:0/2207602638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f0015b790 0x7f0f000c6f30 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 >> 172.21.15.84:0/2207602638 conn(0x7f0f000afb00 msgr2=0x7f0f0015c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:38.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 shutdown_connections 2023-08-31T02:01:38.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.859+0000 7f0f07e1f700 1 -- 172.21.15.84:0/2207602638 wait complete. 2023-08-31T02:01:38.863 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T02:01:38.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.995+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3302762822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce340b0790 msgr2=0x7fce340b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:38.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.995+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3302762822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce340b0790 0x7fce340b0c00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fce340cba60 tx=0x7fce2c00b330 comp rx=0 tx=0).stop 2023-08-31T02:01:38.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.995+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3302762822 shutdown_connections 2023-08-31T02:01:38.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.995+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3302762822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce340b0790 0x7fce340b0c00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.995+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3302762822 >> v2:172.21.15.170:3300/0 conn(0x7fce340b00c0 0x7fce340af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:38.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.995+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3302762822 >> 172.21.15.84:0/3302762822 conn(0x7fce34069b80 msgr2=0x7fce34069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:38.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.995+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3302762822 shutdown_connections 2023-08-31T02:01:38.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.995+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3302762822 wait complete. 2023-08-31T02:01:38.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.996+0000 7fce3c5ba700 1 Processor -- start 2023-08-31T02:01:38.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3c5ba700 1 -- start start 2023-08-31T02:01:38.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3c5ba700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce340b00c0 0x7fce340c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3c5ba700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce340b0790 0x7fce34154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:38.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3c5ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce341591f0 0x7fce341f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:39.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3c5ba700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34155ef0 con 0x7fce341591f0 2023-08-31T02:01:39.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3c5ba700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce341e2500 con 0x7fce340b0790 2023-08-31T02:01:39.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3c5ba700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce341553d0 con 0x7fce340b00c0 2023-08-31T02:01:39.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3ab57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce341591f0 0x7fce341f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:39.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3ab57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce341591f0 0x7fce341f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54284/0 (socket says 172.21.15.84:54284) 2023-08-31T02:01:39.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce3ab57700 1 -- 172.21.15.84:0/3640057704 learned_addr learned my addr 172.21.15.84:0/3640057704 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:39.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.997+0000 7fce39b55700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce340b0790 0x7fce34154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:39.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3a356700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce340b00c0 0x7fce340c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:39.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3ab57700 1 -- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce340b00c0 msgr2=0x7fce340c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3ab57700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce340b00c0 0x7fce340c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3ab57700 1 -- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce340b0790 msgr2=0x7fce34154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3ab57700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce340b0790 0x7fce34154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3ab57700 1 -- 172.21.15.84:0/3640057704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c009c40 con 0x7fce341591f0 2023-08-31T02:01:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce39b55700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce340b0790 0x7fce34154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3ab57700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce341591f0 0x7fce341f10a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00b730 tx=0x7fce2c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce2affd700 1 -- 172.21.15.84:0/3640057704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c00e040 con 0x7fce341591f0 2023-08-31T02:01:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce2affd700 1 -- 172.21.15.84:0/3640057704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce2c00be90 con 0x7fce341591f0 2023-08-31T02:01:39.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce341e21d0 con 0x7fce341591f0 2023-08-31T02:01:39.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce2affd700 1 -- 172.21.15.84:0/3640057704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c01d6c0 con 0x7fce341591f0 2023-08-31T02:01:39.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.998+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce34155930 con 0x7fce341591f0 2023-08-31T02:01:39.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.999+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce341e2690 con 0x7fce341591f0 2023-08-31T02:01:39.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:38.999+0000 7fce2affd700 1 -- 172.21.15.84:0/3640057704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce2c01d820 con 0x7fce341591f0 2023-08-31T02:01:39.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.000+0000 7fce2affd700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fce1806a0e0 0x7fce1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.000+0000 7fce2affd700 1 -- 172.21.15.84:0/3640057704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fce2c08a0c0 con 0x7fce341591f0 2023-08-31T02:01:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.000+0000 7fce3a356700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fce1806a0e0 0x7fce1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.000+0000 7fce3a356700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fce1806a0e0 0x7fce1806c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce24004740 tx=0x7fce24009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.004+0000 7fce2affd700 1 -- 172.21.15.84:0/3640057704 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fce2c055910 con 0x7fce341591f0 2023-08-31T02:01:39.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.214+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fce3404e7c0 con 0x7fce341591f0 2023-08-31T02:01:39.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.214+0000 7fce2affd700 1 -- 172.21.15.84:0/3640057704 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7fce2c058f30 con 0x7fce341591f0 2023-08-31T02:01:39.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fce1806a0e0 msgr2=0x7fce1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fce1806a0e0 0x7fce1806c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce24004740 tx=0x7fce24009040 comp rx=0 tx=0).stop 2023-08-31T02:01:39.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce341591f0 msgr2=0x7fce341f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce341591f0 0x7fce341f10a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00b730 tx=0x7fce2c0077e0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 shutdown_connections 2023-08-31T02:01:39.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fce1806a0e0 0x7fce1806c5a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce341591f0 0x7fce341f10a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce340b00c0 0x7fce340c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 --2- 172.21.15.84:0/3640057704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce340b0790 0x7fce34154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 >> 172.21.15.84:0/3640057704 conn(0x7fce34069b80 msgr2=0x7fce3406eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 shutdown_connections 2023-08-31T02:01:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.216+0000 7fce3c5ba700 1 -- 172.21.15.84:0/3640057704 wait complete. 2023-08-31T02:01:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-08-31T02:01:39.221 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2023-08-31T02:01:39.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:39.222 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-08-31T02:01:39.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[110980]: fuse finished with error 0 and tester_r 0 2023-08-31T02:01:39.264 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:01:39.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:39.266 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-31T02:01:39.349 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:01:39.349 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:39.367 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12633 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-08-31T02:01:39.367 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:01:39.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:39.368 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-31T02:01:39.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:01:39.424 INFO:teuthology.orchestra.run.smithi084.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-31T02:01:39.425 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:01:39.425 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:39.445 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=32,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=591 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-08-31T02:01:39.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:01:39.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:39.446 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-31T02:01:39.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:01:39.504 INFO:teuthology.orchestra.run.smithi170.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-31T02:01:39.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.635+0000 7f4c36a2d700 1 -- 172.21.15.84:0/1179001478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 msgr2=0x7f4c18003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.635+0000 7f4c36a2d700 1 --2- 172.21.15.84:0/1179001478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 0x7f4c18003e50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009bb0 tx=0x7f4c18005880 comp rx=0 tx=0).stop 2023-08-31T02:01:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.635+0000 7f4c34fca700 1 -- 172.21.15.84:0/1179001478 reap_dead start 2023-08-31T02:01:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.635+0000 7f4c36a2d700 1 -- 172.21.15.84:0/1179001478 shutdown_connections 2023-08-31T02:01:39.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.635+0000 7f4c36a2d700 1 -- 172.21.15.84:0/1179001478 >> 172.21.15.84:0/1179001478 conn(0x7f4c300caa20 msgr2=0x7f4c300cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:39.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.635+0000 7f4c36a2d700 1 -- 172.21.15.84:0/1179001478 shutdown_connections 2023-08-31T02:01:39.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.635+0000 7f4c36a2d700 1 -- 172.21.15.84:0/1179001478 wait complete. 2023-08-31T02:01:39.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.636+0000 7f4c36a2d700 1 Processor -- start 2023-08-31T02:01:39.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.636+0000 7f4c36a2d700 1 -- start start 2023-08-31T02:01:39.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c36a2d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 0x7f4c301edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:39.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c36a2d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c300aee20 0x7f4c301ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:39.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c36a2d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c301eb4c0 0x7f4c300c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:39.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c36a2d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c301eefc0 con 0x7f4c18003a30 2023-08-31T02:01:39.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c36a2d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c301ee4f0 con 0x7f4c300aee20 2023-08-31T02:01:39.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c36a2d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300c7f60 con 0x7f4c301eb4c0 2023-08-31T02:01:39.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c2ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 0x7f4c301edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:39.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c2ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 0x7f4c301edfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54300/0 (socket says 172.21.15.84:54300) 2023-08-31T02:01:39.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.637+0000 7f4c2ffff700 1 -- 172.21.15.84:0/2451137280 learned_addr learned my addr 172.21.15.84:0/2451137280 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:39.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2ffff700 1 -- 172.21.15.84:0/2451137280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c301eb4c0 msgr2=0x7f4c300c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2ffff700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c301eb4c0 0x7f4c300c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2ffff700 1 -- 172.21.15.84:0/2451137280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c300aee20 msgr2=0x7f4c301ef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2ffff700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c300aee20 0x7f4c301ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2ffff700 1 -- 172.21.15.84:0/2451137280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c301ef6b0 con 0x7f4c18003a30 2023-08-31T02:01:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2ffff700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 0x7f4c301edfb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4c24016000 tx=0x7f4c240058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2cff9700 1 -- 172.21.15.84:0/2451137280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400ea50 con 0x7f4c18003a30 2023-08-31T02:01:39.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2cff9700 1 -- 172.21.15.84:0/2451137280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4c2400ebb0 con 0x7f4c18003a30 2023-08-31T02:01:39.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c300c7c30 con 0x7f4c18003a30 2023-08-31T02:01:39.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c2cff9700 1 -- 172.21.15.84:0/2451137280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24003680 con 0x7f4c18003a30 2023-08-31T02:01:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.638+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c301eea00 con 0x7f4c18003a30 2023-08-31T02:01:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.639+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3004e7c0 con 0x7f4c18003a30 2023-08-31T02:01:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.639+0000 7f4c2cff9700 1 -- 172.21.15.84:0/2451137280 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4c240037e0 con 0x7f4c18003a30 2023-08-31T02:01:39.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.640+0000 7f4c2cff9700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4c1c06a0e0 0x7f4c1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:39.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.640+0000 7f4c2cff9700 1 -- 172.21.15.84:0/2451137280 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4c24014070 con 0x7f4c18003a30 2023-08-31T02:01:39.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.640+0000 7f4c2f7fe700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4c1c06a0e0 0x7f4c1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:39.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.640+0000 7f4c2f7fe700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4c1c06a0e0 0x7f4c1c06c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000c00 tx=0x7f4c20006830 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.644+0000 7f4c2cff9700 1 -- 172.21.15.84:0/2451137280 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4c24059490 con 0x7f4c18003a30 2023-08-31T02:01:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.876+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c3006b870 con 0x7f4c18003a30 2023-08-31T02:01:39.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.877+0000 7f4c2cff9700 1 -- 172.21.15.84:0/2451137280 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f4c24005b40 con 0x7f4c18003a30 2023-08-31T02:01:39.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:39.870 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5009,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3211732680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3211732680},{"type":"v1","addr":"172.21.15.170:6834","nonce":3211732680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5012,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2965794759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2965794759},{"type":"v1","addr":"172.21.15.170:6835","nonce":2965794759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2457559549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2457559549},{"type":"v1","addr":"172.21.15.84:6837","nonce":2457559549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T02:01:20.870197+0000","modified":"2023-08-31T02:01:24.485132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/915893970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":915893970},{"type":"v1","addr":"172.21.15.84:6836","nonce":915893970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T02:01:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4c1c06a0e0 msgr2=0x7f4c1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4c1c06a0e0 0x7f4c1c06c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000c00 tx=0x7f4c20006830 comp rx=0 tx=0).stop 2023-08-31T02:01:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 msgr2=0x7f4c301edfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 0x7f4c301edfb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4c24016000 tx=0x7f4c240058e0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 shutdown_connections 2023-08-31T02:01:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4c1c06a0e0 0x7f4c1c06c5a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c301eb4c0 0x7f4c300c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c18003a30 0x7f4c301edfb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 --2- 172.21.15.84:0/2451137280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c300aee20 0x7f4c301ef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 >> 172.21.15.84:0/2451137280 conn(0x7f4c300caa20 msgr2=0x7f4c30151490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 shutdown_connections 2023-08-31T02:01:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:39.879+0000 7f4c36a2d700 1 -- 172.21.15.84:0/2451137280 wait complete. 2023-08-31T02:01:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-08-31T02:01:39.884 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.013+0000 7fd8183b1700 1 -- 172.21.15.84:0/4245674982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 msgr2=0x7fd7fc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.013+0000 7fd8183b1700 1 --2- 172.21.15.84:0/4245674982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 0x7fd7fc003e20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00c2e0 tx=0x7fd7fc005880 comp rx=0 tx=0).stop 2023-08-31T02:01:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.013+0000 7fd81694e700 1 -- 172.21.15.84:0/4245674982 reap_dead start 2023-08-31T02:01:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.014+0000 7fd8183b1700 1 -- 172.21.15.84:0/4245674982 shutdown_connections 2023-08-31T02:01:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.014+0000 7fd8183b1700 1 -- 172.21.15.84:0/4245674982 >> 172.21.15.84:0/4245674982 conn(0x7fd8100caa20 msgr2=0x7fd8100cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.014+0000 7fd8183b1700 1 -- 172.21.15.84:0/4245674982 shutdown_connections 2023-08-31T02:01:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.014+0000 7fd8183b1700 1 -- 172.21.15.84:0/4245674982 wait complete. 2023-08-31T02:01:40.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.015+0000 7fd8183b1700 1 Processor -- start 2023-08-31T02:01:40.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.015+0000 7fd8183b1700 1 -- start start 2023-08-31T02:01:40.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.015+0000 7fd8183b1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 0x7fd810158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.015+0000 7fd8183b1700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd810159020 0x7fd8100c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd8183b1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8100c75c0 0x7fd8100c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd8183b1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101594a0 con 0x7fd7fc003a00 2023-08-31T02:01:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd8183b1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101e0cb0 con 0x7fd8100c75c0 2023-08-31T02:01:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd8183b1700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101e0f90 con 0x7fd810159020 2023-08-31T02:01:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 0x7fd810158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 0x7fd810158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54320/0 (socket says 172.21.15.84:54320) 2023-08-31T02:01:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 -- 172.21.15.84:0/806212758 learned_addr learned my addr 172.21.15.84:0/806212758 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81594c700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd810159020 0x7fd8100c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81694e700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8100c75c0 0x7fd8100c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 -- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd810159020 msgr2=0x7fd8100c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd810159020 0x7fd8100c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 -- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8100c75c0 msgr2=0x7fd8100c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8100c75c0 0x7fd8100c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 -- 172.21.15.84:0/806212758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8101e1270 con 0x7fd7fc003a00 2023-08-31T02:01:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81694e700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8100c75c0 0x7fd8100c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd81614d700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 0x7fd810158ae0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd80c000c00 tx=0x7fd80c006c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd806ffd700 1 -- 172.21.15.84:0/806212758 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c006650 con 0x7fd7fc003a00 2023-08-31T02:01:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd806ffd700 1 -- 172.21.15.84:0/806212758 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd80c003680 con 0x7fd7fc003a00 2023-08-31T02:01:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8101e1550 con 0x7fd7fc003a00 2023-08-31T02:01:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd806ffd700 1 -- 172.21.15.84:0/806212758 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c003a90 con 0x7fd7fc003a00 2023-08-31T02:01:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.016+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8101e1c50 con 0x7fd7fc003a00 2023-08-31T02:01:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.017+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81006b870 con 0x7fd7fc003a00 2023-08-31T02:01:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.018+0000 7fd806ffd700 1 -- 172.21.15.84:0/806212758 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd80c022070 con 0x7fd7fc003a00 2023-08-31T02:01:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.018+0000 7fd806ffd700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7f406a0e0 0x7fd7f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.018+0000 7fd806ffd700 1 -- 172.21.15.84:0/806212758 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd80c08a4f0 con 0x7fd7fc003a00 2023-08-31T02:01:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.018+0000 7fd81594c700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7f406a0e0 0x7fd7f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.018+0000 7fd81594c700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7f406a0e0 0x7fd7f406c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd800005e90 tx=0x7fd800009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:40.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.022+0000 7fd806ffd700 1 -- 172.21.15.84:0/806212758 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd80c055cc0 con 0x7fd7fc003a00 2023-08-31T02:01:40.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.218+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8101e18c0 con 0x7fd7fc003a00 2023-08-31T02:01:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.219+0000 7fd806ffd700 1 -- 172.21.15.84:0/806212758 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16799 (secure 0 0 0) 0x7fd80c0592e0 con 0x7fd7fc003a00 2023-08-31T02:01:40.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:40.213 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":41,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:40.174670+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T02:01:18.799026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T02:01:19.825366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.3d","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.221+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7f406a0e0 msgr2=0x7fd7f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7f406a0e0 0x7fd7f406c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd800005e90 tx=0x7fd800009260 comp rx=0 tx=0).stop 2023-08-31T02:01:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 msgr2=0x7fd810158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 0x7fd810158ae0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd80c000c00 tx=0x7fd80c006c80 comp rx=0 tx=0).stop 2023-08-31T02:01:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 shutdown_connections 2023-08-31T02:01:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd7f406a0e0 0x7fd7f406c5a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8100c75c0 0x7fd8100c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7fc003a00 0x7fd810158ae0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 --2- 172.21.15.84:0/806212758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd810159020 0x7fd8100c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 >> 172.21.15.84:0/806212758 conn(0x7fd8100caa20 msgr2=0x7fd8100c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:40.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 shutdown_connections 2023-08-31T02:01:40.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.222+0000 7fd8183b1700 1 -- 172.21.15.84:0/806212758 wait complete. 2023-08-31T02:01:40.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T01:59:45.089337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T02:01:18.799026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T02:01:19.825366+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T02:01:40.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T02:01:40.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.359+0000 7f259f027700 1 -- 172.21.15.84:0/3467102202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 msgr2=0x7f25980cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.359+0000 7f259f027700 1 --2- 172.21.15.84:0/3467102202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 0x7f25980cbad0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f25980661a0 tx=0x7f259000b380 comp rx=0 tx=0).stop 2023-08-31T02:01:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.359+0000 7f259f027700 1 -- 172.21.15.84:0/3467102202 shutdown_connections 2023-08-31T02:01:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.359+0000 7f259f027700 1 --2- 172.21.15.84:0/3467102202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 0x7f25980cbad0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.359+0000 7f259f027700 1 --2- 172.21.15.84:0/3467102202 >> v2:172.21.15.170:3300/0 conn(0x7f259815b790 0x7f259806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.359+0000 7f259f027700 1 -- 172.21.15.84:0/3467102202 >> 172.21.15.84:0/3467102202 conn(0x7f25980afb00 msgr2=0x7f25980aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.359+0000 7f259f027700 1 -- 172.21.15.84:0/3467102202 shutdown_connections 2023-08-31T02:01:40.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.359+0000 7f259f027700 1 -- 172.21.15.84:0/3467102202 wait complete. 2023-08-31T02:01:40.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.360+0000 7f259f027700 1 Processor -- start 2023-08-31T02:01:40.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.360+0000 7f259f027700 1 -- start start 2023-08-31T02:01:40.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259f027700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 0x7f25981494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259f027700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f259815b790 0x7f25981e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259f027700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f259815bce0 0x7f25980b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259f027700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25981e3d30 con 0x7f25980ca2d0 2023-08-31T02:01:40.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259f027700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25981e4010 con 0x7f259815bce0 2023-08-31T02:01:40.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259f027700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25981e42f0 con 0x7f259815b790 2023-08-31T02:01:40.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259cdc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 0x7f25981494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259cdc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 0x7f25981494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54336/0 (socket says 172.21.15.84:54336) 2023-08-31T02:01:40.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.361+0000 7f259cdc3700 1 -- 172.21.15.84:0/2916401571 learned_addr learned my addr 172.21.15.84:0/2916401571 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:40.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259d5c4700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f259815bce0 0x7f25980b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f2597fff700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f259815b790 0x7f25981e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259cdc3700 1 -- 172.21.15.84:0/2916401571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f259815b790 msgr2=0x7f25981e3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259cdc3700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f259815b790 0x7f25981e3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259cdc3700 1 -- 172.21.15.84:0/2916401571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f259815bce0 msgr2=0x7f25980b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259cdc3700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f259815bce0 0x7f25980b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259cdc3700 1 -- 172.21.15.84:0/2916401571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590009d00 con 0x7f25980ca2d0 2023-08-31T02:01:40.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259cdc3700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 0x7f25981494e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c920 tx=0x7f258c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:40.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f25957fa700 1 -- 172.21.15.84:0/2916401571 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c007b00 con 0x7f25980ca2d0 2023-08-31T02:01:40.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f25957fa700 1 -- 172.21.15.84:0/2916401571 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f258c007d50 con 0x7f25980ca2d0 2023-08-31T02:01:40.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f25957fa700 1 -- 172.21.15.84:0/2916401571 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c004a90 con 0x7f25980ca2d0 2023-08-31T02:01:40.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25981e45d0 con 0x7f25980ca2d0 2023-08-31T02:01:40.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.362+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25981e3960 con 0x7f25980ca2d0 2023-08-31T02:01:40.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.363+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25980c52b0 con 0x7f25980ca2d0 2023-08-31T02:01:40.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.363+0000 7f25957fa700 1 -- 172.21.15.84:0/2916401571 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f258c004bf0 con 0x7f25980ca2d0 2023-08-31T02:01:40.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.364+0000 7f25957fa700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f257c06a0e0 0x7f257c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.364+0000 7f2597fff700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f257c06a0e0 0x7f257c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.364+0000 7f25957fa700 1 -- 172.21.15.84:0/2916401571 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f258c0888d0 con 0x7f25980ca2d0 2023-08-31T02:01:40.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.364+0000 7f2597fff700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f257c06a0e0 0x7f257c06c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f25980c7e70 tx=0x7f2584008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.368+0000 7f25957fa700 1 -- 172.21.15.84:0/2916401571 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f25980c52b0 con 0x7f25980ca2d0 2023-08-31T02:01:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.556+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25980c52b0 con 0x7f25980ca2d0 2023-08-31T02:01:40.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.557+0000 7f25957fa700 1 -- 172.21.15.84:0/2916401571 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25980c52b0 con 0x7f25980ca2d0 2023-08-31T02:01:40.550 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-08-31T02:01:40.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f257c06a0e0 msgr2=0x7f257c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f257c06a0e0 0x7f257c06c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f25980c7e70 tx=0x7f2584008040 comp rx=0 tx=0).stop 2023-08-31T02:01:40.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 msgr2=0x7f25981494e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 0x7f25981494e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c920 tx=0x7f258c00cce0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 shutdown_connections 2023-08-31T02:01:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f257c06a0e0 0x7f257c06c5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f259815bce0 0x7f25980b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25980ca2d0 0x7f25981494e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 --2- 172.21.15.84:0/2916401571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f259815b790 0x7f25981e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 >> 172.21.15.84:0/2916401571 conn(0x7f25980afb00 msgr2=0x7f25980c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 shutdown_connections 2023-08-31T02:01:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.559+0000 7f259f027700 1 -- 172.21.15.84:0/2916401571 wait complete. 2023-08-31T02:01:40.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T02:01:40.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.698+0000 7fe7c45b8700 1 -- 172.21.15.84:0/3669149414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 msgr2=0x7fe7bc06c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.698+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/3669149414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 0x7fe7bc06c720 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0098c0 tx=0x7fe7ac009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.698+0000 7fe7c45b8700 1 -- 172.21.15.84:0/3669149414 shutdown_connections 2023-08-31T02:01:40.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.698+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/3669149414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 0x7fe7bc06c720 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.698+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/3669149414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7bc15bce0 0x7fe7bc0c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.698+0000 7fe7c45b8700 1 -- 172.21.15.84:0/3669149414 >> 172.21.15.84:0/3669149414 conn(0x7fe7bc0afb00 msgr2=0x7fe7bc0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:40.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.698+0000 7fe7c45b8700 1 -- 172.21.15.84:0/3669149414 shutdown_connections 2023-08-31T02:01:40.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.698+0000 7fe7c45b8700 1 -- 172.21.15.84:0/3669149414 wait complete. 2023-08-31T02:01:40.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.699+0000 7fe7c45b8700 1 Processor -- start 2023-08-31T02:01:40.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.699+0000 7fe7c45b8700 1 -- start start 2023-08-31T02:01:40.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c45b8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7bc0ca100 0x7fe7bc155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c45b8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 0x7fe7bc154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c45b8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7bc15bce0 0x7fe7bc06a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c45b8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc158110 con 0x7fe7bc15b790 2023-08-31T02:01:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c45b8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc158530 con 0x7fe7bc0ca100 2023-08-31T02:01:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c45b8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc157770 con 0x7fe7bc15bce0 2023-08-31T02:01:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 0x7fe7bc154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 0x7fe7bc154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54350/0 (socket says 172.21.15.84:54350) 2023-08-31T02:01:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 -- 172.21.15.84:0/171634409 learned_addr learned my addr 172.21.15.84:0/171634409 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c2354700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7bc0ca100 0x7fe7bc155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c2b55700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7bc15bce0 0x7fe7bc06a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 -- 172.21.15.84:0/171634409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7bc15bce0 msgr2=0x7fe7bc06a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7bc15bce0 0x7fe7bc06a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 -- 172.21.15.84:0/171634409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7bc0ca100 msgr2=0x7fe7bc155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7bc0ca100 0x7fe7bc155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 -- 172.21.15.84:0/171634409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac009520 con 0x7fe7bc15b790 2023-08-31T02:01:40.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c1b53700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 0x7fe7bc154610 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c920 tx=0x7fe7b800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:40.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/171634409 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8007b00 con 0x7fe7bc15b790 2023-08-31T02:01:40.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/171634409 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe7b8007d50 con 0x7fe7bc15b790 2023-08-31T02:01:40.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc157a50 con 0x7fe7bc15b790 2023-08-31T02:01:40.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/171634409 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b80186e0 con 0x7fe7bc15b790 2023-08-31T02:01:40.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.700+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc154b50 con 0x7fe7bc15b790 2023-08-31T02:01:40.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.701+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc158250 con 0x7fe7bc15b790 2023-08-31T02:01:40.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.702+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/171634409 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe7b8018840 con 0x7fe7bc15b790 2023-08-31T02:01:40.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.702+0000 7fe7b2ffd700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe7a006a0e0 0x7fe7a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:40.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.702+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/171634409 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7b8013070 con 0x7fe7bc15b790 2023-08-31T02:01:40.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.702+0000 7fe7c2354700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe7a006a0e0 0x7fe7a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:40.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.703+0000 7fe7c2354700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe7a006a0e0 0x7fe7a006c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac000c00 tx=0x7fe7ac0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:40.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.706+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/171634409 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe7bc158250 con 0x7fe7bc15b790 2023-08-31T02:01:40.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.894+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7bc158250 con 0x7fe7bc15b790 2023-08-31T02:01:40.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.895+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/171634409 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7bc158250 con 0x7fe7bc15b790 2023-08-31T02:01:40.888 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-08-31T02:01:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe7a006a0e0 msgr2=0x7fe7a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe7a006a0e0 0x7fe7a006c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac000c00 tx=0x7fe7ac0047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 msgr2=0x7fe7bc154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 0x7fe7bc154610 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c920 tx=0x7fe7b800cce0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 shutdown_connections 2023-08-31T02:01:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe7a006a0e0 0x7fe7a006c5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7bc15bce0 0x7fe7bc06a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7bc0ca100 0x7fe7bc155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 --2- 172.21.15.84:0/171634409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7bc15b790 0x7fe7bc154610 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:40.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 >> 172.21.15.84:0/171634409 conn(0x7fe7bc0afb00 msgr2=0x7fe7bc065a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:40.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 shutdown_connections 2023-08-31T02:01:40.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:40.897+0000 7fe7c45b8700 1 -- 172.21.15.84:0/171634409 wait complete. 2023-08-31T02:01:40.901 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T02:01:41.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.034+0000 7f390f1fc700 1 -- 172.21.15.84:0/851370678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 msgr2=0x7f39080b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.034+0000 7f390f1fc700 1 --2- 172.21.15.84:0/851370678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 0x7f39080b23a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005fd0 tx=0x7f38fc009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:41.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.034+0000 7f390f1fc700 1 -- 172.21.15.84:0/851370678 shutdown_connections 2023-08-31T02:01:41.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.034+0000 7f390f1fc700 1 --2- 172.21.15.84:0/851370678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 0x7f39080b23a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.034+0000 7f390f1fc700 1 --2- 172.21.15.84:0/851370678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f390815d7e0 0x7f390815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.034+0000 7f390f1fc700 1 -- 172.21.15.84:0/851370678 >> 172.21.15.84:0/851370678 conn(0x7f39080cd980 msgr2=0x7f39080cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:41.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.034+0000 7f390f1fc700 1 -- 172.21.15.84:0/851370678 shutdown_connections 2023-08-31T02:01:41.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.034+0000 7f390f1fc700 1 -- 172.21.15.84:0/851370678 wait complete. 2023-08-31T02:01:41.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.035+0000 7f390f1fc700 1 Processor -- start 2023-08-31T02:01:41.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.035+0000 7f390f1fc700 1 -- start start 2023-08-31T02:01:41.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390f1fc700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3908070040 0x7f39080ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390f1fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 0x7f39080c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390f1fc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390815d7e0 0x7f390815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390f1fc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39081f37d0 con 0x7f3908156c60 2023-08-31T02:01:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390f1fc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39080c4630 con 0x7f390815d7e0 2023-08-31T02:01:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390f1fc700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39080c24c0 con 0x7f3908070040 2023-08-31T02:01:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f3907fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 0x7f39080c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f3907fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 0x7f39080c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54364/0 (socket says 172.21.15.84:54364) 2023-08-31T02:01:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f3907fff700 1 -- 172.21.15.84:0/313393769 learned_addr learned my addr 172.21.15.84:0/313393769 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390d799700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390815d7e0 0x7f390815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390cf98700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3908070040 0x7f39080ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f3907fff700 1 -- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3908070040 msgr2=0x7f39080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f3907fff700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3908070040 0x7f39080ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f3907fff700 1 -- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390815d7e0 msgr2=0x7f390815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f3907fff700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390815d7e0 0x7f390815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f3907fff700 1 -- 172.21.15.84:0/313393769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc0095f0 con 0x7f3908156c60 2023-08-31T02:01:41.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.036+0000 7f390d799700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390815d7e0 0x7f390815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:41.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.037+0000 7f3907fff700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 0x7f39080c40f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f38f400d9b0 tx=0x7f38f400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:41.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.037+0000 7f39057fa700 1 -- 172.21.15.84:0/313393769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4004220 con 0x7f3908156c60 2023-08-31T02:01:41.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.037+0000 7f39057fa700 1 -- 172.21.15.84:0/313393769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f38f4004470 con 0x7f3908156c60 2023-08-31T02:01:41.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.037+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39080c21e0 con 0x7f3908156c60 2023-08-31T02:01:41.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.037+0000 7f39057fa700 1 -- 172.21.15.84:0/313393769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4009ba0 con 0x7f3908156c60 2023-08-31T02:01:41.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.037+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39081f33f0 con 0x7f3908156c60 2023-08-31T02:01:41.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.038+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39081f2f70 con 0x7f3908156c60 2023-08-31T02:01:41.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.038+0000 7f39057fa700 1 -- 172.21.15.84:0/313393769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f38f4009d00 con 0x7f3908156c60 2023-08-31T02:01:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.038+0000 7f39057fa700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f38ec06a0e0 0x7f38ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.039+0000 7f39057fa700 1 -- 172.21.15.84:0/313393769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f38f40887e0 con 0x7f3908156c60 2023-08-31T02:01:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.039+0000 7f390cf98700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f38ec06a0e0 0x7f38ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.039+0000 7f390cf98700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f38ec06a0e0 0x7f38ec06c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f38fc000c00 tx=0x7f38fc0047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.043+0000 7f39057fa700 1 -- 172.21.15.84:0/313393769 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f39081f2f70 con 0x7f3908156c60 2023-08-31T02:01:41.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.230+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39081f3910 con 0x7f3908156c60 2023-08-31T02:01:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.231+0000 7f39057fa700 1 -- 172.21.15.84:0/313393769 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39081f3910 con 0x7f3908156c60 2023-08-31T02:01:41.224 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-08-31T02:01:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f38ec06a0e0 msgr2=0x7f38ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f38ec06a0e0 0x7f38ec06c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f38fc000c00 tx=0x7f38fc0047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 msgr2=0x7f39080c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 0x7f39080c40f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f38f400d9b0 tx=0x7f38f400dd70 comp rx=0 tx=0).stop 2023-08-31T02:01:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 shutdown_connections 2023-08-31T02:01:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f38ec06a0e0 0x7f38ec06c5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390815d7e0 0x7f390815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3908070040 0x7f39080ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 --2- 172.21.15.84:0/313393769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3908156c60 0x7f39080c40f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 >> 172.21.15.84:0/313393769 conn(0x7f39080cd980 msgr2=0x7f3908155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 shutdown_connections 2023-08-31T02:01:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.233+0000 7f390f1fc700 1 -- 172.21.15.84:0/313393769 wait complete. 2023-08-31T02:01:41.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.367+0000 7fb8ab748700 1 -- 172.21.15.84:0/1340476785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c9c00 msgr2=0x7fb8a40c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.367+0000 7fb8ab748700 1 --2- 172.21.15.84:0/1340476785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c9c00 0x7fb8a40c8e20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00098c0 tx=0x7fb8a0009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.367+0000 7fb8ab748700 1 -- 172.21.15.84:0/1340476785 shutdown_connections 2023-08-31T02:01:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.367+0000 7fb8ab748700 1 --2- 172.21.15.84:0/1340476785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a40c8500 0x7fb8a40c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.367+0000 7fb8ab748700 1 --2- 172.21.15.84:0/1340476785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c9c00 0x7fb8a40c8e20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.367+0000 7fb8ab748700 1 -- 172.21.15.84:0/1340476785 >> 172.21.15.84:0/1340476785 conn(0x7fb8a40ca930 msgr2=0x7fb8a40cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.367+0000 7fb8ab748700 1 -- 172.21.15.84:0/1340476785 shutdown_connections 2023-08-31T02:01:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.367+0000 7fb8ab748700 1 -- 172.21.15.84:0/1340476785 wait complete. 2023-08-31T02:01:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.368+0000 7fb8ab748700 1 Processor -- start 2023-08-31T02:01:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.368+0000 7fb8ab748700 1 -- start start 2023-08-31T02:01:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8ab748700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c8500 0x7fb8a4143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8ab748700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a40c9c00 0x7fb8a41e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8ab748700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8a40ca030 0x7fb8a41e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8ab748700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c2260 con 0x7fb8a40c8500 2023-08-31T02:01:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8ab748700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41436b0 con 0x7fb8a40ca030 2023-08-31T02:01:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8ab748700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c1650 con 0x7fb8a40c9c00 2023-08-31T02:01:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c8500 0x7fb8a4143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c8500 0x7fb8a4143170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54376/0 (socket says 172.21.15.84:54376) 2023-08-31T02:01:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 -- 172.21.15.84:0/3727280056 learned_addr learned my addr 172.21.15.84:0/3727280056 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a8ce3700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a40c9c00 0x7fb8a41e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a9ce5700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8a40ca030 0x7fb8a41e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 -- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a40c9c00 msgr2=0x7fb8a41e5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a40c9c00 0x7fb8a41e5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 -- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8a40ca030 msgr2=0x7fb8a41e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8a40ca030 0x7fb8a41e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 -- 172.21.15.84:0/3727280056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a0009520 con 0x7fb8a40c8500 2023-08-31T02:01:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a9ce5700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8a40ca030 0x7fb8a41e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8a94e4700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c8500 0x7fb8a4143170 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb89400c920 tx=0x7fb89400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb899ffb700 1 -- 172.21.15.84:0/3727280056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894007b00 con 0x7fb8a40c8500 2023-08-31T02:01:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb899ffb700 1 -- 172.21.15.84:0/3727280056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb894007d50 con 0x7fb8a40c8500 2023-08-31T02:01:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40c1930 con 0x7fb8a40c8500 2023-08-31T02:01:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.369+0000 7fb899ffb700 1 -- 172.21.15.84:0/3727280056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894004a90 con 0x7fb8a40c8500 2023-08-31T02:01:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.370+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40c1ef0 con 0x7fb8a40c8500 2023-08-31T02:01:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.371+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a404e7c0 con 0x7fb8a40c8500 2023-08-31T02:01:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.371+0000 7fb899ffb700 1 -- 172.21.15.84:0/3727280056 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb894004bf0 con 0x7fb8a40c8500 2023-08-31T02:01:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.371+0000 7fb899ffb700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.371+0000 7fb899ffb700 1 -- 172.21.15.84:0/3727280056 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8940889a0 con 0x7fb8a40c8500 2023-08-31T02:01:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.371+0000 7fb8a8ce3700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.371+0000 7fb8a8ce3700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0000c00 tx=0x7fb8a0019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.375+0000 7fb899ffb700 1 -- 172.21.15.84:0/3727280056 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb894053f90 con 0x7fb8a40c8500 2023-08-31T02:01:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.607+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8a40c7ba0 con 0x7fb8a40c8500 2023-08-31T02:01:41.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.607+0000 7fb899ffb700 1 -- 172.21.15.84:0/3727280056 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7fb8940575b0 con 0x7fb8a40c8500 2023-08-31T02:01:41.600 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:41.601 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5009,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3211732680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3211732680},{"type":"v1","addr":"172.21.15.170:6834","nonce":3211732680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5012,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2965794759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2965794759},{"type":"v1","addr":"172.21.15.170:6835","nonce":2965794759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2457559549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2457559549},{"type":"v1","addr":"172.21.15.84:6837","nonce":2457559549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T02:01:20.870197+0000","modified":"2023-08-31T02:01:24.485132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/915893970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":915893970},{"type":"v1","addr":"172.21.15.84:6836","nonce":915893970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T02:01:41.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 msgr2=0x7fb88806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0000c00 tx=0x7fb8a0019040 comp rx=0 tx=0).stop 2023-08-31T02:01:41.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c8500 msgr2=0x7fb8a4143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c8500 0x7fb8a4143170 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb89400c920 tx=0x7fb89400cc30 comp rx=0 tx=0).stop 2023-08-31T02:01:41.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 shutdown_connections 2023-08-31T02:01:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb88806a0e0 0x7fb88806c5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8a40ca030 0x7fb8a41e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40c8500 0x7fb8a4143170 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 --2- 172.21.15.84:0/3727280056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8a40c9c00 0x7fb8a41e5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 >> 172.21.15.84:0/3727280056 conn(0x7fb8a40ca930 msgr2=0x7fb8a41587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 shutdown_connections 2023-08-31T02:01:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.609+0000 7fb8ab748700 1 -- 172.21.15.84:0/3727280056 wait complete. 2023-08-31T02:01:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-08-31T02:01:41.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:41.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.744+0000 7f581db5c700 1 -- 172.21.15.84:0/3902498998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5800004d90 msgr2=0x7f5800005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.744+0000 7f581db5c700 1 --2- 172.21.15.84:0/3902498998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5800004d90 0x7f5800005210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5810006fd0 tx=0x7f5800005880 comp rx=0 tx=0).stop 2023-08-31T02:01:41.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.744+0000 7f5817fff700 1 -- 172.21.15.84:0/3902498998 reap_dead start 2023-08-31T02:01:41.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.744+0000 7f581db5c700 1 -- 172.21.15.84:0/3902498998 shutdown_connections 2023-08-31T02:01:41.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.744+0000 7f581db5c700 1 -- 172.21.15.84:0/3902498998 >> 172.21.15.84:0/3902498998 conn(0x7f58180caa20 msgr2=0x7f58180cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:41.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.744+0000 7f581db5c700 1 -- 172.21.15.84:0/3902498998 shutdown_connections 2023-08-31T02:01:41.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.744+0000 7f581db5c700 1 -- 172.21.15.84:0/3902498998 wait complete. 2023-08-31T02:01:41.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.745+0000 7f581db5c700 1 Processor -- start 2023-08-31T02:01:41.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.745+0000 7f581db5c700 1 -- start start 2023-08-31T02:01:41.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f581db5c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58181576f0 0x7f58181ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f581db5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58180a64c0 0x7f58181f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f581db5c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58181f3890 0x7f58181e2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f581db5c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58181f0620 con 0x7f58180a64c0 2023-08-31T02:01:41.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f581db5c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58181efd80 con 0x7f58181576f0 2023-08-31T02:01:41.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f581db5c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58181f0060 con 0x7f58181f3890 2023-08-31T02:01:41.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58180a64c0 0x7f58181f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58180a64c0 0x7f58181f3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54398/0 (socket says 172.21.15.84:54398) 2023-08-31T02:01:41.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 -- 172.21.15.84:0/1513421391 learned_addr learned my addr 172.21.15.84:0/1513421391 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:41.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f58177fe700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58181576f0 0x7f58181ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5817fff700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58181f3890 0x7f58181e2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 -- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58181f3890 msgr2=0x7f58181e2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58181f3890 0x7f58181e2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 -- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58181576f0 msgr2=0x7f58181ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58181576f0 0x7f58181ef680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 -- 172.21.15.84:0/1513421391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58181f0340 con 0x7f58180a64c0 2023-08-31T02:01:41.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f58177fe700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58181576f0 0x7f58181ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:41.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f5816ffd700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58180a64c0 0x7f58181f3350 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5808011ae0 tx=0x7f5808011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:41.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f57fffff700 1 -- 172.21.15.84:0/1513421391 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580800fac0 con 0x7f58180a64c0 2023-08-31T02:01:41.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f57fffff700 1 -- 172.21.15.84:0/1513421391 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f580800fc20 con 0x7f58180a64c0 2023-08-31T02:01:41.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58181f2e30 con 0x7f58180a64c0 2023-08-31T02:01:41.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f57fffff700 1 -- 172.21.15.84:0/1513421391 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808004020 con 0x7f58180a64c0 2023-08-31T02:01:41.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.746+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5818157ad0 con 0x7f58180a64c0 2023-08-31T02:01:41.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.747+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58181f2c90 con 0x7f58180a64c0 2023-08-31T02:01:41.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.748+0000 7f57fffff700 1 -- 172.21.15.84:0/1513421391 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f58080041a0 con 0x7f58180a64c0 2023-08-31T02:01:41.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.748+0000 7f57fffff700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f580406a0e0 0x7f580406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:41.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.748+0000 7f57fffff700 1 -- 172.21.15.84:0/1513421391 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5808088ef0 con 0x7f58180a64c0 2023-08-31T02:01:41.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.748+0000 7f58177fe700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f580406a0e0 0x7f580406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:41.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.749+0000 7f58177fe700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f580406a0e0 0x7f580406c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f580c001270 tx=0x7f580c001300 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:41.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.752+0000 7f57fffff700 1 -- 172.21.15.84:0/1513421391 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f58181f2c90 con 0x7f58180a64c0 2023-08-31T02:01:41.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.946+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58181f2c90 con 0x7f58180a64c0 2023-08-31T02:01:41.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.947+0000 7f57fffff700 1 -- 172.21.15.84:0/1513421391 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16799 (secure 0 0 0) 0x7f58181f2c90 con 0x7f58180a64c0 2023-08-31T02:01:41.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:41.942 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":41,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:40.174670+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T02:01:18.799026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T02:01:19.825366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.3d","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f580406a0e0 msgr2=0x7f580406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f580406a0e0 0x7f580406c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f580c001270 tx=0x7f580c001300 comp rx=0 tx=0).stop 2023-08-31T02:01:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58180a64c0 msgr2=0x7f58181f3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:41.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58180a64c0 0x7f58181f3350 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5808011ae0 tx=0x7f5808011df0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 shutdown_connections 2023-08-31T02:01:41.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f580406a0e0 0x7f580406c5a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58181f3890 0x7f58181e2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58181576f0 0x7f58181ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 --2- 172.21.15.84:0/1513421391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58180a64c0 0x7f58181f3350 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 >> 172.21.15.84:0/1513421391 conn(0x7f58180caa20 msgr2=0x7f5818158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 shutdown_connections 2023-08-31T02:01:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:41.950+0000 7f581db5c700 1 -- 172.21.15.84:0/1513421391 wait complete. 2023-08-31T02:01:41.955 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T02:01:41.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:42.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.084+0000 7fc40c610700 1 -- 172.21.15.84:0/61700260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4040b17a0 msgr2=0x7fc4040b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.084+0000 7fc40c610700 1 --2- 172.21.15.84:0/61700260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4040b17a0 0x7fc4040b1c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4005fd0 tx=0x7fc3f4009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:42.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.084+0000 7fc40c610700 1 -- 172.21.15.84:0/61700260 shutdown_connections 2023-08-31T02:01:42.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.084+0000 7fc40c610700 1 --2- 172.21.15.84:0/61700260 >> v2:172.21.15.170:3300/0 conn(0x7fc40415bbb0 0x7fc40415c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.084+0000 7fc40c610700 1 --2- 172.21.15.84:0/61700260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4040b17a0 0x7fc4040b1c00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.084+0000 7fc40c610700 1 -- 172.21.15.84:0/61700260 >> 172.21.15.84:0/61700260 conn(0x7fc4040caa00 msgr2=0x7fc4040cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:42.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.084+0000 7fc40c610700 1 -- 172.21.15.84:0/61700260 shutdown_connections 2023-08-31T02:01:42.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.085+0000 7fc40c610700 1 -- 172.21.15.84:0/61700260 wait complete. 2023-08-31T02:01:42.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40c610700 1 Processor -- start 2023-08-31T02:01:42.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40c610700 1 -- start start 2023-08-31T02:01:42.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40c610700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040b17a0 0x7fc4041ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40c610700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc40414efe0 0x7fc404152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40c610700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40415bbb0 0x7fc404153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40c610700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404150f50 con 0x7fc4040b17a0 2023-08-31T02:01:42.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40c610700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404151cf0 con 0x7fc40415bbb0 2023-08-31T02:01:42.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40c610700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc404150460 con 0x7fc40414efe0 2023-08-31T02:01:42.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.086+0000 7fc40a3ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040b17a0 0x7fc4041ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40a3ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040b17a0 0x7fc4041ef420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54410/0 (socket says 172.21.15.84:54410) 2023-08-31T02:01:42.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40a3ac700 1 -- 172.21.15.84:0/1589438969 learned_addr learned my addr 172.21.15.84:0/1589438969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:42.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40abad700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40415bbb0 0x7fc404153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc409bab700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc40414efe0 0x7fc404152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40a3ac700 1 -- 172.21.15.84:0/1589438969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc40414efe0 msgr2=0x7fc404152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40a3ac700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc40414efe0 0x7fc404152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40a3ac700 1 -- 172.21.15.84:0/1589438969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40415bbb0 msgr2=0x7fc404153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40a3ac700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40415bbb0 0x7fc404153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40a3ac700 1 -- 172.21.15.84:0/1589438969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40095f0 con 0x7fc4040b17a0 2023-08-31T02:01:42.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40a3ac700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040b17a0 0x7fc4041ef420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c4f0 tx=0x7fc40000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:42.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc3faffd700 1 -- 172.21.15.84:0/1589438969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4000052d0 con 0x7fc4040b17a0 2023-08-31T02:01:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40414bbc0 con 0x7fc4040b17a0 2023-08-31T02:01:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc3faffd700 1 -- 172.21.15.84:0/1589438969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc400005540 con 0x7fc4040b17a0 2023-08-31T02:01:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc3faffd700 1 -- 172.21.15.84:0/1589438969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400006aa0 con 0x7fc4040b17a0 2023-08-31T02:01:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.087+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc404150990 con 0x7fc4040b17a0 2023-08-31T02:01:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.088+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40404e7c0 con 0x7fc4040b17a0 2023-08-31T02:01:42.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.089+0000 7fc3faffd700 1 -- 172.21.15.84:0/1589438969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc400003680 con 0x7fc4040b17a0 2023-08-31T02:01:42.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.089+0000 7fc3faffd700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc3e806a0e0 0x7fc3e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.089+0000 7fc409bab700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc3e806a0e0 0x7fc3e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.089+0000 7fc3faffd700 1 -- 172.21.15.84:0/1589438969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc400087810 con 0x7fc4040b17a0 2023-08-31T02:01:42.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.089+0000 7fc409bab700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc3e806a0e0 0x7fc3e806c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4000c00 tx=0x7fc3f40047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:42.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.093+0000 7fc3faffd700 1 -- 172.21.15.84:0/1589438969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc400052e10 con 0x7fc4040b17a0 2023-08-31T02:01:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.325+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc40415c540 con 0x7fc4040b17a0 2023-08-31T02:01:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.325+0000 7fc3faffd700 1 -- 172.21.15.84:0/1589438969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7fc40415c540 con 0x7fc4040b17a0 2023-08-31T02:01:42.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:42.319 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5009,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3211732680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3211732680},{"type":"v1","addr":"172.21.15.170:6834","nonce":3211732680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5012,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2965794759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2965794759},{"type":"v1","addr":"172.21.15.170:6835","nonce":2965794759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2457559549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2457559549},{"type":"v1","addr":"172.21.15.84:6837","nonce":2457559549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T02:01:20.870197+0000","modified":"2023-08-31T02:01:24.485132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/915893970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":915893970},{"type":"v1","addr":"172.21.15.84:6836","nonce":915893970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T02:01:42.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc3e806a0e0 msgr2=0x7fc3e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc3e806a0e0 0x7fc3e806c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4000c00 tx=0x7fc3f40047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040b17a0 msgr2=0x7fc4041ef420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040b17a0 0x7fc4041ef420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c4f0 tx=0x7fc40000c800 comp rx=0 tx=0).stop 2023-08-31T02:01:42.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 shutdown_connections 2023-08-31T02:01:42.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc3e806a0e0 0x7fc3e806c5a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40415bbb0 0x7fc404153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4040b17a0 0x7fc4041ef420 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 --2- 172.21.15.84:0/1589438969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc40414efe0 0x7fc404152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 >> 172.21.15.84:0/1589438969 conn(0x7fc4040caa00 msgr2=0x7fc4040c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 shutdown_connections 2023-08-31T02:01:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.328+0000 7fc40c610700 1 -- 172.21.15.84:0/1589438969 wait complete. 2023-08-31T02:01:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-08-31T02:01:42.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:01:42.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.464+0000 7f119c7fb700 1 -- 172.21.15.84:0/1461562642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 msgr2=0x7f1194159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.464+0000 7f119c7fb700 1 --2- 172.21.15.84:0/1461562642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 0x7f1194159a00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f118c009f60 tx=0x7f118c009f90 comp rx=0 tx=0).stop 2023-08-31T02:01:42.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.464+0000 7f119c7fb700 1 -- 172.21.15.84:0/1461562642 shutdown_connections 2023-08-31T02:01:42.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.464+0000 7f119c7fb700 1 --2- 172.21.15.84:0/1461562642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 0x7f1194159a00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.464+0000 7f119c7fb700 1 --2- 172.21.15.84:0/1461562642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11940b12c0 0x7f119415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.464+0000 7f119c7fb700 1 -- 172.21.15.84:0/1461562642 >> 172.21.15.84:0/1461562642 conn(0x7f119406fca0 msgr2=0x7f11940cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.464+0000 7f119c7fb700 1 -- 172.21.15.84:0/1461562642 shutdown_connections 2023-08-31T02:01:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.464+0000 7f119c7fb700 1 -- 172.21.15.84:0/1461562642 wait complete. 2023-08-31T02:01:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.465+0000 7f119c7fb700 1 Processor -- start 2023-08-31T02:01:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.465+0000 7f119c7fb700 1 -- start start 2023-08-31T02:01:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119c7fb700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11940af3d0 0x7f11940c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119c7fb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11940b12c0 0x7f11940b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119c7fb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 0x7f1194140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119c7fb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940b4ab0 con 0x7f11940ce570 2023-08-31T02:01:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119c7fb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940c2dc0 con 0x7f11940b12c0 2023-08-31T02:01:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119c7fb700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11940c7d00 con 0x7f11940af3d0 2023-08-31T02:01:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 0x7f1194140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 0x7f1194140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54428/0 (socket says 172.21.15.84:54428) 2023-08-31T02:01:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 -- 172.21.15.84:0/2611739778 learned_addr learned my addr 172.21.15.84:0/2611739778 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119a597700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11940af3d0 0x7f11940c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f1199d96700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11940b12c0 0x7f11940b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 -- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11940af3d0 msgr2=0x7f11940c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11940af3d0 0x7f11940c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 -- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11940b12c0 msgr2=0x7f11940b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11940b12c0 0x7f11940b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 -- 172.21.15.84:0/2611739778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c009c40 con 0x7f11940ce570 2023-08-31T02:01:42.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f1199d96700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11940b12c0 0x7f11940b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:42.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.466+0000 7f119ad98700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 0x7f1194140640 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f11940b1be0 tx=0x7f118c007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:42.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.467+0000 7f118affd700 1 -- 172.21.15.84:0/2611739778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c00e040 con 0x7f11940ce570 2023-08-31T02:01:42.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.467+0000 7f118affd700 1 -- 172.21.15.84:0/2611739778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f118c01d680 con 0x7f11940ce570 2023-08-31T02:01:42.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.467+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11940c7fe0 con 0x7f11940ce570 2023-08-31T02:01:42.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.467+0000 7f118affd700 1 -- 172.21.15.84:0/2611739778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c01da70 con 0x7f11940ce570 2023-08-31T02:01:42.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.467+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11940c30a0 con 0x7f11940ce570 2023-08-31T02:01:42.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.468+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11940c8500 con 0x7f11940ce570 2023-08-31T02:01:42.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.468+0000 7f118affd700 1 -- 172.21.15.84:0/2611739778 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f118c01dbd0 con 0x7f11940ce570 2023-08-31T02:01:42.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.468+0000 7f118affd700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117806a0e0 0x7f117806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.468+0000 7f118affd700 1 -- 172.21.15.84:0/2611739778 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f118c08a320 con 0x7f11940ce570 2023-08-31T02:01:42.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.468+0000 7f119a597700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117806a0e0 0x7f117806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.469+0000 7f119a597700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117806a0e0 0x7f117806c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1184000f60 tx=0x7f1184009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:42.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.473+0000 7f118affd700 1 -- 172.21.15.84:0/2611739778 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f11940c8500 con 0x7f11940ce570 2023-08-31T02:01:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.703+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11940c8500 con 0x7f11940ce570 2023-08-31T02:01:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.703+0000 7f118affd700 1 -- 172.21.15.84:0/2611739778 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f11940c8500 con 0x7f11940ce570 2023-08-31T02:01:42.696 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:42.697 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5009,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3211732680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3211732680},{"type":"v1","addr":"172.21.15.170:6834","nonce":3211732680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5012,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2965794759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2965794759},{"type":"v1","addr":"172.21.15.170:6835","nonce":2965794759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2457559549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2457559549},{"type":"v1","addr":"172.21.15.84:6837","nonce":2457559549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T02:01:20.870197+0000","modified":"2023-08-31T02:01:24.485132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/915893970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":915893970},{"type":"v1","addr":"172.21.15.84:6836","nonce":915893970}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T02:01:42.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117806a0e0 msgr2=0x7f117806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117806a0e0 0x7f117806c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1184000f60 tx=0x7f1184009040 comp rx=0 tx=0).stop 2023-08-31T02:01:42.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 msgr2=0x7f1194140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 0x7f1194140640 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f11940b1be0 tx=0x7f118c007b10 comp rx=0 tx=0).stop 2023-08-31T02:01:42.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 shutdown_connections 2023-08-31T02:01:42.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f117806a0e0 0x7f117806c5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940ce570 0x7f1194140640 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11940af3d0 0x7f11940c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 --2- 172.21.15.84:0/2611739778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11940b12c0 0x7f11940b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 >> 172.21.15.84:0/2611739778 conn(0x7f119406fca0 msgr2=0x7f1194153570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 shutdown_connections 2023-08-31T02:01:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.705+0000 7f119c7fb700 1 -- 172.21.15.84:0/2611739778 wait complete. 2023-08-31T02:01:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-08-31T02:01:42.710 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:42.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.839+0000 7f6fb71fa700 1 -- 172.21.15.84:0/1260129775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00702b0 msgr2=0x7f6fb00b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.839+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/1260129775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00702b0 0x7f6fb00b24a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00b32e0 tx=0x7f6fa4009ba0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.839+0000 7f6fb71fa700 1 -- 172.21.15.84:0/1260129775 shutdown_connections 2023-08-31T02:01:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.839+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/1260129775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00702b0 0x7f6fb00b24a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.839+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/1260129775 >> v2:172.21.15.170:3300/0 conn(0x7f6fb00c5500 0x7f6fb0158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.839+0000 7f6fb71fa700 1 -- 172.21.15.84:0/1260129775 >> 172.21.15.84:0/1260129775 conn(0x7f6fb00cd740 msgr2=0x7f6fb00cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.839+0000 7f6fb71fa700 1 -- 172.21.15.84:0/1260129775 shutdown_connections 2023-08-31T02:01:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.839+0000 7f6fb71fa700 1 -- 172.21.15.84:0/1260129775 wait complete. 2023-08-31T02:01:42.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.840+0000 7f6fb71fa700 1 Processor -- start 2023-08-31T02:01:42.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.840+0000 7f6fb71fa700 1 -- start start 2023-08-31T02:01:42.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb71fa700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fb00702b0 0x7f6fb014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb71fa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fb00b29e0 0x7f6fb00c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb71fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00c5500 0x7f6fb00c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb71fa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb01e2950 con 0x7f6fb00c5500 2023-08-31T02:01:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb71fa700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb014f1a0 con 0x7f6fb00b29e0 2023-08-31T02:01:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb71fa700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb01de710 con 0x7f6fb00702b0 2023-08-31T02:01:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb5797700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00c5500 0x7f6fb00c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb5797700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00c5500 0x7f6fb00c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54442/0 (socket says 172.21.15.84:54442) 2023-08-31T02:01:42.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb5797700 1 -- 172.21.15.84:0/290380774 learned_addr learned my addr 172.21.15.84:0/290380774 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:42.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6faffff700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fb00b29e0 0x7f6fb00c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.841+0000 7f6fb4f96700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fb00702b0 0x7f6fb014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb5797700 1 -- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fb00702b0 msgr2=0x7f6fb014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb5797700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fb00702b0 0x7f6fb014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb5797700 1 -- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fb00b29e0 msgr2=0x7f6fb00c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:42.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb5797700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fb00b29e0 0x7f6fb00c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:42.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb5797700 1 -- 172.21.15.84:0/290380774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa4009520 con 0x7f6fb00c5500 2023-08-31T02:01:42.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb4f96700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fb00702b0 0x7f6fb014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:42.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb5797700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00c5500 0x7f6fb00c5e50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800cb40 tx=0x7f6fa800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:42.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fad7fa700 1 -- 172.21.15.84:0/290380774 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800aa00 con 0x7f6fb00c5500 2023-08-31T02:01:42.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fad7fa700 1 -- 172.21.15.84:0/290380774 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6fa800ac70 con 0x7f6fb00c5500 2023-08-31T02:01:42.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb01e2670 con 0x7f6fb00c5500 2023-08-31T02:01:42.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fad7fa700 1 -- 172.21.15.84:0/290380774 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8012680 con 0x7f6fb00c5500 2023-08-31T02:01:42.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.842+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb01dec90 con 0x7f6fb00c5500 2023-08-31T02:01:42.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.843+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb01de570 con 0x7f6fb00c5500 2023-08-31T02:01:42.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.843+0000 7f6fad7fa700 1 -- 172.21.15.84:0/290380774 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6fa801b400 con 0x7f6fb00c5500 2023-08-31T02:01:42.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.844+0000 7f6fad7fa700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6f9406a0e0 0x7f6f9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:42.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.844+0000 7f6fad7fa700 1 -- 172.21.15.84:0/290380774 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6fa8088c60 con 0x7f6fb00c5500 2023-08-31T02:01:42.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.844+0000 7f6fb4f96700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6f9406a0e0 0x7f6f9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:42.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.844+0000 7f6fb4f96700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6f9406a0e0 0x7f6f9406c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009810 tx=0x7f6fa4019040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:42.848+0000 7f6fad7fa700 1 -- 172.21.15.84:0/290380774 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6fb01de570 con 0x7f6fb00c5500 2023-08-31T02:01:43.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.037+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fb01de570 con 0x7f6fb00c5500 2023-08-31T02:01:43.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.038+0000 7f6fad7fa700 1 -- 172.21.15.84:0/290380774 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16799 (secure 0 0 0) 0x7f6fb01de570 con 0x7f6fb00c5500 2023-08-31T02:01:43.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:43.031 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":41,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:40.174670+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T02:01:18.799026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T02:01:19.825366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.3d","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:43.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.040+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6f9406a0e0 msgr2=0x7f6f9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.040+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6f9406a0e0 0x7f6f9406c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009810 tx=0x7f6fa4019040 comp rx=0 tx=0).stop 2023-08-31T02:01:43.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.040+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00c5500 msgr2=0x7f6fb00c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.040+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00c5500 0x7f6fb00c5e50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800cb40 tx=0x7f6fa800ce50 comp rx=0 tx=0).stop 2023-08-31T02:01:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.041+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 shutdown_connections 2023-08-31T02:01:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.041+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6f9406a0e0 0x7f6f9406c5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.041+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fb00c5500 0x7f6fb00c5e50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.041+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fb00702b0 0x7f6fb014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.041+0000 7f6fb71fa700 1 --2- 172.21.15.84:0/290380774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fb00b29e0 0x7f6fb00c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.041+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 >> 172.21.15.84:0/290380774 conn(0x7f6fb00cd740 msgr2=0x7f6fb0154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.041+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 shutdown_connections 2023-08-31T02:01:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.041+0000 7f6fb71fa700 1 -- 172.21.15.84:0/290380774 wait complete. 2023-08-31T02:01:43.045 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T02:01:43.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.177+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/1929978495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0b0d00 msgr2=0x7fb1cc070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.177+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/1929978495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0b0d00 0x7fb1cc070de0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009f60 tx=0x7fb1c4009f90 comp rx=0 tx=0).stop 2023-08-31T02:01:43.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.177+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/1929978495 shutdown_connections 2023-08-31T02:01:43.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.177+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/1929978495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0b0d00 0x7fb1cc070de0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.177+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/1929978495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1cc0c99b0 0x7fb1cc0708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.177+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/1929978495 >> 172.21.15.84:0/1929978495 conn(0x7fb1cc0cdeb0 msgr2=0x7fb1cc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:43.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.177+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/1929978495 shutdown_connections 2023-08-31T02:01:43.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.177+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/1929978495 wait complete. 2023-08-31T02:01:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1d0ff8700 1 Processor -- start 2023-08-31T02:01:43.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1d0ff8700 1 -- start start 2023-08-31T02:01:43.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1d0ff8700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1cc0b0d00 0x7fb1cc1e2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:43.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1d0ff8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0c99b0 0x7fb1cc070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:43.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1d0ff8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1cc158120 0x7fb1cc0c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:43.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1d0ff8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0c60d0 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1d0ff8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0c6c50 con 0x7fb1cc158120 2023-08-31T02:01:43.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1d0ff8700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0c6320 con 0x7fb1cc0b0d00 2023-08-31T02:01:43.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0c99b0 0x7fb1cc070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:43.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0c99b0 0x7fb1cc070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54454/0 (socket says 172.21.15.84:54454) 2023-08-31T02:01:43.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.179+0000 7fb1c9d9b700 1 -- 172.21.15.84:0/2598198581 learned_addr learned my addr 172.21.15.84:0/2598198581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:43.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1cad9d700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1cc158120 0x7fb1cc0c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:43.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1c9d9b700 1 -- 172.21.15.84:0/2598198581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1cc0b0d00 msgr2=0x7fb1cc1e2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1c9d9b700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1cc0b0d00 0x7fb1cc1e2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1c9d9b700 1 -- 172.21.15.84:0/2598198581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1cc158120 msgr2=0x7fb1cc0c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1c9d9b700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1cc158120 0x7fb1cc0c37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1c9d9b700 1 -- 172.21.15.84:0/2598198581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4009c40 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1c9d9b700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0c99b0 0x7fb1cc070a10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc007b50 tx=0x7fb1bc007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:43.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1baffd700 1 -- 172.21.15.84:0/2598198581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc011070 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1baffd700 1 -- 172.21.15.84:0/2598198581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb1bc00c2e0 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1cc0c6600 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1baffd700 1 -- 172.21.15.84:0/2598198581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc004a90 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.180+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1cc1e2550 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.181+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1cc04e7c0 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.181+0000 7fb1baffd700 1 -- 172.21.15.84:0/2598198581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb1bc004bf0 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.182+0000 7fb1baffd700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1ac06a0e0 0x7fb1ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:43.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.182+0000 7fb1baffd700 1 -- 172.21.15.84:0/2598198581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb1bc089fc0 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.182+0000 7fb1ca59c700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1ac06a0e0 0x7fb1ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:43.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.182+0000 7fb1ca59c700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1ac06a0e0 0x7fb1ac06c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0007fd0 tx=0x7fb1c0007ac0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:43.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.186+0000 7fb1baffd700 1 -- 172.21.15.84:0/2598198581 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb1bc0bc990 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.418+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb1cc0cd330 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.411 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-08-31T02:01:43.419+0000 7f3b998f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T02:01:43.415 INFO:tasks.ceph.mds.c.smithi084.stderr: -1493> 2023-08-31T02:01:25.448+0000 7ff966480700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T02:01:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.426+0000 7fb1baffd700 1 -- 172.21.15.84:0/2598198581 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb1bc055780 con 0x7fb1cc0c99b0 2023-08-31T02:01:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1ac06a0e0 msgr2=0x7fb1ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1ac06a0e0 0x7fb1ac06c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0007fd0 tx=0x7fb1c0007ac0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0c99b0 msgr2=0x7fb1cc070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0c99b0 0x7fb1cc070a10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc007b50 tx=0x7fb1bc007f10 comp rx=0 tx=0).stop 2023-08-31T02:01:43.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 shutdown_connections 2023-08-31T02:01:43.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fb1ac06a0e0 0x7fb1ac06c5a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1cc158120 0x7fb1cc0c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1cc0b0d00 0x7fb1cc1e2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 --2- 172.21.15.84:0/2598198581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1cc0c99b0 0x7fb1cc070a10 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 >> 172.21.15.84:0/2598198581 conn(0x7fb1cc0cdeb0 msgr2=0x7fb1cc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 shutdown_connections 2023-08-31T02:01:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.428+0000 7fb1d0ff8700 1 -- 172.21.15.84:0/2598198581 wait complete. 2023-08-31T02:01:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T02:01:43.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T02:01:43.443 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-08-31T02:01:43.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.566+0000 7fe87eb08700 1 -- 172.21.15.84:0/2572429622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780cba50 msgr2=0x7fe8780c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.566+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2572429622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780cba50 0x7fe8780c84d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe878071cd0 tx=0x7fe86c009ba0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.567+0000 7fe87eb08700 1 -- 172.21.15.84:0/2572429622 shutdown_connections 2023-08-31T02:01:43.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.567+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2572429622 >> v2:172.21.15.170:3300/0 conn(0x7fe8780b14a0 0x7fe8780c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.567+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2572429622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780cba50 0x7fe8780c84d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.567+0000 7fe87eb08700 1 -- 172.21.15.84:0/2572429622 >> 172.21.15.84:0/2572429622 conn(0x7fe8780ca900 msgr2=0x7fe8780cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:43.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.567+0000 7fe87eb08700 1 -- 172.21.15.84:0/2572429622 shutdown_connections 2023-08-31T02:01:43.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.567+0000 7fe87eb08700 1 -- 172.21.15.84:0/2572429622 wait complete. 2023-08-31T02:01:43.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.568+0000 7fe87eb08700 1 Processor -- start 2023-08-31T02:01:43.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.568+0000 7fe87eb08700 1 -- start start 2023-08-31T02:01:43.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87eb08700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780c4290 0x7fe878140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:43.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87eb08700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780cba50 0x7fe8780abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:43.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87eb08700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8781f5090 0x7fe8780ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:43.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87eb08700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780ac240 con 0x7fe8780c4290 2023-08-31T02:01:43.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87eb08700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878140900 con 0x7fe8780cba50 2023-08-31T02:01:43.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87eb08700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe878140be0 con 0x7fe8781f5090 2023-08-31T02:01:43.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780c4290 0x7fe878140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:43.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780c4290 0x7fe878140320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54484/0 (socket says 172.21.15.84:54484) 2023-08-31T02:01:43.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 -- 172.21.15.84:0/2289475870 learned_addr learned my addr 172.21.15.84:0/2289475870 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:43.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 -- 172.21.15.84:0/2289475870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8781f5090 msgr2=0x7fe8780ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8781f5090 0x7fe8780ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 -- 172.21.15.84:0/2289475870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780cba50 msgr2=0x7fe8780abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:43.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780cba50 0x7fe8780abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:43.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 -- 172.21.15.84:0/2289475870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c009520 con 0x7fe8780c4290 2023-08-31T02:01:43.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87c8a4700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780c4290 0x7fe878140320 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe8780725f0 tx=0x7fe86c017630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:43.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe8757fa700 1 -- 172.21.15.84:0/2289475870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c01c070 con 0x7fe8780c4290 2023-08-31T02:01:43.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe8757fa700 1 -- 172.21.15.84:0/2289475870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe86c017c20 con 0x7fe8780c4290 2023-08-31T02:01:43.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe878140ec0 con 0x7fe8780c4290 2023-08-31T02:01:43.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe8757fa700 1 -- 172.21.15.84:0/2289475870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c004050 con 0x7fe8780c4290 2023-08-31T02:01:43.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.569+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8781f4b90 con 0x7fe8780c4290 2023-08-31T02:01:43.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.570+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8781f4d20 con 0x7fe8780c4290 2023-08-31T02:01:43.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.571+0000 7fe8757fa700 1 -- 172.21.15.84:0/2289475870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe86c0041b0 con 0x7fe8780c4290 2023-08-31T02:01:43.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.571+0000 7fe8757fa700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe85c06a0d0 0x7fe85c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:43.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.571+0000 7fe877fff700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe85c06a0d0 0x7fe85c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:43.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.571+0000 7fe8757fa700 1 -- 172.21.15.84:0/2289475870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe86c089630 con 0x7fe8780c4290 2023-08-31T02:01:43.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.571+0000 7fe877fff700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe85c06a0d0 0x7fe85c06c590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe864007fd0 tx=0x7fe8640079a0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:43.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.575+0000 7fe8757fa700 1 -- 172.21.15.84:0/2289475870 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe86c054cf0 con 0x7fe8780c4290 2023-08-31T02:01:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:43.808+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe87804e7c0 con 0x7fe8780c4290 2023-08-31T02:01:44.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.423+0000 7fe8757fa700 1 -- 172.21.15.84:0/2289475870 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe86c058310 con 0x7fe8780c4290 2023-08-31T02:01:44.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe85c06a0d0 msgr2=0x7fe85c06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:44.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe85c06a0d0 0x7fe85c06c590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe864007fd0 tx=0x7fe8640079a0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780c4290 msgr2=0x7fe878140320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:44.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780c4290 0x7fe878140320 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe8780725f0 tx=0x7fe86c017630 comp rx=0 tx=0).stop 2023-08-31T02:01:44.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 shutdown_connections 2023-08-31T02:01:44.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe85c06a0d0 0x7fe85c06c590 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8781f5090 0x7fe8780ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8780c4290 0x7fe878140320 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 --2- 172.21.15.84:0/2289475870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780cba50 0x7fe8780abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 >> 172.21.15.84:0/2289475870 conn(0x7fe8780ca900 msgr2=0x7fe87806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:44.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 shutdown_connections 2023-08-31T02:01:44.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.426+0000 7fe87eb08700 1 -- 172.21.15.84:0/2289475870 wait complete. 2023-08-31T02:01:44.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T02:01:44.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 -- 172.21.15.84:0/2417353632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c158490 msgr2=0x7f053c0c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:44.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 --2- 172.21.15.84:0/2417353632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c158490 0x7f053c0c9f40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f053c073070 tx=0x7f052c009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:44.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 -- 172.21.15.84:0/2417353632 shutdown_connections 2023-08-31T02:01:44.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 --2- 172.21.15.84:0/2417353632 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f053c0c8a50 0x7f053c15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 --2- 172.21.15.84:0/2417353632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c158490 0x7f053c0c9f40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 --2- 172.21.15.84:0/2417353632 >> v2:172.21.15.170:3300/0 conn(0x7f053c0c90d0 0x7f053c0c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 -- 172.21.15.84:0/2417353632 >> 172.21.15.84:0/2417353632 conn(0x7f053c0ca940 msgr2=0x7f053c0cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:44.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 -- 172.21.15.84:0/2417353632 shutdown_connections 2023-08-31T02:01:44.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.611+0000 7f0543283700 1 -- 172.21.15.84:0/2417353632 wait complete. 2023-08-31T02:01:44.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.612+0000 7f0543283700 1 Processor -- start 2023-08-31T02:01:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.612+0000 7f0543283700 1 -- start start 2023-08-31T02:01:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f0543283700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0c8a50 0x7f053c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f0543283700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f053c0c90d0 0x7f053c1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f0543283700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f053c158490 0x7f053c06a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:44.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f0543283700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c1f1bb0 con 0x7f053c0c8a50 2023-08-31T02:01:44.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f0543283700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c15b900 con 0x7f053c0c90d0 2023-08-31T02:01:44.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f0543283700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c15ae70 con 0x7f053c158490 2023-08-31T02:01:44.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054101f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0c8a50 0x7f053c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:44.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054101f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0c8a50 0x7f053c15b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54498/0 (socket says 172.21.15.84:54498) 2023-08-31T02:01:44.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054101f700 1 -- 172.21.15.84:0/1406677476 learned_addr learned my addr 172.21.15.84:0/1406677476 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:44.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f0541820700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f053c158490 0x7f053c06a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:44.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054081e700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f053c0c90d0 0x7f053c1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:44.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054101f700 1 -- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f053c158490 msgr2=0x7f053c06a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:44.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054101f700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f053c158490 0x7f053c06a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054101f700 1 -- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f053c0c90d0 msgr2=0x7f053c1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:44.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054101f700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f053c0c90d0 0x7f053c1574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:44.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054101f700 1 -- 172.21.15.84:0/1406677476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c0095f0 con 0x7f053c0c8a50 2023-08-31T02:01:44.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f0541820700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f053c158490 0x7f053c06a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:44.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.613+0000 7f054081e700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f053c0c90d0 0x7f053c1574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.614+0000 7f054101f700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0c8a50 0x7f053c15b3c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f053c069a90 tx=0x7f052c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.614+0000 7f0531ffb700 1 -- 172.21.15.84:0/1406677476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c01c070 con 0x7f053c0c8a50 2023-08-31T02:01:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.614+0000 7f0531ffb700 1 -- 172.21.15.84:0/1406677476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f052c003890 con 0x7f053c0c8a50 2023-08-31T02:01:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.614+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c0c5450 con 0x7f053c0c8a50 2023-08-31T02:01:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.614+0000 7f0531ffb700 1 -- 172.21.15.84:0/1406677476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c0045f0 con 0x7f053c0c8a50 2023-08-31T02:01:44.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.614+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c0c5a10 con 0x7f053c0c8a50 2023-08-31T02:01:44.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.615+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c073a40 con 0x7f053c0c8a50 2023-08-31T02:01:44.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.615+0000 7f0531ffb700 1 -- 172.21.15.84:0/1406677476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f052c003cc0 con 0x7f053c0c8a50 2023-08-31T02:01:44.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.616+0000 7f0531ffb700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f052006a0e0 0x7f052006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:44.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.616+0000 7f054081e700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f052006a0e0 0x7f052006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.616+0000 7f0531ffb700 1 -- 172.21.15.84:0/1406677476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f052c089a10 con 0x7f053c0c8a50 2023-08-31T02:01:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.616+0000 7f054081e700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f052006a0e0 0x7f052006c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f053c15b150 tx=0x7f0538009550 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.620+0000 7f0531ffb700 1 -- 172.21.15.84:0/1406677476 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f052c0550d0 con 0x7f053c0c8a50 2023-08-31T02:01:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:44.811+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f053c0c82f0 con 0x7f053c0c8a50 2023-08-31T02:01:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.428+0000 7f0531ffb700 1 -- 172.21.15.84:0/1406677476 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f052c0586f0 con 0x7f053c0c8a50 2023-08-31T02:01:45.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f052006a0e0 msgr2=0x7f052006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:45.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f052006a0e0 0x7f052006c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f053c15b150 tx=0x7f0538009550 comp rx=0 tx=0).stop 2023-08-31T02:01:45.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0c8a50 msgr2=0x7f053c15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0c8a50 0x7f053c15b3c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f053c069a90 tx=0x7f052c0042f0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 shutdown_connections 2023-08-31T02:01:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f052006a0e0 0x7f052006c5a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f053c158490 0x7f053c06a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0c8a50 0x7f053c15b3c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 --2- 172.21.15.84:0/1406677476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f053c0c90d0 0x7f053c1574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 >> 172.21.15.84:0/1406677476 conn(0x7f053c0ca940 msgr2=0x7f053c0aac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:45.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 shutdown_connections 2023-08-31T02:01:45.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.432+0000 7f0543283700 1 -- 172.21.15.84:0/1406677476 wait complete. 2023-08-31T02:01:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-08-31T02:01:45.440 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T02:01:45.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.581+0000 7f4d49be1700 1 -- 172.21.15.84:0/2840076770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 msgr2=0x7f4d440b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:45.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.581+0000 7f4d49be1700 1 --2- 172.21.15.84:0/2840076770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 0x7f4d440b0970 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c005fd0 tx=0x7f4d2c009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.581+0000 7f4d49be1700 1 -- 172.21.15.84:0/2840076770 shutdown_connections 2023-08-31T02:01:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.581+0000 7f4d49be1700 1 --2- 172.21.15.84:0/2840076770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d440b0eb0 0x7f4d44162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.581+0000 7f4d49be1700 1 --2- 172.21.15.84:0/2840076770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 0x7f4d440b0970 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.581+0000 7f4d49be1700 1 -- 172.21.15.84:0/2840076770 >> 172.21.15.84:0/2840076770 conn(0x7f4d440cbb60 msgr2=0x7f4d440cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.581+0000 7f4d49be1700 1 -- 172.21.15.84:0/2840076770 shutdown_connections 2023-08-31T02:01:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.581+0000 7f4d49be1700 1 -- 172.21.15.84:0/2840076770 wait complete. 2023-08-31T02:01:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.582+0000 7f4d49be1700 1 Processor -- start 2023-08-31T02:01:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.582+0000 7f4d49be1700 1 -- start start 2023-08-31T02:01:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d49be1700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d440b0590 0x7f4d44158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d49be1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d440b0eb0 0x7f4d44150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d49be1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 0x7f4d441509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d49be1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d441577c0 con 0x7f4d440cdcc0 2023-08-31T02:01:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d49be1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44158d00 con 0x7f4d440b0eb0 2023-08-31T02:01:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d49be1700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d441579d0 con 0x7f4d440b0590 2023-08-31T02:01:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d43fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 0x7f4d441509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d43fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 0x7f4d441509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54514/0 (socket says 172.21.15.84:54514) 2023-08-31T02:01:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.583+0000 7f4d43fff700 1 -- 172.21.15.84:0/3789866530 learned_addr learned my addr 172.21.15.84:0/3789866530 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d440b0590 0x7f4d44158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d42ffd700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d440b0eb0 0x7f4d44150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d43fff700 1 -- 172.21.15.84:0/3789866530 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d440b0590 msgr2=0x7f4d44158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d43fff700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d440b0590 0x7f4d44158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d43fff700 1 -- 172.21.15.84:0/3789866530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d440b0eb0 msgr2=0x7f4d44150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d43fff700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d440b0eb0 0x7f4d44150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d43fff700 1 -- 172.21.15.84:0/3789866530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0095f0 con 0x7f4d440cdcc0 2023-08-31T02:01:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d43fff700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 0x7f4d441509b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00ada0 tx=0x7f4d3c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d3bfff700 1 -- 172.21.15.84:0/3789866530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00f070 con 0x7f4d440cdcc0 2023-08-31T02:01:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d3bfff700 1 -- 172.21.15.84:0/3789866530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d3c007e60 con 0x7f4d440cdcc0 2023-08-31T02:01:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d3bfff700 1 -- 172.21.15.84:0/3789866530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c004df0 con 0x7f4d440cdcc0 2023-08-31T02:01:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d44157cb0 con 0x7f4d440cdcc0 2023-08-31T02:01:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.584+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d441552c0 con 0x7f4d440cdcc0 2023-08-31T02:01:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.585+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d441581d0 con 0x7f4d440cdcc0 2023-08-31T02:01:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.585+0000 7f4d3bfff700 1 -- 172.21.15.84:0/3789866530 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d3c00c980 con 0x7f4d440cdcc0 2023-08-31T02:01:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.586+0000 7f4d3bfff700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4d2406a0e0 0x7f4d2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.586+0000 7f4d3bfff700 1 -- 172.21.15.84:0/3789866530 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4d3c088130 con 0x7f4d440cdcc0 2023-08-31T02:01:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.586+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4d2406a0e0 0x7f4d2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.586+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4d2406a0e0 0x7f4d2406c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009870 tx=0x7f4d34008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.590+0000 7f4d3bfff700 1 -- 172.21.15.84:0/3789866530 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4d441581d0 con 0x7f4d440cdcc0 2023-08-31T02:01:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:45.785+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d441581d0 con 0x7f4d440cdcc0 2023-08-31T02:01:46.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.433+0000 7f4d3bfff700 1 -- 172.21.15.84:0/3789866530 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4d441581d0 con 0x7f4d440cdcc0 2023-08-31T02:01:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4d2406a0e0 msgr2=0x7f4d2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4d2406a0e0 0x7f4d2406c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009870 tx=0x7f4d34008040 comp rx=0 tx=0).stop 2023-08-31T02:01:46.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 msgr2=0x7f4d441509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 0x7f4d441509b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00ada0 tx=0x7f4d3c00c330 comp rx=0 tx=0).stop 2023-08-31T02:01:46.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 shutdown_connections 2023-08-31T02:01:46.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4d2406a0e0 0x7f4d2406c5a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d440cdcc0 0x7f4d441509b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d440b0590 0x7f4d44158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 --2- 172.21.15.84:0/3789866530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d440b0eb0 0x7f4d44150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 >> 172.21.15.84:0/3789866530 conn(0x7f4d440cbb60 msgr2=0x7f4d440b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:46.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 shutdown_connections 2023-08-31T02:01:46.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.437+0000 7f4d49be1700 1 -- 172.21.15.84:0/3789866530 wait complete. 2023-08-31T02:01:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-08-31T02:01:46.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 30 2023-08-31T02:01:46.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.587+0000 7fe1ad47f700 1 -- 172.21.15.84:0/2802133086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004060 msgr2=0x7fe190004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.587+0000 7fe1ad47f700 1 --2- 172.21.15.84:0/2802133086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004060 0x7fe190004850 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe19800c310 tx=0x7fe190005880 comp rx=0 tx=0).stop 2023-08-31T02:01:46.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.587+0000 7fe1a77fe700 1 -- 172.21.15.84:0/2802133086 reap_dead start 2023-08-31T02:01:46.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.587+0000 7fe1ad47f700 1 -- 172.21.15.84:0/2802133086 shutdown_connections 2023-08-31T02:01:46.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.587+0000 7fe1ad47f700 1 -- 172.21.15.84:0/2802133086 >> 172.21.15.84:0/2802133086 conn(0x7fe1a8069b80 msgr2=0x7fe1a8069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:46.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.587+0000 7fe1ad47f700 1 -- 172.21.15.84:0/2802133086 shutdown_connections 2023-08-31T02:01:46.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.587+0000 7fe1ad47f700 1 -- 172.21.15.84:0/2802133086 wait complete. 2023-08-31T02:01:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.588+0000 7fe1ad47f700 1 Processor -- start 2023-08-31T02:01:46.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.588+0000 7fe1ad47f700 1 -- start start 2023-08-31T02:01:46.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1ad47f700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe190004060 0x7fe1a80c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:46.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1ad47f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1a80aded0 0x7fe1a80c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:46.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1ad47f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a80ae350 0x7fe1a80c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1ad47f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80c8e00 con 0x7fe1a80ae350 2023-08-31T02:01:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1ad47f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80c56b0 con 0x7fe1a80aded0 2023-08-31T02:01:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1ad47f700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80c7f70 con 0x7fe190004060 2023-08-31T02:01:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a80ae350 0x7fe1a80c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a80ae350 0x7fe1a80c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54536/0 (socket says 172.21.15.84:54536) 2023-08-31T02:01:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a77fe700 1 -- 172.21.15.84:0/1054746649 learned_addr learned my addr 172.21.15.84:0/1054746649 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a6ffd700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe190004060 0x7fe1a80c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a67fc700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1a80aded0 0x7fe1a80c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a77fe700 1 -- 172.21.15.84:0/1054746649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe190004060 msgr2=0x7fe1a80c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a77fe700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe190004060 0x7fe1a80c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a77fe700 1 -- 172.21.15.84:0/1054746649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1a80aded0 msgr2=0x7fe1a80c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a77fe700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1a80aded0 0x7fe1a80c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.589+0000 7fe1a77fe700 1 -- 172.21.15.84:0/1054746649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a814d870 con 0x7fe1a80ae350 2023-08-31T02:01:46.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.590+0000 7fe1a77fe700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a80ae350 0x7fe1a80c6640 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80ca7d0 tx=0x7fe1a000e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:46.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.590+0000 7fe18f7fe700 1 -- 172.21.15.84:0/1054746649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000c070 con 0x7fe1a80ae350 2023-08-31T02:01:46.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.590+0000 7fe18f7fe700 1 -- 172.21.15.84:0/1054746649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1a00135f0 con 0x7fe1a80ae350 2023-08-31T02:01:46.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.590+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a80c81f0 con 0x7fe1a80ae350 2023-08-31T02:01:46.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.590+0000 7fe18f7fe700 1 -- 172.21.15.84:0/1054746649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0013a00 con 0x7fe1a80ae350 2023-08-31T02:01:46.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.590+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a80c87b0 con 0x7fe1a80ae350 2023-08-31T02:01:46.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.591+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a804e7c0 con 0x7fe1a80ae350 2023-08-31T02:01:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.592+0000 7fe18f7fe700 1 -- 172.21.15.84:0/1054746649 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe1a001d440 con 0x7fe1a80ae350 2023-08-31T02:01:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.592+0000 7fe18f7fe700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe19406a0e0 0x7fe19406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.592+0000 7fe18f7fe700 1 -- 172.21.15.84:0/1054746649 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe1a00876e0 con 0x7fe1a80ae350 2023-08-31T02:01:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.592+0000 7fe1a6ffd700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe19406a0e0 0x7fe19406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.592+0000 7fe1a6ffd700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe19406a0e0 0x7fe19406c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009d30 tx=0x7fe19c009450 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.596+0000 7fe18f7fe700 1 -- 172.21.15.84:0/1054746649 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe1a0053160 con 0x7fe1a80ae350 2023-08-31T02:01:46.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.788+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config reset", "num": 30} v 0) v1 -- 0x7fe1a80c8f40 con 0x7fe1a80ae350 2023-08-31T02:01:46.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.792+0000 7fe18f7fe700 1 -- 172.21.15.84:0/1054746649 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 30}]=0 v32) v1 ==== 71+0+0 (secure 0 0 0) 0x7fe1a0056780 con 0x7fe1a80ae350 2023-08-31T02:01:46.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe19406a0e0 msgr2=0x7fe19406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe19406a0e0 0x7fe19406c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009d30 tx=0x7fe19c009450 comp rx=0 tx=0).stop 2023-08-31T02:01:46.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a80ae350 msgr2=0x7fe1a80c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a80ae350 0x7fe1a80c6640 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80ca7d0 tx=0x7fe1a000e860 comp rx=0 tx=0).stop 2023-08-31T02:01:46.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 shutdown_connections 2023-08-31T02:01:46.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe19406a0e0 0x7fe19406c5a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a80ae350 0x7fe1a80c6640 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe190004060 0x7fe1a80c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.794+0000 7fe1ad47f700 1 --2- 172.21.15.84:0/1054746649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1a80aded0 0x7fe1a80c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.795+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 >> 172.21.15.84:0/1054746649 conn(0x7fe1a8069b80 msgr2=0x7fe1a806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.795+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 shutdown_connections 2023-08-31T02:01:46.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.795+0000 7fe1ad47f700 1 -- 172.21.15.84:0/1054746649 wait complete. 2023-08-31T02:01:46.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2023-08-31T02:01:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.934+0000 7f501725d700 1 -- 172.21.15.84:0/1937998050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 msgr2=0x7f50100b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.934+0000 7f501725d700 1 --2- 172.21.15.84:0/1937998050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 0x7f50100b2cb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f5008009f60 tx=0x7f5008009f90 comp rx=0 tx=0).stop 2023-08-31T02:01:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.934+0000 7f501725d700 1 -- 172.21.15.84:0/1937998050 shutdown_connections 2023-08-31T02:01:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.934+0000 7f501725d700 1 --2- 172.21.15.84:0/1937998050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 0x7f50100b2cb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.934+0000 7f501725d700 1 --2- 172.21.15.84:0/1937998050 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50100b03c0 0x7f50100b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.934+0000 7f501725d700 1 -- 172.21.15.84:0/1937998050 >> 172.21.15.84:0/1937998050 conn(0x7f50100cdcb0 msgr2=0x7f50100ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.934+0000 7f501725d700 1 -- 172.21.15.84:0/1937998050 shutdown_connections 2023-08-31T02:01:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.935+0000 7f501725d700 1 -- 172.21.15.84:0/1937998050 wait complete. 2023-08-31T02:01:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.936+0000 7f501725d700 1 Processor -- start 2023-08-31T02:01:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.936+0000 7f501725d700 1 -- start start 2023-08-31T02:01:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.936+0000 7f501725d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50100b03c0 0x7f50101f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.936+0000 7f501725d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 0x7f50100a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.936+0000 7f501725d700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501015b320 0x7f50100ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f501725d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501015a2c0 con 0x7f50100b4800 2023-08-31T02:01:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f501725d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50100c6fc0 con 0x7f50100b03c0 2023-08-31T02:01:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f501725d700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50100c72a0 con 0x7f501015b320 2023-08-31T02:01:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 0x7f50100a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 0x7f50100a8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54548/0 (socket says 172.21.15.84:54548) 2023-08-31T02:01:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 -- 172.21.15.84:0/747821205 learned_addr learned my addr 172.21.15.84:0/747821205 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f50157fa700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501015b320 0x7f50100ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5014ff9700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50100b03c0 0x7f50101f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 -- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501015b320 msgr2=0x7f50100ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501015b320 0x7f50100ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 -- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50100b03c0 msgr2=0x7f50101f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50100b03c0 0x7f50101f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 -- 172.21.15.84:0/747821205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008009c40 con 0x7f50100b4800 2023-08-31T02:01:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f50157fa700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501015b320 0x7f50100ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5014ff9700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50100b03c0 0x7f50101f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f5007fff700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 0x7f50100a8cf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f500000b530 tx=0x7f500000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f50057fa700 1 -- 172.21.15.84:0/747821205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000011830 con 0x7f50100b4800 2023-08-31T02:01:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f50057fa700 1 -- 172.21.15.84:0/747821205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5000011aa0 con 0x7f50100b4800 2023-08-31T02:01:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50100c7580 con 0x7f50100b4800 2023-08-31T02:01:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f50057fa700 1 -- 172.21.15.84:0/747821205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000010380 con 0x7f50100b4800 2023-08-31T02:01:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.937+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50100c7b40 con 0x7f50100b4800 2023-08-31T02:01:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.938+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50101f1920 con 0x7f50100b4800 2023-08-31T02:01:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.939+0000 7f50057fa700 1 -- 172.21.15.84:0/747821205 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f50000104e0 con 0x7f50100b4800 2023-08-31T02:01:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.939+0000 7f50057fa700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ffc06a0e0 0x7f4ffc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.939+0000 7f5014ff9700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ffc06a0e0 0x7f4ffc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.939+0000 7f50057fa700 1 -- 172.21.15.84:0/747821205 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f50000884f0 con 0x7f50100b4800 2023-08-31T02:01:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.940+0000 7f5014ff9700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ffc06a0e0 0x7f4ffc06c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f500c004740 tx=0x7f500c009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:46.944+0000 7f50057fa700 1 -- 172.21.15.84:0/747821205 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f50101f1920 con 0x7f50100b4800 2023-08-31T02:01:47.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.212+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7f50101f1920 con 0x7f50100b4800 2023-08-31T02:01:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.443+0000 7f50057fa700 1 -- 172.21.15.84:0/747821205 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v128) v1 ==== 160+0+0 (secure 0 0 0) 0x7f50101f1920 con 0x7f50100b4800 2023-08-31T02:01:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ffc06a0e0 msgr2=0x7f4ffc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ffc06a0e0 0x7f4ffc06c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f500c004740 tx=0x7f500c009040 comp rx=0 tx=0).stop 2023-08-31T02:01:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 msgr2=0x7f50100a8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 0x7f50100a8cf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f500000b530 tx=0x7f500000b8f0 comp rx=0 tx=0).stop 2023-08-31T02:01:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 shutdown_connections 2023-08-31T02:01:47.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4ffc06a0e0 0x7f4ffc06c5a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:47.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501015b320 0x7f50100ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:47.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50100b03c0 0x7f50101f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:47.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 --2- 172.21.15.84:0/747821205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50100b4800 0x7f50100a8cf0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:47.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 >> 172.21.15.84:0/747821205 conn(0x7f50100cdcb0 msgr2=0x7f50100b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 shutdown_connections 2023-08-31T02:01:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:47.446+0000 7f501725d700 1 -- 172.21.15.84:0/747821205 wait complete. 2023-08-31T02:01:47.451 INFO:tasks.cephfs_test_runner:test: ... ERROR 2023-08-31T02:01:47.451 INFO:tasks.cephfs_test_runner: 2023-08-31T02:01:47.452 INFO:tasks.cephfs_test_runner:====================================================================== 2023-08-31T02:01:47.452 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T02:01:47.452 INFO:tasks.cephfs_test_runner:test: 2023-08-31T02:01:47.453 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-31T02:01:47.453 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-08-31T02:01:47.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks/cephfs/test_quota.py", line 157, in test_disable_enable_human_readable_quota_values 2023-08-31T02:01:47.453 INFO:tasks.cephfs_test_runner: self.mount_a.setfattr("./subdir", "ceph.quota.max_bytes", "1K") 2023-08-31T02:01:47.454 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks/cephfs/mount.py", line 1566, in setfattr 2023-08-31T02:01:47.454 INFO:tasks.cephfs_test_runner: self.run_shell(**kwargs) 2023-08-31T02:01:47.454 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-08-31T02:01:47.454 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-08-31T02:01:47.455 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/remote.py", line 522, in run 2023-08-31T02:01:47.455 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-08-31T02:01:47.455 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 455, in run 2023-08-31T02:01:47.456 INFO:tasks.cephfs_test_runner: r.wait() 2023-08-31T02:01:47.456 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 161, in wait 2023-08-31T02:01:47.456 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-08-31T02:01:47.456 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-08-31T02:01:47.457 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-08-31T02:01:47.457 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)' 2023-08-31T02:01:47.457 INFO:tasks.cephfs_test_runner: 2023-08-31T02:01:47.457 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-31T02:01:47.458 INFO:tasks.cephfs_test_runner:Ran 1 test in 62.940s 2023-08-31T02:01:47.458 INFO:tasks.cephfs_test_runner: 2023-08-31T02:01:47.458 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-08-31T02:01:47.459 INFO:tasks.cephfs_test_runner: 2023-08-31T02:01:47.459 INFO:tasks.cephfs_test_runner:====================================================================== 2023-08-31T02:01:47.459 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T02:01:47.459 INFO:tasks.cephfs_test_runner:test: 2023-08-31T02:01:47.460 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-31T02:01:47.460 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-08-31T02:01:47.460 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks/cephfs/test_quota.py", line 157, in test_disable_enable_human_readable_quota_values 2023-08-31T02:01:47.460 INFO:tasks.cephfs_test_runner: self.mount_a.setfattr("./subdir", "ceph.quota.max_bytes", "1K") 2023-08-31T02:01:47.461 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks/cephfs/mount.py", line 1566, in setfattr 2023-08-31T02:01:47.461 INFO:tasks.cephfs_test_runner: self.run_shell(**kwargs) 2023-08-31T02:01:47.461 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-08-31T02:01:47.461 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-08-31T02:01:47.462 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/remote.py", line 522, in run 2023-08-31T02:01:47.462 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-08-31T02:01:47.462 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 455, in run 2023-08-31T02:01:47.462 INFO:tasks.cephfs_test_runner: r.wait() 2023-08-31T02:01:47.463 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 161, in wait 2023-08-31T02:01:47.463 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-08-31T02:01:47.463 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-08-31T02:01:47.463 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-08-31T02:01:47.464 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)' 2023-08-31T02:01:47.464 INFO:tasks.cephfs_test_runner: 2023-08-31T02:01:47.464 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T02:01:47.526 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a8f9dbaa19dd4fe69711f2d79e74dabe Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T02:01:47.528 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-31T02:01:47.541 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-08-31T02:01:47.574 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-08-31T02:01:47.574 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:01:47.575 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:47.595 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12633 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-08-31T02:01:47.596 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-08-31T02:01:47.596 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:47.654 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12633 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-08-31T02:01:47.655 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:01:47.655 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:47.677 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=32,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=591 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-08-31T02:01:47.677 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-08-31T02:01:47.678 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T02:01:47.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=32,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=591 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-08-31T02:01:47.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:47.737 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-08-31T02:01:47.755 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T02:01:47.755 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T02:01:47.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:47.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T02:01:47.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:47.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T02:01:47.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:47.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-08-31T02:01:48.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:48.013 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-08-31T02:01:48.035 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-31T02:01:48.035 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T02:01:48.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:48.036 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T02:01:48.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:48.125 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T02:01:48.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T02:01:48.210 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2023-08-31T02:01:48.307 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-31T02:01:48.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-31T02:01:48.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.453+0000 7fcdea969700 1 -- 172.21.15.84:0/3156973092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde40cd380 msgr2=0x7fcde4159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.453+0000 7fcdea969700 1 --2- 172.21.15.84:0/3156973092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde40cd380 0x7fcde4159140 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcde40cb570 tx=0x7fcdd8009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:48.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.453+0000 7fcdea969700 1 -- 172.21.15.84:0/3156973092 shutdown_connections 2023-08-31T02:01:48.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.453+0000 7fcdea969700 1 --2- 172.21.15.84:0/3156973092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde40cd380 0x7fcde4159140 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.453+0000 7fcdea969700 1 --2- 172.21.15.84:0/3156973092 >> v2:172.21.15.170:3300/0 conn(0x7fcde415c930 0x7fcde40c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.453+0000 7fcdea969700 1 -- 172.21.15.84:0/3156973092 >> 172.21.15.84:0/3156973092 conn(0x7fcde40ca930 msgr2=0x7fcde40cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.453+0000 7fcdea969700 1 -- 172.21.15.84:0/3156973092 shutdown_connections 2023-08-31T02:01:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.453+0000 7fcdea969700 1 -- 172.21.15.84:0/3156973092 wait complete. 2023-08-31T02:01:48.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.454+0000 7fcdea969700 1 Processor -- start 2023-08-31T02:01:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.454+0000 7fcdea969700 1 -- start start 2023-08-31T02:01:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcdea969700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcde40c9ef0 0x7fcde41ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcdea969700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcde40cd380 0x7fcde4150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcdea969700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde415c930 0x7fcde4154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcdea969700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41f01b0 con 0x7fcde415c930 2023-08-31T02:01:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcdea969700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41f0490 con 0x7fcde40cd380 2023-08-31T02:01:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcdea969700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41f0770 con 0x7fcde40c9ef0 2023-08-31T02:01:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcde8f06700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde415c930 0x7fcde4154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcde8f06700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde415c930 0x7fcde4154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54564/0 (socket says 172.21.15.84:54564) 2023-08-31T02:01:48.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcde8f06700 1 -- 172.21.15.84:0/16386253 learned_addr learned my addr 172.21.15.84:0/16386253 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:48.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcde37fe700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcde40cd380 0x7fcde4150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:48.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.455+0000 7fcde3fff700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcde40c9ef0 0x7fcde41ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:48.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde8f06700 1 -- 172.21.15.84:0/16386253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcde40c9ef0 msgr2=0x7fcde41ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde8f06700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcde40c9ef0 0x7fcde41ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde8f06700 1 -- 172.21.15.84:0/16386253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcde40cd380 msgr2=0x7fcde4150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde8f06700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcde40cd380 0x7fcde4150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde8f06700 1 -- 172.21.15.84:0/16386253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80095f0 con 0x7fcde415c930 2023-08-31T02:01:48.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde8f06700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde415c930 0x7fcde4154f90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00b9e0 tx=0x7fcddc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:48.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde0ff9700 1 -- 172.21.15.84:0/16386253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00c950 con 0x7fcde415c930 2023-08-31T02:01:48.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde0ff9700 1 -- 172.21.15.84:0/16386253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcddc00cba0 con 0x7fcde415c930 2023-08-31T02:01:48.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde40c16f0 con 0x7fcde415c930 2023-08-31T02:01:48.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcde0ff9700 1 -- 172.21.15.84:0/16386253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc014440 con 0x7fcde415c930 2023-08-31T02:01:48.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.456+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde41efe10 con 0x7fcde415c930 2023-08-31T02:01:48.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.457+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde4151eb0 con 0x7fcde415c930 2023-08-31T02:01:48.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.458+0000 7fcde0ff9700 1 -- 172.21.15.84:0/16386253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcddc01e440 con 0x7fcde415c930 2023-08-31T02:01:48.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.458+0000 7fcde0ff9700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcdd006a0e0 0x7fcdd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:48.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.458+0000 7fcde0ff9700 1 -- 172.21.15.84:0/16386253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcddc088040 con 0x7fcde415c930 2023-08-31T02:01:48.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.458+0000 7fcde3fff700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcdd006a0e0 0x7fcdd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:48.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.459+0000 7fcde3fff700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcdd006a0e0 0x7fcdd006c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8000c00 tx=0x7fcdd80047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:48.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.463+0000 7fcde0ff9700 1 -- 172.21.15.84:0/16386253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcddc053a70 con 0x7fcde415c930 2023-08-31T02:01:48.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.648+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcde415c410 con 0x7fcdd006a0e0 2023-08-31T02:01:48.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.650+0000 7fcde0ff9700 1 -- 172.21.15.84:0/16386253 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50870 (secure 0 0 0) 0x7fcdd8004ab0 con 0x7fcdd006a0e0 2023-08-31T02:01:48.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:48.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcdd006a0e0 msgr2=0x7fcdd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcdd006a0e0 0x7fcdd006c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8000c00 tx=0x7fcdd80047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde415c930 msgr2=0x7fcde4154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde415c930 0x7fcde4154f90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00b9e0 tx=0x7fcddc00bda0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 shutdown_connections 2023-08-31T02:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcdd006a0e0 0x7fcdd006c5a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcde415c930 0x7fcde4154f90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcde40c9ef0 0x7fcde41ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 --2- 172.21.15.84:0/16386253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcde40cd380 0x7fcde4150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 >> 172.21.15.84:0/16386253 conn(0x7fcde40ca930 msgr2=0x7fcde41523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 shutdown_connections 2023-08-31T02:01:48.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.652+0000 7fcdea969700 1 -- 172.21.15.84:0/16386253 wait complete. 2023-08-31T02:01:48.648 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:48.656 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-08-31T02:01:47.072436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221168,"kb_used_data":4996,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753552,"statfs":{"total":773094113280,"available":772867637248,"internally_reserved":0,"allocated":5115904,"data_stored":2869235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6278,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000816"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155129+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:23.155129+0000","last_peered":"2023-08-31T02:01:23.155129+0000","last_clean":"2023-08-31T02:01:23.155129+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:23.155129+0000","last_undegraded":"2023-08-31T02:01:23.155129+0000","last_fullsized":"2023-08-31T02:01:23.155129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":216732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.373},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.74,"5min":11.74,"15min":11.74},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":11.707000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.659000000000001,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":11.628,"5min":11.628,"15min":11.628},"last":0.435}]}]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1085440,"data_stored":799947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.746},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.64500000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1093632,"data_stored":807044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.627},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64700000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":216712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.28000000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.38}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":0.307},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.6799999999999997,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.501},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.71,"5min":5.71,"15min":5.71},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.8579999999999997,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.53800000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":209543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.252}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.317},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.504},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.443}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.55000000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":210787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.623}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.755},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.74199999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":204470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.8460000000000001,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.745}]},{"osd":5,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.80300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:48.659 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:48.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.788+0000 7fd850093700 1 -- 172.21.15.84:0/3228537478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 msgr2=0x7fd84815b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.788+0000 7fd850093700 1 --2- 172.21.15.84:0/3228537478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 0x7fd84815b040 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd840009f60 tx=0x7fd840009f90 comp rx=0 tx=0).stop 2023-08-31T02:01:48.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.788+0000 7fd850093700 1 -- 172.21.15.84:0/3228537478 shutdown_connections 2023-08-31T02:01:48.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.788+0000 7fd850093700 1 --2- 172.21.15.84:0/3228537478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 0x7fd84815b040 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.788+0000 7fd850093700 1 --2- 172.21.15.84:0/3228537478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8480b2910 0x7fd8480b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.788+0000 7fd850093700 1 -- 172.21.15.84:0/3228537478 >> 172.21.15.84:0/3228537478 conn(0x7fd8480ca920 msgr2=0x7fd8480cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:48.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.788+0000 7fd850093700 1 -- 172.21.15.84:0/3228537478 shutdown_connections 2023-08-31T02:01:48.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.788+0000 7fd850093700 1 -- 172.21.15.84:0/3228537478 wait complete. 2023-08-31T02:01:48.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.789+0000 7fd850093700 1 Processor -- start 2023-08-31T02:01:48.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.789+0000 7fd850093700 1 -- start start 2023-08-31T02:01:48.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd850093700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8480b2910 0x7fd848149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:48.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd850093700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 0x7fd8480c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:48.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd850093700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd84815c850 0x7fd8480c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:48.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd850093700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84814a480 con 0x7fd84815abb0 2023-08-31T02:01:48.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd850093700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848150130 con 0x7fd8480b2910 2023-08-31T02:01:48.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd850093700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd848150410 con 0x7fd84815c850 2023-08-31T02:01:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 0x7fd8480c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 0x7fd8480c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54576/0 (socket says 172.21.15.84:54576) 2023-08-31T02:01:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 -- 172.21.15.84:0/2562473804 learned_addr learned my addr 172.21.15.84:0/2562473804 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84e630700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd84815c850 0x7fd8480c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84de2f700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8480b2910 0x7fd848149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 -- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd84815c850 msgr2=0x7fd8480c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd84815c850 0x7fd8480c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 -- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8480b2910 msgr2=0x7fd848149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8480b2910 0x7fd848149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 -- 172.21.15.84:0/2562473804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009c40 con 0x7fd84815abb0 2023-08-31T02:01:48.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84e630700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd84815c850 0x7fd8480c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:48.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd84d62e700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 0x7fd8480c4130 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd84400e9a0 tx=0x7fd84400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:48.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd83e7fc700 1 -- 172.21.15.84:0/2562473804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844009790 con 0x7fd84815abb0 2023-08-31T02:01:48.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd83e7fc700 1 -- 172.21.15.84:0/2562473804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd84400ccc0 con 0x7fd84815abb0 2023-08-31T02:01:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8481506f0 con 0x7fd84815abb0 2023-08-31T02:01:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd83e7fc700 1 -- 172.21.15.84:0/2562473804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844010690 con 0x7fd84815abb0 2023-08-31T02:01:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.790+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8480c6020 con 0x7fd84815abb0 2023-08-31T02:01:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.791+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480c61b0 con 0x7fd84815abb0 2023-08-31T02:01:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.792+0000 7fd83e7fc700 1 -- 172.21.15.84:0/2562473804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd8440107f0 con 0x7fd84815abb0 2023-08-31T02:01:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.792+0000 7fd83e7fc700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd82c06a0e0 0x7fd82c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.792+0000 7fd83e7fc700 1 -- 172.21.15.84:0/2562473804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd844014070 con 0x7fd84815abb0 2023-08-31T02:01:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.792+0000 7fd84de2f700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd82c06a0e0 0x7fd82c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.792+0000 7fd84de2f700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd82c06a0e0 0x7fd82c06c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd838007fd0 tx=0x7fd838009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.796+0000 7fd83e7fc700 1 -- 172.21.15.84:0/2562473804 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd844051990 con 0x7fd84815abb0 2023-08-31T02:01:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.982+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8480b2310 con 0x7fd82c06a0e0 2023-08-31T02:01:48.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.984+0000 7fd83e7fc700 1 -- 172.21.15.84:0/2562473804 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50870 (secure 0 0 0) 0x7fd8380133e0 con 0x7fd82c06a0e0 2023-08-31T02:01:48.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:48.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd82c06a0e0 msgr2=0x7fd82c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd82c06a0e0 0x7fd82c06c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd838007fd0 tx=0x7fd838009040 comp rx=0 tx=0).stop 2023-08-31T02:01:48.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 msgr2=0x7fd8480c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:48.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 0x7fd8480c4130 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd84400e9a0 tx=0x7fd84400ed60 comp rx=0 tx=0).stop 2023-08-31T02:01:48.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 shutdown_connections 2023-08-31T02:01:48.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd82c06a0e0 0x7fd82c06c5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd84815c850 0x7fd8480c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8480b2910 0x7fd848149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 --2- 172.21.15.84:0/2562473804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd84815abb0 0x7fd8480c4130 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 >> 172.21.15.84:0/2562473804 conn(0x7fd8480ca920 msgr2=0x7fd8480cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 shutdown_connections 2023-08-31T02:01:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:48.986+0000 7fd850093700 1 -- 172.21.15.84:0/2562473804 wait complete. 2023-08-31T02:01:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:48.991 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-08-31T02:01:47.072436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221168,"kb_used_data":4996,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753552,"statfs":{"total":773094113280,"available":772867637248,"internally_reserved":0,"allocated":5115904,"data_stored":2869235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6278,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000816"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155129+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:23.155129+0000","last_peered":"2023-08-31T02:01:23.155129+0000","last_clean":"2023-08-31T02:01:23.155129+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:23.155129+0000","last_undegraded":"2023-08-31T02:01:23.155129+0000","last_fullsized":"2023-08-31T02:01:23.155129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":216732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.373},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.74,"5min":11.74,"15min":11.74},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":11.707000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.659000000000001,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":11.628,"5min":11.628,"15min":11.628},"last":0.435}]}]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1085440,"data_stored":799947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.746},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.64500000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1093632,"data_stored":807044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.627},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64700000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":216712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.28000000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.38}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":0.307},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.6799999999999997,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.501},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.71,"5min":5.71,"15min":5.71},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.8579999999999997,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.53800000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":209543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.252}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.317},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.504},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.443}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.55000000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":210787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.623}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.755},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.74199999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":204470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.8460000000000001,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.745}]},{"osd":5,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.80300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:48.993 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-31T02:01:48.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:49.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.125+0000 7f8c64169700 1 -- 172.21.15.84:0/2159136372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0707c0 msgr2=0x7f8c5c070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.125+0000 7f8c64169700 1 --2- 172.21.15.84:0/2159136372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0707c0 0x7f8c5c070c10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009f60 tx=0x7f8c54009f90 comp rx=0 tx=0).stop 2023-08-31T02:01:49.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.125+0000 7f8c64169700 1 -- 172.21.15.84:0/2159136372 shutdown_connections 2023-08-31T02:01:49.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.125+0000 7f8c64169700 1 --2- 172.21.15.84:0/2159136372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0707c0 0x7f8c5c070c10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.125+0000 7f8c64169700 1 --2- 172.21.15.84:0/2159136372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c5c0cc920 0x7f8c5c0c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.125+0000 7f8c64169700 1 -- 172.21.15.84:0/2159136372 >> 172.21.15.84:0/2159136372 conn(0x7f8c5c0caa20 msgr2=0x7f8c5c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:49.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.125+0000 7f8c64169700 1 -- 172.21.15.84:0/2159136372 shutdown_connections 2023-08-31T02:01:49.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.125+0000 7f8c64169700 1 -- 172.21.15.84:0/2159136372 wait complete. 2023-08-31T02:01:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.126+0000 7f8c64169700 1 Processor -- start 2023-08-31T02:01:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.126+0000 7f8c64169700 1 -- start start 2023-08-31T02:01:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c64169700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c5c0707c0 0x7f8c5c0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c64169700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0cc920 0x7f8c5c1ee230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c64169700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158220 0x7f8c5c0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c64169700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c155f70 con 0x7f8c5c158220 2023-08-31T02:01:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c64169700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c155360 con 0x7f8c5c0cc920 2023-08-31T02:01:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c64169700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c155640 con 0x7f8c5c0707c0 2023-08-31T02:01:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c62706700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158220 0x7f8c5c0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c62706700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158220 0x7f8c5c0c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54590/0 (socket says 172.21.15.84:54590) 2023-08-31T02:01:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c62706700 1 -- 172.21.15.84:0/1634791587 learned_addr learned my addr 172.21.15.84:0/1634791587 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c61704700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0cc920 0x7f8c5c1ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c61f05700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c5c0707c0 0x7f8c5c0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c62706700 1 -- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c5c0707c0 msgr2=0x7f8c5c0c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c62706700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c5c0707c0 0x7f8c5c0c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c62706700 1 -- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0cc920 msgr2=0x7f8c5c1ee230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c62706700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0cc920 0x7f8c5c1ee230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c62706700 1 -- 172.21.15.84:0/1634791587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54009c40 con 0x7f8c5c158220 2023-08-31T02:01:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.127+0000 7f8c61704700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0cc920 0x7f8c5c1ee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T02:01:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.128+0000 7f8c62706700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158220 0x7f8c5c0c8710 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400b610 tx=0x7f8c54007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.128+0000 7f8c4e7fc700 1 -- 172.21.15.84:0/1634791587 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400e040 con 0x7f8c5c158220 2023-08-31T02:01:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.128+0000 7f8c4e7fc700 1 -- 172.21.15.84:0/1634791587 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c5401d680 con 0x7f8c5c158220 2023-08-31T02:01:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.128+0000 7f8c4e7fc700 1 -- 172.21.15.84:0/1634791587 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5401da70 con 0x7f8c5c158220 2023-08-31T02:01:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.128+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c155920 con 0x7f8c5c158220 2023-08-31T02:01:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.128+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c1ee770 con 0x7f8c5c158220 2023-08-31T02:01:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.129+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c066880 con 0x7f8c5c158220 2023-08-31T02:01:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.129+0000 7f8c4e7fc700 1 -- 172.21.15.84:0/1634791587 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c5401dbd0 con 0x7f8c5c158220 2023-08-31T02:01:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.130+0000 7f8c4e7fc700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c4006a0e0 0x7f8c4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.130+0000 7f8c4e7fc700 1 -- 172.21.15.84:0/1634791587 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8c5408a290 con 0x7f8c5c158220 2023-08-31T02:01:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.130+0000 7f8c61f05700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c4006a0e0 0x7f8c4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.130+0000 7f8c61f05700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c4006a0e0 0x7f8c4006c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004740 tx=0x7f8c58007f40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.134+0000 7f8c4e7fc700 1 -- 172.21.15.84:0/1634791587 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8c54055cc0 con 0x7f8c5c158220 2023-08-31T02:01:49.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.318+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c5c06d2b0 con 0x7f8c4006a0e0 2023-08-31T02:01:49.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.320+0000 7f8c4e7fc700 1 -- 172.21.15.84:0/1634791587 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50868 (secure 0 0 0) 0x7f8c58001cc0 con 0x7f8c4006a0e0 2023-08-31T02:01:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:49.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c4006a0e0 msgr2=0x7f8c4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c4006a0e0 0x7f8c4006c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004740 tx=0x7f8c58007f40 comp rx=0 tx=0).stop 2023-08-31T02:01:49.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158220 msgr2=0x7f8c5c0c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158220 0x7f8c5c0c8710 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400b610 tx=0x7f8c54007aa0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 shutdown_connections 2023-08-31T02:01:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f8c4006a0e0 0x7f8c4006c5a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158220 0x7f8c5c0c8710 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c5c0707c0 0x7f8c5c0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 --2- 172.21.15.84:0/1634791587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c0cc920 0x7f8c5c1ee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 >> 172.21.15.84:0/1634791587 conn(0x7f8c5c0caa20 msgr2=0x7f8c5c1573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 shutdown_connections 2023-08-31T02:01:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.322+0000 7f8c64169700 1 -- 172.21.15.84:0/1634791587 wait complete. 2023-08-31T02:01:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:49.327 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-08-31T02:01:49.072802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221220,"kb_used_data":5044,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753500,"statfs":{"total":773094113280,"available":772867584000,"internally_reserved":0,"allocated":5165056,"data_stored":2894160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6278,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.879660"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T02:01:23.155129+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:23.155129+0000","last_peered":"2023-08-31T02:01:23.155129+0000","last_clean":"2023-08-31T02:01:23.155129+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:23.155129+0000","last_undegraded":"2023-08-31T02:01:23.155129+0000","last_fullsized":"2023-08-31T02:01:23.155129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":216732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.373},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":11.74,"5min":11.74,"15min":11.74},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":11.707000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.659000000000001,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":11.628,"5min":11.628,"15min":11.628},"last":0.435}]}]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1085440,"data_stored":799947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.746},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.64500000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1093632,"data_stored":807044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.433},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.504}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.36799999999999999}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":216712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.28000000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.7400000000000002,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.38}]},{"osd":3,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":0.307},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.6799999999999997,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":5.8879999999999999,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.501},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.71,"5min":5.71,"15min":5.71},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 02:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.8579999999999997,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.53800000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":209543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.252}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.317},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.504},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.443}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.55000000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":210787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.623}]},{"osd":5,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.755},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.74199999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":204470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.8460000000000001,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.745}]},{"osd":5,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Aug 31 02:00:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.80300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:49.329 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T02:01:49.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.460+0000 7f3f97427700 1 -- 172.21.15.84:0/2291517449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 msgr2=0x7f3f90159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.460+0000 7f3f97427700 1 --2- 172.21.15.84:0/2291517449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 0x7f3f90159a00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009fd0 tx=0x7f3f8800b380 comp rx=0 tx=0).stop 2023-08-31T02:01:49.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.460+0000 7f3f97427700 1 -- 172.21.15.84:0/2291517449 shutdown_connections 2023-08-31T02:01:49.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.460+0000 7f3f97427700 1 --2- 172.21.15.84:0/2291517449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 0x7f3f90159a00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.460+0000 7f3f97427700 1 --2- 172.21.15.84:0/2291517449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f900af3d0 0x7f3f9015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.460+0000 7f3f97427700 1 -- 172.21.15.84:0/2291517449 >> 172.21.15.84:0/2291517449 conn(0x7f3f9006fca0 msgr2=0x7f3f900cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:49.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.460+0000 7f3f97427700 1 -- 172.21.15.84:0/2291517449 shutdown_connections 2023-08-31T02:01:49.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.460+0000 7f3f97427700 1 -- 172.21.15.84:0/2291517449 wait complete. 2023-08-31T02:01:49.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.461+0000 7f3f97427700 1 Processor -- start 2023-08-31T02:01:49.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.461+0000 7f3f97427700 1 -- start start 2023-08-31T02:01:49.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f97427700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f900af3d0 0x7f3f900c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:49.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f97427700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 0x7f3f9006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:49.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f97427700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f900ce570 0x7f3f901465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:49.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f97427700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900c37f0 con 0x7f3f900b12c0 2023-08-31T02:01:49.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f97427700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90152a50 con 0x7f3f900af3d0 2023-08-31T02:01:49.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f97427700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9006f340 con 0x7f3f900ce570 2023-08-31T02:01:49.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f949c2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 0x7f3f9006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:49.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f949c2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 0x7f3f9006ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54602/0 (socket says 172.21.15.84:54602) 2023-08-31T02:01:49.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f949c2700 1 -- 172.21.15.84:0/2363025854 learned_addr learned my addr 172.21.15.84:0/2363025854 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:49.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f959c4700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f900ce570 0x7f3f901465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:49.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f951c3700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f900af3d0 0x7f3f900c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:49.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f949c2700 1 -- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f900ce570 msgr2=0x7f3f901465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.462+0000 7f3f949c2700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f900ce570 0x7f3f901465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f949c2700 1 -- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f900af3d0 msgr2=0x7f3f900c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f949c2700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f900af3d0 0x7f3f900c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f949c2700 1 -- 172.21.15.84:0/2363025854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88009d00 con 0x7f3f900b12c0 2023-08-31T02:01:49.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f951c3700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f900af3d0 0x7f3f900c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:49.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f949c2700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 0x7f3f9006ee00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00c4d0 tx=0x7f3f8c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:49.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f85ffb700 1 -- 172.21.15.84:0/2363025854 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0054e0 con 0x7f3f900b12c0 2023-08-31T02:01:49.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f85ffb700 1 -- 172.21.15.84:0/2363025854 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3f8c003680 con 0x7f3f900b12c0 2023-08-31T02:01:49.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f85ffb700 1 -- 172.21.15.84:0/2363025854 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c003a90 con 0x7f3f900b12c0 2023-08-31T02:01:49.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f90146af0 con 0x7f3f900b12c0 2023-08-31T02:01:49.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.463+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f900c5470 con 0x7f3f900b12c0 2023-08-31T02:01:49.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.464+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9004e7c0 con 0x7f3f900b12c0 2023-08-31T02:01:49.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.464+0000 7f3f85ffb700 1 -- 172.21.15.84:0/2363025854 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3f8c003bf0 con 0x7f3f900b12c0 2023-08-31T02:01:49.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.465+0000 7f3f85ffb700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f7406a0e0 0x7f3f7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:49.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.465+0000 7f3f85ffb700 1 -- 172.21.15.84:0/2363025854 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3f8c087450 con 0x7f3f900b12c0 2023-08-31T02:01:49.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.465+0000 7f3f951c3700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f7406a0e0 0x7f3f7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:49.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.465+0000 7f3f951c3700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f7406a0e0 0x7f3f7406c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f80005950 tx=0x7f3f80005eb0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:49.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.469+0000 7f3f85ffb700 1 -- 172.21.15.84:0/2363025854 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3f8c052df0 con 0x7f3f900b12c0 2023-08-31T02:01:49.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.659+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f900b00a0 con 0x7f3f900b12c0 2023-08-31T02:01:49.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.660+0000 7f3f85ffb700 1 -- 172.21.15.84:0/2363025854 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13165 (secure 0 0 0) 0x7f3f8c056410 con 0x7f3f900b12c0 2023-08-31T02:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":45,"fsid":"3192a6ac-325f-4185-9b3a-d848f695e6dd","created":"2023-08-31T01:59:32.389052+0000","modified":"2023-08-31T02:01:46.427066+0000","last_up_change":"2023-08-31T01:59:44.497914+0000","last_in_change":"2023-08-31T01:59:35.976173+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T01:59:45.089337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aeb58e93-e490-463f-9ab8-b9295b224a8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6815","nonce":856635215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6819","nonce":856635215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6823","nonce":856635215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":856635215},{"type":"v1","addr":"172.21.15.84:6821","nonce":856635215}]},"public_addr":"172.21.15.84:6815/856635215","cluster_addr":"172.21.15.84:6819/856635215","heartbeat_back_addr":"172.21.15.84:6823/856635215","heartbeat_front_addr":"172.21.15.84:6821/856635215","state":["exists","up"]},{"osd":1,"uuid":"8b81870a-0d5c-4b87-b959-b44386769b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6809","nonce":257300748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6811","nonce":257300748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6818","nonce":257300748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":257300748},{"type":"v1","addr":"172.21.15.84:6814","nonce":257300748}]},"public_addr":"172.21.15.84:6809/257300748","cluster_addr":"172.21.15.84:6811/257300748","heartbeat_back_addr":"172.21.15.84:6818/257300748","heartbeat_front_addr":"172.21.15.84:6814/257300748","state":["exists","up"]},{"osd":2,"uuid":"902b105d-5db8-41ea-a4b7-8917479c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6801","nonce":1213248925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6803","nonce":1213248925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6807","nonce":1213248925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1213248925},{"type":"v1","addr":"172.21.15.84:6805","nonce":1213248925}]},"public_addr":"172.21.15.84:6801/1213248925","cluster_addr":"172.21.15.84:6803/1213248925","heartbeat_back_addr":"172.21.15.84:6807/1213248925","heartbeat_front_addr":"172.21.15.84:6805/1213248925","state":["exists","up"]},{"osd":3,"uuid":"cee7d084-e5fd-4b9c-92e3-e14e7efd925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6825","nonce":266140406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6827","nonce":266140406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6831","nonce":266140406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":266140406},{"type":"v1","addr":"172.21.15.84:6829","nonce":266140406}]},"public_addr":"172.21.15.84:6825/266140406","cluster_addr":"172.21.15.84:6827/266140406","heartbeat_back_addr":"172.21.15.84:6831/266140406","heartbeat_front_addr":"172.21.15.84:6829/266140406","state":["exists","up"]},{"osd":4,"uuid":"c452f9fd-131e-401f-b16c-4406f2aff9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6809","nonce":1776632925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6811","nonce":1776632925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6815","nonce":1776632925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1776632925},{"type":"v1","addr":"172.21.15.170:6813","nonce":1776632925}]},"public_addr":"172.21.15.170:6809/1776632925","cluster_addr":"172.21.15.170:6811/1776632925","heartbeat_back_addr":"172.21.15.170:6815/1776632925","heartbeat_front_addr":"172.21.15.170:6813/1776632925","state":["exists","up"]},{"osd":5,"uuid":"0b52460e-6bb7-4f33-801f-cbdff681fcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6801","nonce":4177484541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6803","nonce":4177484541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6807","nonce":4177484541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4177484541},{"type":"v1","addr":"172.21.15.170:6805","nonce":4177484541}]},"public_addr":"172.21.15.170:6801/4177484541","cluster_addr":"172.21.15.170:6803/4177484541","heartbeat_back_addr":"172.21.15.170:6807/4177484541","heartbeat_front_addr":"172.21.15.170:6805/4177484541","state":["exists","up"]},{"osd":6,"uuid":"a076d44f-d92a-4547-a076-dabe1fff3121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6825","nonce":1742000930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6827","nonce":1742000930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6831","nonce":1742000930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1742000930},{"type":"v1","addr":"172.21.15.170:6829","nonce":1742000930}]},"public_addr":"172.21.15.170:6825/1742000930","cluster_addr":"172.21.15.170:6827/1742000930","heartbeat_back_addr":"172.21.15.170:6831/1742000930","heartbeat_front_addr":"172.21.15.170:6829/1742000930","state":["exists","up"]},{"osd":7,"uuid":"041acc92-3c86-425f-a750-6db96a7b852a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6817","nonce":2208670688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6819","nonce":2208670688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6823","nonce":2208670688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2208670688},{"type":"v1","addr":"172.21.15.170:6821","nonce":2208670688}]},"public_addr":"172.21.15.170:6817/2208670688","cluster_addr":"172.21.15.170:6819/2208670688","heartbeat_back_addr":"172.21.15.170:6823/2208670688","heartbeat_front_addr":"172.21.15.170:6821/2208670688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.232169+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.150454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.917086+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:40.939032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.162537+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.715874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.146125+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T01:59:41.143364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6836/915893970":"2023-09-01T02:01:43.420167+0000","172.21.15.84:6834/915893970":"2023-09-01T02:01:43.420167+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T02:01:49.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f7406a0e0 msgr2=0x7f3f7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f7406a0e0 0x7f3f7406c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f80005950 tx=0x7f3f80005eb0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 msgr2=0x7f3f9006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:49.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 0x7f3f9006ee00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00c4d0 tx=0x7f3f8c00c890 comp rx=0 tx=0).stop 2023-08-31T02:01:49.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 shutdown_connections 2023-08-31T02:01:49.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f3f7406a0e0 0x7f3f7406c5a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f900ce570 0x7f3f901465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f900af3d0 0x7f3f900c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 --2- 172.21.15.84:0/2363025854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f900b12c0 0x7f3f9006ee00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 >> 172.21.15.84:0/2363025854 conn(0x7f3f9006fca0 msgr2=0x7f3f9015b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 shutdown_connections 2023-08-31T02:01:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:49.662+0000 7f3f97427700 1 -- 172.21.15.84:0/2363025854 wait complete. 2023-08-31T02:01:50.667 INFO:tasks.ceph:Scrubbing osd.0 2023-08-31T02:01:50.668 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-31T02:01:50.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.815+0000 7f2d31c51700 1 -- 172.21.15.84:0/2778021640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06d810 msgr2=0x7f2d2c06a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.815+0000 7f2d31c51700 1 --2- 172.21.15.84:0/2778021640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06d810 0x7f2d2c06a1b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2d20005fd0 tx=0x7f2d20009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:50.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.815+0000 7f2d31c51700 1 -- 172.21.15.84:0/2778021640 shutdown_connections 2023-08-31T02:01:50.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.815+0000 7f2d31c51700 1 --2- 172.21.15.84:0/2778021640 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d2c06a6f0 0x7f2d2c161be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.815+0000 7f2d31c51700 1 --2- 172.21.15.84:0/2778021640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06d810 0x7f2d2c06a1b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.815+0000 7f2d31c51700 1 -- 172.21.15.84:0/2778021640 >> 172.21.15.84:0/2778021640 conn(0x7f2d2c0cd740 msgr2=0x7f2d2c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:50.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.815+0000 7f2d31c51700 1 -- 172.21.15.84:0/2778021640 shutdown_connections 2023-08-31T02:01:50.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.815+0000 7f2d31c51700 1 -- 172.21.15.84:0/2778021640 wait complete. 2023-08-31T02:01:50.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.816+0000 7f2d31c51700 1 Processor -- start 2023-08-31T02:01:50.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.817+0000 7f2d31c51700 1 -- start start 2023-08-31T02:01:50.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.817+0000 7f2d31c51700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d2c069dd0 0x7f2d2c160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d31c51700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06a6f0 0x7f2d2c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d31c51700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d2c06d810 0x7f2d2c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d31c51700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c160ea0 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d31c51700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c161180 con 0x7f2d2c06d810 2023-08-31T02:01:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d31c51700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c161460 con 0x7f2d2c069dd0 2023-08-31T02:01:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06a6f0 0x7f2d2c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06a6f0 0x7f2d2c0700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54616/0 (socket says 172.21.15.84:54616) 2023-08-31T02:01:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 -- 172.21.15.84:0/97315511 learned_addr learned my addr 172.21.15.84:0/97315511 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:50.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2b7fe700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d2c069dd0 0x7f2d2c160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2bfff700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d2c06d810 0x7f2d2c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 -- 172.21.15.84:0/97315511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d2c069dd0 msgr2=0x7f2d2c160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d2c069dd0 0x7f2d2c160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 -- 172.21.15.84:0/97315511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d2c06d810 msgr2=0x7f2d2c070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d2c06d810 0x7f2d2c070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 -- 172.21.15.84:0/97315511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d200095f0 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d2affd700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06a6f0 0x7f2d2c0700c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2d20000c00 tx=0x7f2d20004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:50.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2001c070 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2d20004320 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c161740 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20003680 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.818+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c160970 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.819+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d2c0c9f60 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.820+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2d200037e0 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.820+0000 7f2d13fff700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2d1806a0e0 0x7f2d1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.820+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2d20089b70 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.820+0000 7f2d2b7fe700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2d1806a0e0 0x7f2d1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.820+0000 7f2d13fff700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7f2d18070370 0x7f2d180727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.820+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 --> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d18072ea0 con 0x7f2d18070370 2023-08-31T02:01:50.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.820+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d20089fc0 con 0x7f2d2c06a6f0 2023-08-31T02:01:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.821+0000 7f2d2bfff700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7f2d18070370 0x7f2d180727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.821+0000 7f2d2b7fe700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2d1806a0e0 0x7f2d1806c5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c007fd0 tx=0x7f2d1c007ec0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.821+0000 7f2d2bfff700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7f2d18070370 0x7f2d180727d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.822+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 <== osd.0 v2:172.21.15.84:6813/856635215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2d18072ea0 con 0x7f2d18070370 2023-08-31T02:01:50.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.836+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 --> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2d2c073a40 con 0x7f2d18070370 2023-08-31T02:01:50.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.836+0000 7f2d13fff700 1 -- 172.21.15.84:0/97315511 <== osd.0 v2:172.21.15.84:6813/856635215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2d2c073a40 con 0x7f2d18070370 2023-08-31T02:01:50.829 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:50.830 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T02:01:50.830 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:50.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.836+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7f2d18070370 msgr2=0x7f2d180727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.836+0000 7f2d31c51700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6813/856635215,v1:172.21.15.84:6815/856635215] conn(0x7f2d18070370 0x7f2d180727d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2d1806a0e0 msgr2=0x7f2d1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d31c51700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f2d1806a0e0 0x7f2d1806c5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c007fd0 tx=0x7f2d1c007ec0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06a6f0 msgr2=0x7f2d2c0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d31c51700 1 --2- 172.21.15.84:0/97315511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d2c06a6f0 0x7f2d2c0700c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2d20000c00 tx=0x7f2d20004a60 comp rx=0 tx=0).stop 2023-08-31T02:01:50.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d2bfff700 1 -- 172.21.15.84:0/97315511 reap_dead start 2023-08-31T02:01:50.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 shutdown_connections 2023-08-31T02:01:50.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 >> 172.21.15.84:0/97315511 conn(0x7f2d2c0cd740 msgr2=0x7f2d2c0b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:50.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 shutdown_connections 2023-08-31T02:01:50.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.837+0000 7f2d31c51700 1 -- 172.21.15.84:0/97315511 wait complete. 2023-08-31T02:01:50.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-31T02:01:50.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 -- 172.21.15.84:0/4227615473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158080 msgr2=0x7f28a40b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 --2- 172.21.15.84:0/4227615473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158080 0x7f28a40b3630 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f28a415cef0 tx=0x7f2898009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:50.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 -- 172.21.15.84:0/4227615473 shutdown_connections 2023-08-31T02:01:50.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 --2- 172.21.15.84:0/4227615473 >> v2:172.21.15.170:3300/0 conn(0x7f28a40ccae0 0x7f28a40ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 --2- 172.21.15.84:0/4227615473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158080 0x7f28a40b3630 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 --2- 172.21.15.84:0/4227615473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a4158460 0x7f28a40b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 -- 172.21.15.84:0/4227615473 >> 172.21.15.84:0/4227615473 conn(0x7f28a4070860 msgr2=0x7f28a4070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:50.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 -- 172.21.15.84:0/4227615473 shutdown_connections 2023-08-31T02:01:50.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.971+0000 7f28a9f49700 1 -- 172.21.15.84:0/4227615473 wait complete. 2023-08-31T02:01:50.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.972+0000 7f28a9f49700 1 Processor -- start 2023-08-31T02:01:50.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.972+0000 7f28a9f49700 1 -- start start 2023-08-31T02:01:50.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a9f49700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a40ccae0 0x7f28a40c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a9f49700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a4158080 0x7f28a4158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a9f49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158460 0x7f28a40c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a9f49700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40c42a0 con 0x7f28a4158460 2023-08-31T02:01:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a9f49700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a4158fe0 con 0x7f28a40ccae0 2023-08-31T02:01:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a9f49700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a41592c0 con 0x7f28a4158080 2023-08-31T02:01:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158460 0x7f28a40c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158460 0x7f28a40c09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54634/0 (socket says 172.21.15.84:54634) 2023-08-31T02:01:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a3fff700 1 -- 172.21.15.84:0/652052369 learned_addr learned my addr 172.21.15.84:0/652052369 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a37fe700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a40ccae0 0x7f28a40c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.973+0000 7f28a2ffd700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a4158080 0x7f28a4158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a3fff700 1 -- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a4158080 msgr2=0x7f28a4158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a3fff700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a4158080 0x7f28a4158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a3fff700 1 -- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a40ccae0 msgr2=0x7f28a40c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:50.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a3fff700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a40ccae0 0x7f28a40c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:50.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a3fff700 1 -- 172.21.15.84:0/652052369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980095f0 con 0x7f28a4158460 2023-08-31T02:01:50.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a2ffd700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a4158080 0x7f28a4158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a3fff700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158460 0x7f28a40c09c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f289c00ab90 tx=0x7f289c00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f288bfff700 1 -- 172.21.15.84:0/652052369 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00f070 con 0x7f28a4158460 2023-08-31T02:01:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f288bfff700 1 -- 172.21.15.84:0/652052369 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f289c004bb0 con 0x7f28a4158460 2023-08-31T02:01:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a41595a0 con 0x7f28a4158460 2023-08-31T02:01:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f288bfff700 1 -- 172.21.15.84:0/652052369 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00c660 con 0x7f28a4158460 2023-08-31T02:01:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.974+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a4159b60 con 0x7f28a4158460 2023-08-31T02:01:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.975+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a404e7c0 con 0x7f28a4158460 2023-08-31T02:01:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.975+0000 7f288bfff700 1 -- 172.21.15.84:0/652052369 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f289c00c7c0 con 0x7f28a4158460 2023-08-31T02:01:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.975+0000 7f288bfff700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f289006a0e0 0x7f289006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.976+0000 7f288bfff700 1 -- 172.21.15.84:0/652052369 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f289c087e00 con 0x7f28a4158460 2023-08-31T02:01:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.976+0000 7f28a37fe700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f289006a0e0 0x7f289006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:50.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.976+0000 7f28a37fe700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f289006a0e0 0x7f289006c5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f28980098e0 tx=0x7f28980047c0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:50.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:50.980+0000 7f288bfff700 1 -- 172.21.15.84:0/652052369 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f289c053830 con 0x7f28a4158460 2023-08-31T02:01:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.170+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f28a40715b0 con 0x7f289006a0e0 2023-08-31T02:01:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.171+0000 7f288bfff700 1 -- 172.21.15.84:0/652052369 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f28a40715b0 con 0x7f289006a0e0 2023-08-31T02:01:51.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f289006a0e0 msgr2=0x7f289006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f289006a0e0 0x7f289006c5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f28980098e0 tx=0x7f28980047c0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158460 msgr2=0x7f28a40c09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158460 0x7f28a40c09c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f289c00ab90 tx=0x7f289c00aea0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 shutdown_connections 2023-08-31T02:01:51.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f289006a0e0 0x7f289006c5a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a4158460 0x7f28a40c09c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a40ccae0 0x7f28a40c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 --2- 172.21.15.84:0/652052369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a4158080 0x7f28a4158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.172+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 >> 172.21.15.84:0/652052369 conn(0x7f28a4070860 msgr2=0x7f28a40c9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:51.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.173+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 shutdown_connections 2023-08-31T02:01:51.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.173+0000 7f28a9f49700 1 -- 172.21.15.84:0/652052369 wait complete. 2023-08-31T02:01:51.169 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 0 to deep-scrub 2023-08-31T02:01:51.177 INFO:tasks.ceph:Scrubbing osd.1 2023-08-31T02:01:51.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-31T02:01:51.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.311+0000 7fd4f6676700 1 -- 172.21.15.84:0/1159523558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4f00b1810 msgr2=0x7fd4f00b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.311+0000 7fd4f6676700 1 --2- 172.21.15.84:0/1159523558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4f00b1810 0x7fd4f00b29b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00098c0 tx=0x7fd4e0009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.311+0000 7fd4f6676700 1 -- 172.21.15.84:0/1159523558 shutdown_connections 2023-08-31T02:01:51.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.311+0000 7fd4f6676700 1 --2- 172.21.15.84:0/1159523558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4f00b1c90 0x7fd4f00b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.311+0000 7fd4f6676700 1 --2- 172.21.15.84:0/1159523558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4f00b1810 0x7fd4f00b29b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.311+0000 7fd4f6676700 1 -- 172.21.15.84:0/1159523558 >> 172.21.15.84:0/1159523558 conn(0x7fd4f00caa30 msgr2=0x7fd4f00cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:51.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.311+0000 7fd4f6676700 1 -- 172.21.15.84:0/1159523558 shutdown_connections 2023-08-31T02:01:51.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.311+0000 7fd4f6676700 1 -- 172.21.15.84:0/1159523558 wait complete. 2023-08-31T02:01:51.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.312+0000 7fd4f6676700 1 Processor -- start 2023-08-31T02:01:51.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.312+0000 7fd4f6676700 1 -- start start 2023-08-31T02:01:51.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4f6676700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4f00b1810 0x7fd4f015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4f6676700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f00b1c90 0x7fd4f006a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4f6676700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4f01591d0 0x7fd4f014a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4f6676700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f015c440 con 0x7fd4f00b1c90 2023-08-31T02:01:51.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4f6676700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f015b550 con 0x7fd4f01591d0 2023-08-31T02:01:51.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4f6676700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f015b830 con 0x7fd4f00b1810 2023-08-31T02:01:51.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f00b1c90 0x7fd4f006a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f00b1c90 0x7fd4f006a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54646/0 (socket says 172.21.15.84:54646) 2023-08-31T02:01:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 -- 172.21.15.84:0/218376261 learned_addr learned my addr 172.21.15.84:0/218376261 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4f4c13700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4f01591d0 0x7fd4f014a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4effff700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4f00b1810 0x7fd4f015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 -- 172.21.15.84:0/218376261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4f00b1810 msgr2=0x7fd4f015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4f00b1810 0x7fd4f015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 -- 172.21.15.84:0/218376261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4f01591d0 msgr2=0x7fd4f014a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4f01591d0 0x7fd4f014a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 -- 172.21.15.84:0/218376261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e0009520 con 0x7fd4f00b1c90 2023-08-31T02:01:51.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.313+0000 7fd4ef7fe700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f00b1c90 0x7fd4f006a210 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000c00 tx=0x7fd4e000f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.314+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000fb10 con 0x7fd4f00b1c90 2023-08-31T02:01:51.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.314+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd4e000fc70 con 0x7fd4f00b1c90 2023-08-31T02:01:51.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.314+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f015bb10 con 0x7fd4f00b1c90 2023-08-31T02:01:51.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.314+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0017660 con 0x7fd4f00b1c90 2023-08-31T02:01:51.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.314+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f015c0d0 con 0x7fd4f00b1c90 2023-08-31T02:01:51.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.314+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4f00c98b0 con 0x7fd4f00b1c90 2023-08-31T02:01:51.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.315+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd4e00177c0 con 0x7fd4f00b1c90 2023-08-31T02:01:51.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.315+0000 7fd4ecff9700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4d006a0e0 0x7fd4d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.315+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd4e008a040 con 0x7fd4f00b1c90 2023-08-31T02:01:51.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.315+0000 7fd4effff700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4d006a0e0 0x7fd4d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.315+0000 7fd4ecff9700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7fd4d0070370 0x7fd4d00727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.315+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 --> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4d0072ea0 con 0x7fd4d0070370 2023-08-31T02:01:51.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.315+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4e008c700 con 0x7fd4f00b1c90 2023-08-31T02:01:51.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.316+0000 7fd4f4c13700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7fd4d0070370 0x7fd4d00727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.316+0000 7fd4effff700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4d006a0e0 0x7fd4d006c5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8004740 tx=0x7fd4d8007f40 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.316+0000 7fd4f4c13700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7fd4d0070370 0x7fd4d00727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.316+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 <== osd.1 v2:172.21.15.84:6808/257300748 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd4d0072ea0 con 0x7fd4d0070370 2023-08-31T02:01:51.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 --> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd4f0073a40 con 0x7fd4d0070370 2023-08-31T02:01:51.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4ecff9700 1 -- 172.21.15.84:0/218376261 <== osd.1 v2:172.21.15.84:6808/257300748 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd4f0073a40 con 0x7fd4d0070370 2023-08-31T02:01:51.324 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:51.324 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T02:01:51.325 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:51.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7fd4d0070370 msgr2=0x7fd4d00727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4f6676700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6808/257300748,v1:172.21.15.84:6809/257300748] conn(0x7fd4d0070370 0x7fd4d00727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4d006a0e0 msgr2=0x7fd4d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4f6676700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fd4d006a0e0 0x7fd4d006c5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8004740 tx=0x7fd4d8007f40 comp rx=0 tx=0).stop 2023-08-31T02:01:51.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f00b1c90 msgr2=0x7fd4f006a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4f6676700 1 --2- 172.21.15.84:0/218376261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f00b1c90 0x7fd4f006a210 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000c00 tx=0x7fd4e000f710 comp rx=0 tx=0).stop 2023-08-31T02:01:51.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.331+0000 7fd4f4c13700 1 -- 172.21.15.84:0/218376261 reap_dead start 2023-08-31T02:01:51.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.332+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 shutdown_connections 2023-08-31T02:01:51.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.332+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 >> 172.21.15.84:0/218376261 conn(0x7fd4f00caa30 msgr2=0x7fd4f0158470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:51.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.332+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 shutdown_connections 2023-08-31T02:01:51.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.332+0000 7fd4f6676700 1 -- 172.21.15.84:0/218376261 wait complete. 2023-08-31T02:01:51.336 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-31T02:01:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.467+0000 7fe4dce9c700 1 -- 172.21.15.84:0/1183957842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d80c99b0 msgr2=0x7fe4d80708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.467+0000 7fe4dce9c700 1 --2- 172.21.15.84:0/1183957842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d80c99b0 0x7fe4d80708a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0098f0 tx=0x7fe4cc009c00 comp rx=0 tx=0).stop 2023-08-31T02:01:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.467+0000 7fe4dce9c700 1 -- 172.21.15.84:0/1183957842 shutdown_connections 2023-08-31T02:01:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.467+0000 7fe4dce9c700 1 --2- 172.21.15.84:0/1183957842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d80c99b0 0x7fe4d80708a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.467+0000 7fe4dce9c700 1 -- 172.21.15.84:0/1183957842 >> 172.21.15.84:0/1183957842 conn(0x7fe4d80cdeb0 msgr2=0x7fe4d80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.467+0000 7fe4dce9c700 1 -- 172.21.15.84:0/1183957842 shutdown_connections 2023-08-31T02:01:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.467+0000 7fe4dce9c700 1 -- 172.21.15.84:0/1183957842 wait complete. 2023-08-31T02:01:51.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.468+0000 7fe4dce9c700 1 Processor -- start 2023-08-31T02:01:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.468+0000 7fe4dce9c700 1 -- start start 2023-08-31T02:01:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4dce9c700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4d80b0d00 0x7fe4d80c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4dce9c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d80c99b0 0x7fe4d80c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4dce9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d8158120 0x7fe4d81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4dce9c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d80c7e50 con 0x7fe4d8158120 2023-08-31T02:01:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4dce9c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d8155620 con 0x7fe4d80c99b0 2023-08-31T02:01:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4dce9c700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d80c7b70 con 0x7fe4d80b0d00 2023-08-31T02:01:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4d6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d8158120 0x7fe4d81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4d6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d8158120 0x7fe4d81550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54664/0 (socket says 172.21.15.84:54664) 2023-08-31T02:01:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4d6d9d700 1 -- 172.21.15.84:0/340452615 learned_addr learned my addr 172.21.15.84:0/340452615 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:51.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4d659c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4d80b0d00 0x7fe4d80c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.469+0000 7fe4d5d9b700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d80c99b0 0x7fe4d80c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4d6d9d700 1 -- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4d80b0d00 msgr2=0x7fe4d80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4d6d9d700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4d80b0d00 0x7fe4d80c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4d6d9d700 1 -- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d80c99b0 msgr2=0x7fe4d80c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4d6d9d700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d80c99b0 0x7fe4d80c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4d6d9d700 1 -- 172.21.15.84:0/340452615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009520 con 0x7fe4d8158120 2023-08-31T02:01:51.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4d5d9b700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d80c99b0 0x7fe4d80c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:51.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4d659c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4d80b0d00 0x7fe4d80c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:51.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4d6d9d700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d8158120 0x7fe4d81550e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c7c0 tx=0x7fe4d000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4c6ffd700 1 -- 172.21.15.84:0/340452615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0003e30 con 0x7fe4d8158120 2023-08-31T02:01:51.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4c6ffd700 1 -- 172.21.15.84:0/340452615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe4d0005070 con 0x7fe4d8158120 2023-08-31T02:01:51.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d80c5ac0 con 0x7fe4d8158120 2023-08-31T02:01:51.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4c6ffd700 1 -- 172.21.15.84:0/340452615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0005480 con 0x7fe4d8158120 2023-08-31T02:01:51.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.470+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d80c6080 con 0x7fe4d8158120 2023-08-31T02:01:51.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.471+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d80c5920 con 0x7fe4d8158120 2023-08-31T02:01:51.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.471+0000 7fe4c6ffd700 1 -- 172.21.15.84:0/340452615 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4d00055e0 con 0x7fe4d8158120 2023-08-31T02:01:51.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.472+0000 7fe4c6ffd700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe4b806a0e0 0x7fe4b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.472+0000 7fe4d659c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe4b806a0e0 0x7fe4b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.472+0000 7fe4c6ffd700 1 -- 172.21.15.84:0/340452615 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe4d00880b0 con 0x7fe4d8158120 2023-08-31T02:01:51.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.472+0000 7fe4d659c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe4b806a0e0 0x7fe4b806c5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8006fd0 tx=0x7fe4c8008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.476+0000 7fe4c6ffd700 1 -- 172.21.15.84:0/340452615 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe4d80c5920 con 0x7fe4d8158120 2023-08-31T02:01:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.666+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4d80c5920 con 0x7fe4b806a0e0 2023-08-31T02:01:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.666+0000 7fe4c6ffd700 1 -- 172.21.15.84:0/340452615 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe4d80c5920 con 0x7fe4b806a0e0 2023-08-31T02:01:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe4b806a0e0 msgr2=0x7fe4b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe4b806a0e0 0x7fe4b806c5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8006fd0 tx=0x7fe4c8008040 comp rx=0 tx=0).stop 2023-08-31T02:01:51.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d8158120 msgr2=0x7fe4d81550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d8158120 0x7fe4d81550e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c7c0 tx=0x7fe4d000cb80 comp rx=0 tx=0).stop 2023-08-31T02:01:51.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 shutdown_connections 2023-08-31T02:01:51.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe4b806a0e0 0x7fe4b806c5a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d8158120 0x7fe4d81550e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4d80b0d00 0x7fe4d80c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 --2- 172.21.15.84:0/340452615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d80c99b0 0x7fe4d80c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 >> 172.21.15.84:0/340452615 conn(0x7fe4d80cdeb0 msgr2=0x7fe4d8155ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 shutdown_connections 2023-08-31T02:01:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.668+0000 7fe4dce9c700 1 -- 172.21.15.84:0/340452615 wait complete. 2023-08-31T02:01:51.668 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 1 to deep-scrub 2023-08-31T02:01:51.673 INFO:tasks.ceph:Scrubbing osd.2 2023-08-31T02:01:51.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-31T02:01:51.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 -- 172.21.15.84:0/3516601397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0b0eb0 msgr2=0x7f7fdc0cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 --2- 172.21.15.84:0/3516601397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0b0eb0 0x7f7fdc0cccb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc071760 tx=0x7f7fd400b380 comp rx=0 tx=0).stop 2023-08-31T02:01:51.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 -- 172.21.15.84:0/3516601397 shutdown_connections 2023-08-31T02:01:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 --2- 172.21.15.84:0/3516601397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0b0eb0 0x7f7fdc0cccb0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 --2- 172.21.15.84:0/3516601397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fdc0b0590 0x7f7fdc0ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 --2- 172.21.15.84:0/3516601397 >> v2:172.21.15.170:3300/0 conn(0x7f7fdc0cec70 0x7f7fdc0b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 -- 172.21.15.84:0/3516601397 >> 172.21.15.84:0/3516601397 conn(0x7f7fdc0cbb60 msgr2=0x7f7fdc0cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 -- 172.21.15.84:0/3516601397 shutdown_connections 2023-08-31T02:01:51.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.807+0000 7f7fe14dd700 1 -- 172.21.15.84:0/3516601397 wait complete. 2023-08-31T02:01:51.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.808+0000 7f7fe14dd700 1 Processor -- start 2023-08-31T02:01:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.808+0000 7f7fe14dd700 1 -- start start 2023-08-31T02:01:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fe14dd700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fdc0b0590 0x7f7fdc144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fe14dd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fdc0b0eb0 0x7f7fdc1dee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fe14dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0cec70 0x7f7fdc0c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fe14dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc144c90 con 0x7f7fdc0cec70 2023-08-31T02:01:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fe14dd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0c7c70 con 0x7f7fdc0b0eb0 2023-08-31T02:01:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fe14dd700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0c7680 con 0x7f7fdc0b0590 2023-08-31T02:01:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0cec70 0x7f7fdc0c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0cec70 0x7f7fdc0c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54676/0 (socket says 172.21.15.84:54676) 2023-08-31T02:01:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/2218811134 learned_addr learned my addr 172.21.15.84:0/2218811134 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:51.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdaffd700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fdc0b0590 0x7f7fdc144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fda7fc700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fdc0b0eb0 0x7f7fdc1dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/2218811134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fdc0b0590 msgr2=0x7f7fdc144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fdc0b0590 0x7f7fdc144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/2218811134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fdc0b0eb0 msgr2=0x7f7fdc1dee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fdc0b0eb0 0x7f7fdc1dee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/2218811134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4009d00 con 0x7f7fdc0cec70 2023-08-31T02:01:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fdb7fe700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0cec70 0x7f7fdc0c50f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc06af70 tx=0x7f7fd4007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd400e040 con 0x7f7fdc0cec70 2023-08-31T02:01:51.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7fd401d890 con 0x7f7fdc0cec70 2023-08-31T02:01:51.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc1ef360 con 0x7f7fdc0cec70 2023-08-31T02:01:51.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd401dce0 con 0x7f7fdc0cec70 2023-08-31T02:01:51.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.809+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc1dfb50 con 0x7f7fdc0cec70 2023-08-31T02:01:51.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.810+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fdc0b13a0 con 0x7f7fdc0cec70 2023-08-31T02:01:51.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.811+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7fd401b450 con 0x7f7fdc0cec70 2023-08-31T02:01:51.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.811+0000 7f7fc37fe700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.811+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7fd408a430 con 0x7f7fdc0cec70 2023-08-31T02:01:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.811+0000 7f7fdaffd700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.811+0000 7f7fc37fe700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f7fc8070370 0x7f7fc80727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.811+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 --> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fc8072ea0 con 0x7f7fc8070370 2023-08-31T02:01:51.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.811+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fd408caf0 con 0x7f7fdc0cec70 2023-08-31T02:01:51.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.811+0000 7f7fda7fc700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f7fc8070370 0x7f7fc80727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.812+0000 7f7fdaffd700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0005fd0 tx=0x7f7fd0005e00 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.812+0000 7f7fda7fc700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f7fc8070370 0x7f7fc80727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.812+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 <== osd.2 v2:172.21.15.84:6800/1213248925 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7fc8072ea0 con 0x7f7fc8070370 2023-08-31T02:01:51.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 --> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7fdc073a40 con 0x7f7fc8070370 2023-08-31T02:01:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fc37fe700 1 -- 172.21.15.84:0/2218811134 <== osd.2 v2:172.21.15.84:6800/1213248925 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7fdc073a40 con 0x7f7fc8070370 2023-08-31T02:01:51.820 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:51.820 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T02:01:51.821 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f7fc8070370 msgr2=0x7f7fc80727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6800/1213248925,v1:172.21.15.84:6801/1213248925] conn(0x7f7fc8070370 0x7f7fc80727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7fc806a0e0 msgr2=0x7f7fc806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0005fd0 tx=0x7f7fd0005e00 comp rx=0 tx=0).stop 2023-08-31T02:01:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0cec70 msgr2=0x7f7fdc0c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 --2- 172.21.15.84:0/2218811134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0cec70 0x7f7fdc0c50f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc06af70 tx=0x7f7fd4007c10 comp rx=0 tx=0).stop 2023-08-31T02:01:51.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/2218811134 reap_dead start 2023-08-31T02:01:51.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 shutdown_connections 2023-08-31T02:01:51.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.827+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 >> 172.21.15.84:0/2218811134 conn(0x7f7fdc0cbb60 msgr2=0x7f7fdc152870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:51.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.828+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 shutdown_connections 2023-08-31T02:01:51.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.828+0000 7f7fe14dd700 1 -- 172.21.15.84:0/2218811134 wait complete. 2023-08-31T02:01:51.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-31T02:01:51.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.962+0000 7fcd50b94700 1 -- 172.21.15.84:0/527997716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd34003a00 msgr2=0x7fcd34003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.962+0000 7fcd50b94700 1 --2- 172.21.15.84:0/527997716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd34003a00 0x7fcd34003e20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009c10 tx=0x7fcd34005880 comp rx=0 tx=0).stop 2023-08-31T02:01:51.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.962+0000 7fcd4ad9d700 1 -- 172.21.15.84:0/527997716 reap_dead start 2023-08-31T02:01:51.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.962+0000 7fcd50b94700 1 -- 172.21.15.84:0/527997716 shutdown_connections 2023-08-31T02:01:51.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.962+0000 7fcd50b94700 1 -- 172.21.15.84:0/527997716 >> 172.21.15.84:0/527997716 conn(0x7fcd4c0cdeb0 msgr2=0x7fcd4c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:51.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.963+0000 7fcd50b94700 1 -- 172.21.15.84:0/527997716 shutdown_connections 2023-08-31T02:01:51.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.963+0000 7fcd50b94700 1 -- 172.21.15.84:0/527997716 wait complete. 2023-08-31T02:01:51.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.964+0000 7fcd50b94700 1 Processor -- start 2023-08-31T02:01:51.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.964+0000 7fcd50b94700 1 -- start start 2023-08-31T02:01:51.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd50b94700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd34003a00 0x7fcd4c15b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd50b94700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd4c1e2e00 0x7fcd4c155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd50b94700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c1561c0 0x7fcd4c0ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd50b94700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c15b640 con 0x7fcd4c1561c0 2023-08-31T02:01:51.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd50b94700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1e3350 con 0x7fcd4c1e2e00 2023-08-31T02:01:51.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd50b94700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1e3630 con 0x7fcd34003a00 2023-08-31T02:01:51.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd4ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c1561c0 0x7fcd4c0ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd4ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c1561c0 0x7fcd4c0ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54698/0 (socket says 172.21.15.84:54698) 2023-08-31T02:01:51.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.965+0000 7fcd4ad9d700 1 -- 172.21.15.84:0/2546019517 learned_addr learned my addr 172.21.15.84:0/2546019517 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:51.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd4a59c700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd34003a00 0x7fcd4c15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd49d9b700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd4c1e2e00 0x7fcd4c155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd4ad9d700 1 -- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd34003a00 msgr2=0x7fcd4c15b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd4ad9d700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd34003a00 0x7fcd4c15b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd4ad9d700 1 -- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd4c1e2e00 msgr2=0x7fcd4c155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:51.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd4ad9d700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd4c1e2e00 0x7fcd4c155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:51.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd4ad9d700 1 -- 172.21.15.84:0/2546019517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c1e3910 con 0x7fcd4c1561c0 2023-08-31T02:01:51.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd49d9b700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd4c1e2e00 0x7fcd4c155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:51.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd4ad9d700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c1561c0 0x7fcd4c0ad970 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0cef00 tx=0x7fcd440115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd3affd700 1 -- 172.21.15.84:0/2546019517 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4401c070 con 0x7fcd4c1561c0 2023-08-31T02:01:51.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd3affd700 1 -- 172.21.15.84:0/2546019517 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcd44011e40 con 0x7fcd4c1561c0 2023-08-31T02:01:51.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c15a900 con 0x7fcd4c1561c0 2023-08-31T02:01:51.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd3affd700 1 -- 172.21.15.84:0/2546019517 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44004e10 con 0x7fcd4c1561c0 2023-08-31T02:01:51.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.966+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c155f50 con 0x7fcd4c1561c0 2023-08-31T02:01:51.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.967+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c15ae20 con 0x7fcd4c1561c0 2023-08-31T02:01:51.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.967+0000 7fcd3affd700 1 -- 172.21.15.84:0/2546019517 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd44014460 con 0x7fcd4c1561c0 2023-08-31T02:01:51.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.968+0000 7fcd3affd700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcd2c06a0e0 0x7fcd2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:51.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.968+0000 7fcd3affd700 1 -- 172.21.15.84:0/2546019517 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcd4408a6e0 con 0x7fcd4c1561c0 2023-08-31T02:01:51.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.968+0000 7fcd4a59c700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcd2c06a0e0 0x7fcd2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:51.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.968+0000 7fcd4a59c700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcd2c06a0e0 0x7fcd2c06c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009c10 tx=0x7fcd3c004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:51.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:51.972+0000 7fcd3affd700 1 -- 172.21.15.84:0/2546019517 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcd4c15ae20 con 0x7fcd4c1561c0 2023-08-31T02:01:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.162+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd4c0b0d00 con 0x7fcd2c06a0e0 2023-08-31T02:01:52.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.162+0000 7fcd3affd700 1 -- 172.21.15.84:0/2546019517 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcd3c00edd0 con 0x7fcd2c06a0e0 2023-08-31T02:01:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcd2c06a0e0 msgr2=0x7fcd2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcd2c06a0e0 0x7fcd2c06c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009c10 tx=0x7fcd3c004750 comp rx=0 tx=0).stop 2023-08-31T02:01:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c1561c0 msgr2=0x7fcd4c0ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c1561c0 0x7fcd4c0ad970 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0cef00 tx=0x7fcd440115c0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 shutdown_connections 2023-08-31T02:01:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fcd2c06a0e0 0x7fcd2c06c5a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c1561c0 0x7fcd4c0ad970 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd34003a00 0x7fcd4c15b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 --2- 172.21.15.84:0/2546019517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd4c1e2e00 0x7fcd4c155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 >> 172.21.15.84:0/2546019517 conn(0x7fcd4c0cdeb0 msgr2=0x7fcd4c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:52.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 shutdown_connections 2023-08-31T02:01:52.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.164+0000 7fcd50b94700 1 -- 172.21.15.84:0/2546019517 wait complete. 2023-08-31T02:01:52.161 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 2 to deep-scrub 2023-08-31T02:01:52.168 INFO:tasks.ceph:Scrubbing osd.3 2023-08-31T02:01:52.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-31T02:01:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.303+0000 7f00cc125700 1 -- 172.21.15.84:0/3942093871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b0004850 msgr2=0x7f00b0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.303+0000 7f00cc125700 1 --2- 172.21.15.84:0/3942093871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b0004850 0x7f00b0004cd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f00c0001730 tx=0x7f00b0005880 comp rx=0 tx=0).stop 2023-08-31T02:01:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.303+0000 7f00cc125700 1 -- 172.21.15.84:0/3942093871 shutdown_connections 2023-08-31T02:01:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.303+0000 7f00cc125700 1 --2- 172.21.15.84:0/3942093871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b0004850 0x7f00b0004cd0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.303+0000 7f00cc125700 1 -- 172.21.15.84:0/3942093871 >> 172.21.15.84:0/3942093871 conn(0x7f00c40caa30 msgr2=0x7f00c40cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:52.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.303+0000 7f00cc125700 1 -- 172.21.15.84:0/3942093871 shutdown_connections 2023-08-31T02:01:52.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.303+0000 7f00cc125700 1 -- 172.21.15.84:0/3942093871 wait complete. 2023-08-31T02:01:52.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.304+0000 7f00cc125700 1 Processor -- start 2023-08-31T02:01:52.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.304+0000 7f00cc125700 1 -- start start 2023-08-31T02:01:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00cc125700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00b0004850 0x7f00c40ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00cc125700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4157250 0x7f00c40aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00cc125700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00c41576d0 0x7f00c4155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00cc125700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40cbef0 con 0x7f00c4157250 2023-08-31T02:01:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00cc125700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40c4510 con 0x7f00b0004850 2023-08-31T02:01:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00cc125700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40aced0 con 0x7f00c41576d0 2023-08-31T02:01:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4157250 0x7f00c40aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4157250 0x7f00c40aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54714/0 (socket says 172.21.15.84:54714) 2023-08-31T02:01:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 -- 172.21.15.84:0/924138663 learned_addr learned my addr 172.21.15.84:0/924138663 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c9ec1700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00b0004850 0x7f00c40ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00ca6c2700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00c41576d0 0x7f00c4155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 -- 172.21.15.84:0/924138663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00c41576d0 msgr2=0x7f00c4155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00c41576d0 0x7f00c4155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 -- 172.21.15.84:0/924138663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00b0004850 msgr2=0x7f00c40ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00b0004850 0x7f00c40ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 -- 172.21.15.84:0/924138663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40ad1b0 con 0x7f00c4157250 2023-08-31T02:01:52.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c9ec1700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00b0004850 0x7f00c40ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.305+0000 7f00c96c0700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4157250 0x7f00c40aad70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f00c0000c00 tx=0x7f00c0003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.306+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c0015070 con 0x7f00c4157250 2023-08-31T02:01:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.306+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f00c0003de0 con 0x7f00c4157250 2023-08-31T02:01:52.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.306+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c40ad490 con 0x7f00c4157250 2023-08-31T02:01:52.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.306+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c0010480 con 0x7f00c4157250 2023-08-31T02:01:52.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.306+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40ab2b0 con 0x7f00c4157250 2023-08-31T02:01:52.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.306+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00c40b3820 con 0x7f00c4157250 2023-08-31T02:01:52.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.307+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f00c00105e0 con 0x7f00c4157250 2023-08-31T02:01:52.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.307+0000 7f00ba7fc700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00a806a0e0 0x7f00a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.307+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f00c0089540 con 0x7f00c4157250 2023-08-31T02:01:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.307+0000 7f00c9ec1700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00a806a0e0 0x7f00a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.308+0000 7f00ba7fc700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f00a8070370 0x7f00a80727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.308+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 --> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00a8072ea0 con 0x7f00a8070370 2023-08-31T02:01:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.308+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00c008bc00 con 0x7f00c4157250 2023-08-31T02:01:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.308+0000 7f00ca6c2700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f00a8070370 0x7f00a80727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.308+0000 7f00c9ec1700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00a806a0e0 0x7f00a806c5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f00b4005fd0 tx=0x7f00b400b2e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.308+0000 7f00ca6c2700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f00a8070370 0x7f00a80727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.309+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 <== osd.3 v2:172.21.15.84:6824/266140406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f00a8072ea0 con 0x7f00a8070370 2023-08-31T02:01:52.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.323+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 --> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00c40ab440 con 0x7f00a8070370 2023-08-31T02:01:52.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.323+0000 7f00ba7fc700 1 -- 172.21.15.84:0/924138663 <== osd.3 v2:172.21.15.84:6824/266140406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f00c40ab440 con 0x7f00a8070370 2023-08-31T02:01:52.317 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:52.317 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T02:01:52.317 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:52.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f00a8070370 msgr2=0x7f00a80727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6824/266140406,v1:172.21.15.84:6825/266140406] conn(0x7f00a8070370 0x7f00a80727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00a806a0e0 msgr2=0x7f00a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f00a806a0e0 0x7f00a806c5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f00b4005fd0 tx=0x7f00b400b2e0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4157250 msgr2=0x7f00c40aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 --2- 172.21.15.84:0/924138663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4157250 0x7f00c40aad70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f00c0000c00 tx=0x7f00c0003930 comp rx=0 tx=0).stop 2023-08-31T02:01:52.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00ca6c2700 1 -- 172.21.15.84:0/924138663 reap_dead start 2023-08-31T02:01:52.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 shutdown_connections 2023-08-31T02:01:52.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 >> 172.21.15.84:0/924138663 conn(0x7f00c40caa30 msgr2=0x7f00c4158480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:52.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 shutdown_connections 2023-08-31T02:01:52.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.324+0000 7f00cc125700 1 -- 172.21.15.84:0/924138663 wait complete. 2023-08-31T02:01:52.328 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-31T02:01:52.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.459+0000 7f56f07a3700 1 -- 172.21.15.84:0/3187602597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 msgr2=0x7f56d4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.459+0000 7f56f07a3700 1 --2- 172.21.15.84:0/3187602597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 0x7f56d4005210 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009d10 tx=0x7f56d4005880 comp rx=0 tx=0).stop 2023-08-31T02:01:52.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.459+0000 7f56eed40700 1 -- 172.21.15.84:0/3187602597 reap_dead start 2023-08-31T02:01:52.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.459+0000 7f56f07a3700 1 -- 172.21.15.84:0/3187602597 shutdown_connections 2023-08-31T02:01:52.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.459+0000 7f56f07a3700 1 -- 172.21.15.84:0/3187602597 >> 172.21.15.84:0/3187602597 conn(0x7f56e8069b80 msgr2=0x7f56e8069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:52.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.459+0000 7f56f07a3700 1 -- 172.21.15.84:0/3187602597 shutdown_connections 2023-08-31T02:01:52.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.459+0000 7f56f07a3700 1 -- 172.21.15.84:0/3187602597 wait complete. 2023-08-31T02:01:52.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.460+0000 7f56f07a3700 1 Processor -- start 2023-08-31T02:01:52.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.460+0000 7f56f07a3700 1 -- start start 2023-08-31T02:01:52.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56f07a3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 0x7f56e8156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56f07a3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e806b340 0x7f56e8156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56f07a3700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e806cdc0 0x7f56e81f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56f07a3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80c2b40 con 0x7f56d4004d90 2023-08-31T02:01:52.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56f07a3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e81f1f50 con 0x7f56e806b340 2023-08-31T02:01:52.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56f07a3700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e81f2230 con 0x7f56e806cdc0 2023-08-31T02:01:52.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 0x7f56e8156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 0x7f56e8156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54736/0 (socket says 172.21.15.84:54736) 2023-08-31T02:01:52.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 -- 172.21.15.84:0/100228222 learned_addr learned my addr 172.21.15.84:0/100228222 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:52.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56eed40700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e806cdc0 0x7f56e81f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56edd3e700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e806b340 0x7f56e8156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 -- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e806cdc0 msgr2=0x7f56e81f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e806cdc0 0x7f56e81f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 -- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e806b340 msgr2=0x7f56e8156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e806b340 0x7f56e8156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 -- 172.21.15.84:0/100228222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e81f2510 con 0x7f56d4004d90 2023-08-31T02:01:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56eed40700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e806cdc0 0x7f56e81f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T02:01:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56ee53f700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 0x7f56e8156540 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f56e4006630 tx=0x7f56e4003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56daffd700 1 -- 172.21.15.84:0/100228222 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011840 con 0x7f56d4004d90 2023-08-31T02:01:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56daffd700 1 -- 172.21.15.84:0/100228222 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56e40119e0 con 0x7f56d4004d90 2023-08-31T02:01:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e81f27f0 con 0x7f56d4004d90 2023-08-31T02:01:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56daffd700 1 -- 172.21.15.84:0/100228222 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011df0 con 0x7f56d4004d90 2023-08-31T02:01:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.461+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e80c2970 con 0x7f56d4004d90 2023-08-31T02:01:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.462+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e81f2a10 con 0x7f56d4004d90 2023-08-31T02:01:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.463+0000 7f56daffd700 1 -- 172.21.15.84:0/100228222 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f56e40103c0 con 0x7f56d4004d90 2023-08-31T02:01:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.463+0000 7f56daffd700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f56cc06a0e0 0x7f56cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.463+0000 7f56daffd700 1 -- 172.21.15.84:0/100228222 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f56e4089310 con 0x7f56d4004d90 2023-08-31T02:01:52.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.463+0000 7f56edd3e700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f56cc06a0e0 0x7f56cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.463+0000 7f56edd3e700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f56cc06a0e0 0x7f56cc06c5a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f56e806cb70 tx=0x7f56dc00b590 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.467+0000 7f56daffd700 1 -- 172.21.15.84:0/100228222 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f56e4054cb0 con 0x7f56d4004d90 2023-08-31T02:01:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.656+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f56e804e7c0 con 0x7f56cc06a0e0 2023-08-31T02:01:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.657+0000 7f56daffd700 1 -- 172.21.15.84:0/100228222 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f56e804e7c0 con 0x7f56cc06a0e0 2023-08-31T02:01:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f56cc06a0e0 msgr2=0x7f56cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f56cc06a0e0 0x7f56cc06c5a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f56e806cb70 tx=0x7f56dc00b590 comp rx=0 tx=0).stop 2023-08-31T02:01:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 msgr2=0x7f56e8156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 0x7f56e8156540 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f56e4006630 tx=0x7f56e4003960 comp rx=0 tx=0).stop 2023-08-31T02:01:52.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 shutdown_connections 2023-08-31T02:01:52.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f56cc06a0e0 0x7f56cc06c5a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e806cdc0 0x7f56e81f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56d4004d90 0x7f56e8156540 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 --2- 172.21.15.84:0/100228222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e806b340 0x7f56e8156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 >> 172.21.15.84:0/100228222 conn(0x7f56e8069b80 msgr2=0x7f56e8157290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:52.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 shutdown_connections 2023-08-31T02:01:52.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.659+0000 7f56f07a3700 1 -- 172.21.15.84:0/100228222 wait complete. 2023-08-31T02:01:52.655 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 3 to deep-scrub 2023-08-31T02:01:52.663 INFO:tasks.ceph:Scrubbing osd.4 2023-08-31T02:01:52.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-31T02:01:52.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.798+0000 7f0ad71e2700 1 -- 172.21.15.84:0/571408993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ac0003a30 msgr2=0x7f0ac0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.798+0000 7f0ad71e2700 1 --2- 172.21.15.84:0/571408993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ac0003a30 0x7f0ac0003e10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009be0 tx=0x7f0ac0005880 comp rx=0 tx=0).stop 2023-08-31T02:01:52.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.798+0000 7f0ad577f700 1 -- 172.21.15.84:0/571408993 reap_dead start 2023-08-31T02:01:52.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.798+0000 7f0ad71e2700 1 -- 172.21.15.84:0/571408993 shutdown_connections 2023-08-31T02:01:52.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.798+0000 7f0ad71e2700 1 -- 172.21.15.84:0/571408993 >> 172.21.15.84:0/571408993 conn(0x7f0ad00cbb60 msgr2=0x7f0ad00cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:52.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.798+0000 7f0ad71e2700 1 -- 172.21.15.84:0/571408993 shutdown_connections 2023-08-31T02:01:52.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.798+0000 7f0ad71e2700 1 -- 172.21.15.84:0/571408993 wait complete. 2023-08-31T02:01:52.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.799+0000 7f0ad71e2700 1 Processor -- start 2023-08-31T02:01:52.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.799+0000 7f0ad71e2700 1 -- start start 2023-08-31T02:01:52.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad71e2700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ac0003a30 0x7f0ad00c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad71e2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad006c430 0x7f0ad01f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad71e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad006c890 0x7f0ad01f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad71e2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad00c6cb0 con 0x7f0ad006c890 2023-08-31T02:01:52.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad71e2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad00c83f0 con 0x7f0ad006c430 2023-08-31T02:01:52.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad71e2700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad00c6330 con 0x7f0ac0003a30 2023-08-31T02:01:52.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad577f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad006c890 0x7f0ad01f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad577f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad006c890 0x7f0ad01f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54760/0 (socket says 172.21.15.84:54760) 2023-08-31T02:01:52.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad577f700 1 -- 172.21.15.84:0/2134788850 learned_addr learned my addr 172.21.15.84:0/2134788850 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:52.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0acffff700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad006c430 0x7f0ad01f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.800+0000 7f0ad4f7e700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ac0003a30 0x7f0ad00c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0ad577f700 1 -- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ac0003a30 msgr2=0x7f0ad00c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0ad577f700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ac0003a30 0x7f0ad00c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0ad577f700 1 -- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad006c430 msgr2=0x7f0ad01f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0ad577f700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad006c430 0x7f0ad01f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0ad577f700 1 -- 172.21.15.84:0/2134788850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00c65f0 con 0x7f0ad006c890 2023-08-31T02:01:52.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0ad577f700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad006c890 0x7f0ad01f52c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00c2a40 tx=0x7f0ac800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800c8c0 con 0x7f0ad006c890 2023-08-31T02:01:52.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ac800cb30 con 0x7f0ad006c890 2023-08-31T02:01:52.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad00c68d0 con 0x7f0ad006c890 2023-08-31T02:01:52.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8011460 con 0x7f0ad006c890 2023-08-31T02:01:52.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.801+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad01e2820 con 0x7f0ad006c890 2023-08-31T02:01:52.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.802+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ad00ce730 con 0x7f0ad006c890 2023-08-31T02:01:52.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.802+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ac80115c0 con 0x7f0ad006c890 2023-08-31T02:01:52.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0acd7fa700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ab406a0e0 0x7f0ab406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0ac80887d0 con 0x7f0ad006c890 2023-08-31T02:01:52.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0ad4f7e700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ab406a0e0 0x7f0ab406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0acd7fa700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f0ab4070370 0x7f0ab40727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 --> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ab4072ea0 con 0x7f0ab4070370 2023-08-31T02:01:52.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ac808d2c0 con 0x7f0ad006c890 2023-08-31T02:01:52.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0ad4f7e700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ab406a0e0 0x7f0ab406c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009be0 tx=0x7f0ac4004750 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0acffff700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f0ab4070370 0x7f0ab40727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.803+0000 7f0acffff700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f0ab4070370 0x7f0ab40727d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.804+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 <== osd.4 v2:172.21.15.170:6808/1776632925 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0ab4072ea0 con 0x7f0ab4070370 2023-08-31T02:01:52.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.819+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 --> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0ad00c6df0 con 0x7f0ab4070370 2023-08-31T02:01:52.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.819+0000 7f0acd7fa700 1 -- 172.21.15.84:0/2134788850 <== osd.4 v2:172.21.15.170:6808/1776632925 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0ad00c6df0 con 0x7f0ab4070370 2023-08-31T02:01:52.813 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:52.813 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T02:01:52.813 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:52.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f0ab4070370 msgr2=0x7f0ab40727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.170:6808/1776632925,v1:172.21.15.170:6809/1776632925] conn(0x7f0ab4070370 0x7f0ab40727d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ab406a0e0 msgr2=0x7f0ab406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f0ab406a0e0 0x7f0ab406c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009be0 tx=0x7f0ac4004750 comp rx=0 tx=0).stop 2023-08-31T02:01:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad006c890 msgr2=0x7f0ad01f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 --2- 172.21.15.84:0/2134788850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad006c890 0x7f0ad01f52c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00c2a40 tx=0x7f0ac800ec10 comp rx=0 tx=0).stop 2023-08-31T02:01:52.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad577f700 1 -- 172.21.15.84:0/2134788850 reap_dead start 2023-08-31T02:01:52.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 shutdown_connections 2023-08-31T02:01:52.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 >> 172.21.15.84:0/2134788850 conn(0x7f0ad00cbb60 msgr2=0x7f0ad01584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:52.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 shutdown_connections 2023-08-31T02:01:52.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.820+0000 7f0ad71e2700 1 -- 172.21.15.84:0/2134788850 wait complete. 2023-08-31T02:01:52.824 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-31T02:01:52.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.957+0000 7f46f6d74700 1 -- 172.21.15.84:0/834328661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f00b0790 msgr2=0x7f46f00b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.957+0000 7f46f6d74700 1 --2- 172.21.15.84:0/834328661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f00b0790 0x7f46f00b0c40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009fd0 tx=0x7f46e800b380 comp rx=0 tx=0).stop 2023-08-31T02:01:52.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.957+0000 7f46f6d74700 1 -- 172.21.15.84:0/834328661 shutdown_connections 2023-08-31T02:01:52.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.957+0000 7f46f6d74700 1 --2- 172.21.15.84:0/834328661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f00b0790 0x7f46f00b0c40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.957+0000 7f46f6d74700 1 --2- 172.21.15.84:0/834328661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46f00b00c0 0x7f46f00af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.957+0000 7f46f6d74700 1 -- 172.21.15.84:0/834328661 >> 172.21.15.84:0/834328661 conn(0x7f46f0069b80 msgr2=0x7f46f0069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.957+0000 7f46f6d74700 1 -- 172.21.15.84:0/834328661 shutdown_connections 2023-08-31T02:01:52.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.957+0000 7f46f6d74700 1 -- 172.21.15.84:0/834328661 wait complete. 2023-08-31T02:01:52.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.958+0000 7f46f6d74700 1 Processor -- start 2023-08-31T02:01:52.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.958+0000 7f46f6d74700 1 -- start start 2023-08-31T02:01:52.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f6d74700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46f00b00c0 0x7f46f01577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f6d74700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46f00b0790 0x7f46f0157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f6d74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f01591f0 0x7f46f00c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f6d74700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f01efd60 con 0x7f46f01591f0 2023-08-31T02:01:52.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f6d74700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f01ef1a0 con 0x7f46f00b00c0 2023-08-31T02:01:52.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f6d74700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f01ef400 con 0x7f46f00b0790 2023-08-31T02:01:52.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f01591f0 0x7f46f00c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f01591f0 0x7f46f00c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54776/0 (socket says 172.21.15.84:54776) 2023-08-31T02:01:52.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 -- 172.21.15.84:0/2049396560 learned_addr learned my addr 172.21.15.84:0/2049396560 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:52.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 -- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46f00b0790 msgr2=0x7f46f0157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f4b10700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46f00b00c0 0x7f46f01577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46effff700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46f00b0790 0x7f46f0157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46f00b0790 0x7f46f0157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 -- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46f00b00c0 msgr2=0x7f46f01577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:52.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46f00b00c0 0x7f46f01577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:52.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 -- 172.21.15.84:0/2049396560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8009d00 con 0x7f46f01591f0 2023-08-31T02:01:52.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f4b10700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46f00b00c0 0x7f46f01577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:52.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46effff700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46f00b0790 0x7f46f0157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:52.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f5311700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f01591f0 0x7f46f00c61e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f46f00b1920 tx=0x7f46e8003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46ed7fa700 1 -- 172.21.15.84:0/2049396560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800e040 con 0x7f46f01591f0 2023-08-31T02:01:52.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46ed7fa700 1 -- 172.21.15.84:0/2049396560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f46e8007ac0 con 0x7f46f01591f0 2023-08-31T02:01:52.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f01f0180 con 0x7f46f01591f0 2023-08-31T02:01:52.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.959+0000 7f46ed7fa700 1 -- 172.21.15.84:0/2049396560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800be40 con 0x7f46f01591f0 2023-08-31T02:01:52.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.960+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f01ef6a0 con 0x7f46f01591f0 2023-08-31T02:01:52.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.960+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f01efea0 con 0x7f46f01591f0 2023-08-31T02:01:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.961+0000 7f46ed7fa700 1 -- 172.21.15.84:0/2049396560 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f46e8004030 con 0x7f46f01591f0 2023-08-31T02:01:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.961+0000 7f46ed7fa700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f46d406a0e0 0x7f46d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:52.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.961+0000 7f46ed7fa700 1 -- 172.21.15.84:0/2049396560 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f46e80894f0 con 0x7f46f01591f0 2023-08-31T02:01:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.961+0000 7f46f4b10700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f46d406a0e0 0x7f46d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.962+0000 7f46f4b10700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f46d406a0e0 0x7f46d406c5a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f46e4006fd0 tx=0x7f46e4008040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:52.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:52.966+0000 7f46ed7fa700 1 -- 172.21.15.84:0/2049396560 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f46f01efea0 con 0x7f46f01591f0 2023-08-31T02:01:53.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.153+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f46f01efea0 con 0x7f46d406a0e0 2023-08-31T02:01:53.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.154+0000 7f46ed7fa700 1 -- 172.21.15.84:0/2049396560 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46f01efea0 con 0x7f46d406a0e0 2023-08-31T02:01:53.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f46d406a0e0 msgr2=0x7f46d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f46d406a0e0 0x7f46d406c5a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f46e4006fd0 tx=0x7f46e4008040 comp rx=0 tx=0).stop 2023-08-31T02:01:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f01591f0 msgr2=0x7f46f00c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f01591f0 0x7f46f00c61e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f46f00b1920 tx=0x7f46e8003d30 comp rx=0 tx=0).stop 2023-08-31T02:01:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 shutdown_connections 2023-08-31T02:01:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f46d406a0e0 0x7f46d406c5a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46f01591f0 0x7f46f00c61e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46f00b00c0 0x7f46f01577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 --2- 172.21.15.84:0/2049396560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46f00b0790 0x7f46f0157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 >> 172.21.15.84:0/2049396560 conn(0x7f46f0069b80 msgr2=0x7f46f00caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 shutdown_connections 2023-08-31T02:01:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.156+0000 7f46f6d74700 1 -- 172.21.15.84:0/2049396560 wait complete. 2023-08-31T02:01:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 4 to deep-scrub 2023-08-31T02:01:53.160 INFO:tasks.ceph:Scrubbing osd.5 2023-08-31T02:01:53.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-31T02:01:53.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 -- 172.21.15.84:0/1126406617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4140ca0e0 msgr2=0x7fe4140c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 --2- 172.21.15.84:0/1126406617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4140ca0e0 0x7fe4140c8600 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe4140ca910 tx=0x7fe40c00b380 comp rx=0 tx=0).stop 2023-08-31T02:01:53.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 -- 172.21.15.84:0/1126406617 shutdown_connections 2023-08-31T02:01:53.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 --2- 172.21.15.84:0/1126406617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4140ca0e0 0x7fe4140c8600 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 --2- 172.21.15.84:0/1126406617 >> v2:172.21.15.170:3300/0 conn(0x7fe4140c9d00 0x7fe4140b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 --2- 172.21.15.84:0/1126406617 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe41415c8c0 0x7fe4141590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 -- 172.21.15.84:0/1126406617 >> 172.21.15.84:0/1126406617 conn(0x7fe4140caa30 msgr2=0x7fe4140cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:53.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 -- 172.21.15.84:0/1126406617 shutdown_connections 2023-08-31T02:01:53.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.294+0000 7fe418b70700 1 -- 172.21.15.84:0/1126406617 wait complete. 2023-08-31T02:01:53.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.295+0000 7fe418b70700 1 Processor -- start 2023-08-31T02:01:53.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.295+0000 7fe418b70700 1 -- start start 2023-08-31T02:01:53.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe418b70700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4140c9d00 0x7fe41406e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe418b70700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4140ca0e0 0x7fe414145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe418b70700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe41415c8c0 0x7fe4140aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe418b70700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4141f2750 con 0x7fe41415c8c0 2023-08-31T02:01:53.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe418b70700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41406d480 con 0x7fe4140c9d00 2023-08-31T02:01:53.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe418b70700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4141f2470 con 0x7fe4140ca0e0 2023-08-31T02:01:53.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe412d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe41415c8c0 0x7fe4140aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe412d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe41415c8c0 0x7fe4140aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54790/0 (socket says 172.21.15.84:54790) 2023-08-31T02:01:53.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe412d9d700 1 -- 172.21.15.84:0/178533293 learned_addr learned my addr 172.21.15.84:0/178533293 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:53.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe411d9b700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4140ca0e0 0x7fe414145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe41259c700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4140c9d00 0x7fe41406e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe412d9d700 1 -- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4140ca0e0 msgr2=0x7fe414145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe412d9d700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4140ca0e0 0x7fe414145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe412d9d700 1 -- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4140c9d00 msgr2=0x7fe41406e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe412d9d700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4140c9d00 0x7fe41406e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.296+0000 7fe412d9d700 1 -- 172.21.15.84:0/178533293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c009d00 con 0x7fe41415c8c0 2023-08-31T02:01:53.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.297+0000 7fe412d9d700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe41415c8c0 0x7fe4140aee70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe414066e00 tx=0x7fe40c007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.297+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00e040 con 0x7fe41415c8c0 2023-08-31T02:01:53.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.297+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe40c01a6c0 con 0x7fe41415c8c0 2023-08-31T02:01:53.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.297+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41406d700 con 0x7fe41415c8c0 2023-08-31T02:01:53.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.297+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c01ab10 con 0x7fe41415c8c0 2023-08-31T02:01:53.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.297+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41406dcc0 con 0x7fe41415c8c0 2023-08-31T02:01:53.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.297+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4140ca550 con 0x7fe41415c8c0 2023-08-31T02:01:53.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.298+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe40c01ac70 con 0x7fe41415c8c0 2023-08-31T02:01:53.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.298+0000 7fe402ffd700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3f406a0e0 0x7fe3f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.298+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe40c08b810 con 0x7fe41415c8c0 2023-08-31T02:01:53.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.298+0000 7fe41259c700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3f406a0e0 0x7fe3f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.299+0000 7fe402ffd700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7fe3f4070370 0x7fe3f40727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.299+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 --> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3f4072ea0 con 0x7fe3f4070370 2023-08-31T02:01:53.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.299+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe40c0902c0 con 0x7fe41415c8c0 2023-08-31T02:01:53.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.299+0000 7fe411d9b700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7fe3f4070370 0x7fe3f40727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.299+0000 7fe41259c700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3f406a0e0 0x7fe3f406c5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe408005e10 tx=0x7fe40800b390 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.299+0000 7fe411d9b700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7fe3f4070370 0x7fe3f40727d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.300+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 <== osd.5 v2:172.21.15.170:6800/4177484541 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe3f4072ea0 con 0x7fe3f4070370 2023-08-31T02:01:53.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.314+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 --> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe414073a40 con 0x7fe3f4070370 2023-08-31T02:01:53.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe402ffd700 1 -- 172.21.15.84:0/178533293 <== osd.5 v2:172.21.15.170:6800/4177484541 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe414073a40 con 0x7fe3f4070370 2023-08-31T02:01:53.308 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:53.308 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T02:01:53.309 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:53.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7fe3f4070370 msgr2=0x7fe3f40727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.170:6800/4177484541,v1:172.21.15.170:6801/4177484541] conn(0x7fe3f4070370 0x7fe3f40727d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3f406a0e0 msgr2=0x7fe3f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fe3f406a0e0 0x7fe3f406c5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe408005e10 tx=0x7fe40800b390 comp rx=0 tx=0).stop 2023-08-31T02:01:53.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe41415c8c0 msgr2=0x7fe4140aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 --2- 172.21.15.84:0/178533293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe41415c8c0 0x7fe4140aee70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe414066e00 tx=0x7fe40c007b60 comp rx=0 tx=0).stop 2023-08-31T02:01:53.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe412d9d700 1 -- 172.21.15.84:0/178533293 reap_dead start 2023-08-31T02:01:53.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 shutdown_connections 2023-08-31T02:01:53.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 >> 172.21.15.84:0/178533293 conn(0x7fe4140caa30 msgr2=0x7fe4140b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:53.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 shutdown_connections 2023-08-31T02:01:53.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.315+0000 7fe418b70700 1 -- 172.21.15.84:0/178533293 wait complete. 2023-08-31T02:01:53.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-31T02:01:53.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.452+0000 7f99ccd0a700 1 -- 172.21.15.84:0/2254787430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 msgr2=0x7f99c80708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.452+0000 7f99ccd0a700 1 --2- 172.21.15.84:0/2254787430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 0x7f99c80708a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0098c0 tx=0x7f99bc009bd0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.452+0000 7f99ccd0a700 1 -- 172.21.15.84:0/2254787430 shutdown_connections 2023-08-31T02:01:53.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.452+0000 7f99ccd0a700 1 --2- 172.21.15.84:0/2254787430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 0x7f99c80708a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.452+0000 7f99ccd0a700 1 -- 172.21.15.84:0/2254787430 >> 172.21.15.84:0/2254787430 conn(0x7f99c80cde90 msgr2=0x7f99c80ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:53.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.452+0000 7f99ccd0a700 1 -- 172.21.15.84:0/2254787430 shutdown_connections 2023-08-31T02:01:53.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.452+0000 7f99ccd0a700 1 -- 172.21.15.84:0/2254787430 wait complete. 2023-08-31T02:01:53.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99ccd0a700 1 Processor -- start 2023-08-31T02:01:53.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99ccd0a700 1 -- start start 2023-08-31T02:01:53.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99ccd0a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c80b0d00 0x7f99c814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99ccd0a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 0x7f99c8154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99ccd0a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c8158210 0x7f99c806a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99ccd0a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8158680 con 0x7f99c80c9990 2023-08-31T02:01:53.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99ccd0a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8158960 con 0x7f99c80b0d00 2023-08-31T02:01:53.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99ccd0a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8158c40 con 0x7f99c8158210 2023-08-31T02:01:53.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99c5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 0x7f99c8154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99c5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 0x7f99c8154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54804/0 (socket says 172.21.15.84:54804) 2023-08-31T02:01:53.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.454+0000 7f99c5d9b700 1 -- 172.21.15.84:0/32749742 learned_addr learned my addr 172.21.15.84:0/32749742 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:53.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99c6d9d700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c8158210 0x7f99c806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99c659c700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c80b0d00 0x7f99c814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99c5d9b700 1 -- 172.21.15.84:0/32749742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c8158210 msgr2=0x7f99c806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99c5d9b700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c8158210 0x7f99c806a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99c5d9b700 1 -- 172.21.15.84:0/32749742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c80b0d00 msgr2=0x7f99c814e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99c5d9b700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c80b0d00 0x7f99c814e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99c5d9b700 1 -- 172.21.15.84:0/32749742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc009520 con 0x7f99c80c9990 2023-08-31T02:01:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99c5d9b700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 0x7f99c8154f20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f99bc000c00 tx=0x7f99bc00f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99b6ffd700 1 -- 172.21.15.84:0/32749742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc025070 con 0x7f99c80c9990 2023-08-31T02:01:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99b6ffd700 1 -- 172.21.15.84:0/32749742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f99bc00fc70 con 0x7f99c80c9990 2023-08-31T02:01:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c8158f20 con 0x7f99c80c9990 2023-08-31T02:01:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99b6ffd700 1 -- 172.21.15.84:0/32749742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc01b040 con 0x7f99c80c9990 2023-08-31T02:01:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.455+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c8159720 con 0x7f99c80c9990 2023-08-31T02:01:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.456+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c8159440 con 0x7f99c80c9990 2023-08-31T02:01:53.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.456+0000 7f99b6ffd700 1 -- 172.21.15.84:0/32749742 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f99bc004a90 con 0x7f99c80c9990 2023-08-31T02:01:53.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.457+0000 7f99b6ffd700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f99a806a0e0 0x7f99a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.457+0000 7f99b6ffd700 1 -- 172.21.15.84:0/32749742 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f99bc089f20 con 0x7f99c80c9990 2023-08-31T02:01:53.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.457+0000 7f99c659c700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f99a806a0e0 0x7f99a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.457+0000 7f99c659c700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f99a806a0e0 0x7f99a806c5a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99b8001620 tx=0x7f99b8009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.461+0000 7f99b6ffd700 1 -- 172.21.15.84:0/32749742 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f99c8159440 con 0x7f99c80c9990 2023-08-31T02:01:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.653+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f99c80cd8b0 con 0x7f99a806a0e0 2023-08-31T02:01:53.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.653+0000 7f99b6ffd700 1 -- 172.21.15.84:0/32749742 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f99c80cd8b0 con 0x7f99a806a0e0 2023-08-31T02:01:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f99a806a0e0 msgr2=0x7f99a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f99a806a0e0 0x7f99a806c5a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99b8001620 tx=0x7f99b8009040 comp rx=0 tx=0).stop 2023-08-31T02:01:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 msgr2=0x7f99c8154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 0x7f99c8154f20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f99bc000c00 tx=0x7f99bc00f7c0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 shutdown_connections 2023-08-31T02:01:53.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f99a806a0e0 0x7f99a806c5a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c8158210 0x7f99c806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c80b0d00 0x7f99c814e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 --2- 172.21.15.84:0/32749742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99c80c9990 0x7f99c8154f20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 >> 172.21.15.84:0/32749742 conn(0x7f99c80cde90 msgr2=0x7f99c806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:53.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 shutdown_connections 2023-08-31T02:01:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.655+0000 7f99ccd0a700 1 -- 172.21.15.84:0/32749742 wait complete. 2023-08-31T02:01:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 5 to deep-scrub 2023-08-31T02:01:53.659 INFO:tasks.ceph:Scrubbing osd.6 2023-08-31T02:01:53.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-31T02:01:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.793+0000 7ffaeceec700 1 -- 172.21.15.84:0/1579761288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80cdcc0 msgr2=0x7ffae8162cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.793+0000 7ffaeceec700 1 --2- 172.21.15.84:0/1579761288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80cdcc0 0x7ffae8162cb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ffae80aea60 tx=0x7ffae000b330 comp rx=0 tx=0).stop 2023-08-31T02:01:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.793+0000 7ffaeceec700 1 -- 172.21.15.84:0/1579761288 shutdown_connections 2023-08-31T02:01:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.793+0000 7ffaeceec700 1 --2- 172.21.15.84:0/1579761288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80cdcc0 0x7ffae8162cb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.793+0000 7ffaeceec700 1 --2- 172.21.15.84:0/1579761288 >> v2:172.21.15.170:3300/0 conn(0x7ffae80b0590 0x7ffae80ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.793+0000 7ffaeceec700 1 -- 172.21.15.84:0/1579761288 >> 172.21.15.84:0/1579761288 conn(0x7ffae80cbb60 msgr2=0x7ffae80cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:53.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.793+0000 7ffaeceec700 1 -- 172.21.15.84:0/1579761288 shutdown_connections 2023-08-31T02:01:53.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.793+0000 7ffaeceec700 1 -- 172.21.15.84:0/1579761288 wait complete. 2023-08-31T02:01:53.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffaeceec700 1 Processor -- start 2023-08-31T02:01:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffaeceec700 1 -- start start 2023-08-31T02:01:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffaeceec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80b0590 0x7ffae80c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffaeceec700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80cdcc0 0x7ffae81573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffaeceec700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cec70 0x7ffae81f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffaeceec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae814ea30 con 0x7ffae80b0590 2023-08-31T02:01:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffaeceec700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8150030 con 0x7ffae80cec70 2023-08-31T02:01:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffaeceec700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81f3be0 con 0x7ffae80cdcc0 2023-08-31T02:01:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffae659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80b0590 0x7ffae80c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffae659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80b0590 0x7ffae80c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54816/0 (socket says 172.21.15.84:54816) 2023-08-31T02:01:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.795+0000 7ffae659c700 1 -- 172.21.15.84:0/3564016175 learned_addr learned my addr 172.21.15.84:0/3564016175 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffae6d9d700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cec70 0x7ffae81f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffae5d9b700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80cdcc0 0x7ffae81573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffae659c700 1 -- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80cdcc0 msgr2=0x7ffae81573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffae659c700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80cdcc0 0x7ffae81573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffae659c700 1 -- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cec70 msgr2=0x7ffae81f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffae659c700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cec70 0x7ffae81f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffae659c700 1 -- 172.21.15.84:0/3564016175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0009c40 con 0x7ffae80b0590 2023-08-31T02:01:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffae659c700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80b0590 0x7ffae80c2a70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00d980 tx=0x7ffadc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc009b40 con 0x7ffae80b0590 2023-08-31T02:01:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffadc009d90 con 0x7ffae80b0590 2023-08-31T02:01:53.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae81f3340 con 0x7ffae80b0590 2023-08-31T02:01:53.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0106c0 con 0x7ffae80b0590 2023-08-31T02:01:53.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.796+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81f3900 con 0x7ffae80b0590 2023-08-31T02:01:53.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.797+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffae8073a40 con 0x7ffae80b0590 2023-08-31T02:01:53.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.797+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffadc010820 con 0x7ffae80b0590 2023-08-31T02:01:53.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.798+0000 7ffad6ffd700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffac806a0e0 0x7ffac806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.798+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ffadc088710 con 0x7ffae80b0590 2023-08-31T02:01:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.798+0000 7ffae5d9b700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffac806a0e0 0x7ffac806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.798+0000 7ffad6ffd700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7ffac8070370 0x7ffac80727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.798+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 --> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffac8072ea0 con 0x7ffac8070370 2023-08-31T02:01:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.798+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffadc08acf0 con 0x7ffae80b0590 2023-08-31T02:01:53.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.798+0000 7ffae5d9b700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffac806a0e0 0x7ffac806c5a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffae80c2fb0 tx=0x7ffad8009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.798+0000 7ffae6d9d700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7ffac8070370 0x7ffac80727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.799+0000 7ffae6d9d700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7ffac8070370 0x7ffac80727d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.799+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 <== osd.6 v2:172.21.15.170:6824/1742000930 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ffac8072ea0 con 0x7ffac8070370 2023-08-31T02:01:53.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.814+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 --> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffae80662e0 con 0x7ffac8070370 2023-08-31T02:01:53.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.814+0000 7ffad6ffd700 1 -- 172.21.15.84:0/3564016175 <== osd.6 v2:172.21.15.170:6824/1742000930 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffae80662e0 con 0x7ffac8070370 2023-08-31T02:01:53.807 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T02:01:53.808 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:53.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7ffac8070370 msgr2=0x7ffac80727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.170:6824/1742000930,v1:172.21.15.170:6825/1742000930] conn(0x7ffac8070370 0x7ffac80727d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffac806a0e0 msgr2=0x7ffac806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7ffac806a0e0 0x7ffac806c5a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffae80c2fb0 tx=0x7ffad8009040 comp rx=0 tx=0).stop 2023-08-31T02:01:53.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80b0590 msgr2=0x7ffae80c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 --2- 172.21.15.84:0/3564016175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffae80b0590 0x7ffae80c2a70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00d980 tx=0x7ffadc00dd40 comp rx=0 tx=0).stop 2023-08-31T02:01:53.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffae6d9d700 1 -- 172.21.15.84:0/3564016175 reap_dead start 2023-08-31T02:01:53.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 shutdown_connections 2023-08-31T02:01:53.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 >> 172.21.15.84:0/3564016175 conn(0x7ffae80cbb60 msgr2=0x7ffae80afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:53.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 shutdown_connections 2023-08-31T02:01:53.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.815+0000 7ffaeceec700 1 -- 172.21.15.84:0/3564016175 wait complete. 2023-08-31T02:01:53.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-31T02:01:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.950+0000 7f6b1c078700 1 -- 172.21.15.84:0/3042139616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 msgr2=0x7f6b00004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.950+0000 7f6b1c078700 1 --2- 172.21.15.84:0/3042139616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 0x7f6b00004cd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c2e0 tx=0x7f6b00005880 comp rx=0 tx=0).stop 2023-08-31T02:01:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.950+0000 7f6b1a615700 1 -- 172.21.15.84:0/3042139616 reap_dead start 2023-08-31T02:01:53.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.950+0000 7f6b1c078700 1 -- 172.21.15.84:0/3042139616 shutdown_connections 2023-08-31T02:01:53.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.950+0000 7f6b1c078700 1 -- 172.21.15.84:0/3042139616 >> 172.21.15.84:0/3042139616 conn(0x7f6b140cdeb0 msgr2=0x7f6b140ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:53.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.950+0000 7f6b1c078700 1 -- 172.21.15.84:0/3042139616 shutdown_connections 2023-08-31T02:01:53.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.950+0000 7f6b1c078700 1 -- 172.21.15.84:0/3042139616 wait complete. 2023-08-31T02:01:53.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.951+0000 7f6b1c078700 1 Processor -- start 2023-08-31T02:01:53.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.951+0000 7f6b1c078700 1 -- start start 2023-08-31T02:01:53.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b1c078700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 0x7f6b1414d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b1c078700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b1414ebf0 0x7f6b1414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b1c078700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b141e4630 0x7f6b141e4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b1c078700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141e4ff0 con 0x7f6b00004850 2023-08-31T02:01:53.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b1c078700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1414d980 con 0x7f6b141e4630 2023-08-31T02:01:53.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b1c078700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1414e8b0 con 0x7f6b1414ebf0 2023-08-31T02:01:53.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 0x7f6b1414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 0x7f6b1414d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54836/0 (socket says 172.21.15.84:54836) 2023-08-31T02:01:53.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 -- 172.21.15.84:0/282351470 learned_addr learned my addr 172.21.15.84:0/282351470 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:53.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b1a615700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b141e4630 0x7f6b141e4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19613700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b1414ebf0 0x7f6b1414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 -- 172.21.15.84:0/282351470 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b1414ebf0 msgr2=0x7f6b1414e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b1414ebf0 0x7f6b1414e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 -- 172.21.15.84:0/282351470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b141e4630 msgr2=0x7f6b141e4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:53.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b141e4630 0x7f6b141e4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:53.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 -- 172.21.15.84:0/282351470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1414f160 con 0x7f6b00004850 2023-08-31T02:01:53.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b19e14700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 0x7f6b1414d440 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6b04011ae0 tx=0x7f6b04011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b0a7fc700 1 -- 172.21.15.84:0/282351470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400fd80 con 0x7f6b00004850 2023-08-31T02:01:53.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b0a7fc700 1 -- 172.21.15.84:0/282351470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b04019430 con 0x7f6b00004850 2023-08-31T02:01:53.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b0a7fc700 1 -- 172.21.15.84:0/282351470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400fee0 con 0x7f6b00004850 2023-08-31T02:01:53.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.952+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1414f440 con 0x7f6b00004850 2023-08-31T02:01:53.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.953+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b14152e10 con 0x7f6b00004850 2023-08-31T02:01:53.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.953+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1404e7c0 con 0x7f6b00004850 2023-08-31T02:01:53.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.954+0000 7f6b0a7fc700 1 -- 172.21.15.84:0/282351470 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6b04019820 con 0x7f6b00004850 2023-08-31T02:01:53.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.954+0000 7f6b0a7fc700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6af806a0e0 0x7f6af806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:53.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.954+0000 7f6b0a7fc700 1 -- 172.21.15.84:0/282351470 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6b04088f70 con 0x7f6b00004850 2023-08-31T02:01:53.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.954+0000 7f6b19613700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6af806a0e0 0x7f6af806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:53.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.955+0000 7f6b19613700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6af806a0e0 0x7f6af806c5a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6b140ad7c0 tx=0x7f6b10001a00 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:53.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:53.959+0000 7f6b0a7fc700 1 -- 172.21.15.84:0/282351470 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6b040bb990 con 0x7f6b00004850 2023-08-31T02:01:54.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.149+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b140ae3f0 con 0x7f6af806a0e0 2023-08-31T02:01:54.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.149+0000 7f6b0a7fc700 1 -- 172.21.15.84:0/282351470 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b140ae3f0 con 0x7f6af806a0e0 2023-08-31T02:01:54.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6af806a0e0 msgr2=0x7f6af806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6af806a0e0 0x7f6af806c5a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6b140ad7c0 tx=0x7f6b10001a00 comp rx=0 tx=0).stop 2023-08-31T02:01:54.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 msgr2=0x7f6b1414d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 0x7f6b1414d440 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6b04011ae0 tx=0x7f6b04011ea0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 shutdown_connections 2023-08-31T02:01:54.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f6af806a0e0 0x7f6af806c5a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b141e4630 0x7f6b141e4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b00004850 0x7f6b1414d440 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 --2- 172.21.15.84:0/282351470 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b1414ebf0 0x7f6b1414e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.151+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 >> 172.21.15.84:0/282351470 conn(0x7f6b140cdeb0 msgr2=0x7f6b140cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:54.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.152+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 shutdown_connections 2023-08-31T02:01:54.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.152+0000 7f6b1c078700 1 -- 172.21.15.84:0/282351470 wait complete. 2023-08-31T02:01:54.148 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 6 to deep-scrub 2023-08-31T02:01:54.156 INFO:tasks.ceph:Scrubbing osd.7 2023-08-31T02:01:54.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-31T02:01:54.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.291+0000 7fc181e96700 1 -- 172.21.15.84:0/1796222317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc164004d90 msgr2=0x7fc164005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.291+0000 7fc181e96700 1 --2- 172.21.15.84:0/1796222317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc164004d90 0x7fc164005210 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c640 tx=0x7fc164005880 comp rx=0 tx=0).stop 2023-08-31T02:01:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.291+0000 7fc17bfff700 1 -- 172.21.15.84:0/1796222317 reap_dead start 2023-08-31T02:01:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.291+0000 7fc181e96700 1 -- 172.21.15.84:0/1796222317 shutdown_connections 2023-08-31T02:01:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.291+0000 7fc181e96700 1 -- 172.21.15.84:0/1796222317 >> 172.21.15.84:0/1796222317 conn(0x7fc17c0cbb60 msgr2=0x7fc17c0cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.291+0000 7fc181e96700 1 -- 172.21.15.84:0/1796222317 shutdown_connections 2023-08-31T02:01:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.291+0000 7fc181e96700 1 -- 172.21.15.84:0/1796222317 wait complete. 2023-08-31T02:01:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.292+0000 7fc181e96700 1 Processor -- start 2023-08-31T02:01:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.292+0000 7fc181e96700 1 -- start start 2023-08-31T02:01:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc181e96700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc17c1551e0 0x7fc17c1f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc181e96700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17c06bd10 0x7fc17c1f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc181e96700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c140490 0x7fc17c140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc181e96700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c144850 con 0x7fc17c140490 2023-08-31T02:01:54.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc181e96700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1e41d0 con 0x7fc17c1551e0 2023-08-31T02:01:54.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc181e96700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c06c1d0 con 0x7fc17c06bd10 2023-08-31T02:01:54.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c140490 0x7fc17c140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c140490 0x7fc17c140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54860/0 (socket says 172.21.15.84:54860) 2023-08-31T02:01:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 -- 172.21.15.84:0/598081304 learned_addr learned my addr 172.21.15.84:0/598081304 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17b7fe700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc17c1551e0 0x7fc17c1f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17affd700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17c06bd10 0x7fc17c1f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 -- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17c06bd10 msgr2=0x7fc17c1f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17c06bd10 0x7fc17c1f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 -- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc17c1551e0 msgr2=0x7fc17c1f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc17c1551e0 0x7fc17c1f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 -- 172.21.15.84:0/598081304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c06c4b0 con 0x7fc17c140490 2023-08-31T02:01:54.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.293+0000 7fc17bfff700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c140490 0x7fc17c140940 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc174011000 tx=0x7fc174003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:54.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.294+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174003cf0 con 0x7fc17c140490 2023-08-31T02:01:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.294+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc174020070 con 0x7fc17c140490 2023-08-31T02:01:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.294+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c06c790 con 0x7fc17c140490 2023-08-31T02:01:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.294+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174006330 con 0x7fc17c140490 2023-08-31T02:01:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.294+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c06cd50 con 0x7fc17c140490 2023-08-31T02:01:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.294+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc17c0cee40 con 0x7fc17c140490 2023-08-31T02:01:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.295+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc174006490 con 0x7fc17c140490 2023-08-31T02:01:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.295+0000 7fc163fff700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc16806a0e0 0x7fc16806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.295+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc17408a1a0 con 0x7fc17c140490 2023-08-31T02:01:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.295+0000 7fc17b7fe700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc16806a0e0 0x7fc16806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.296+0000 7fc163fff700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc168070370 0x7fc1680727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.296+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 --> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc168072ea0 con 0x7fc168070370 2023-08-31T02:01:54.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.296+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc17408a5f0 con 0x7fc17c140490 2023-08-31T02:01:54.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.296+0000 7fc17b7fe700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc16806a0e0 0x7fc16806c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc170004750 tx=0x7fc170006e30 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:54.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.296+0000 7fc17affd700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc168070370 0x7fc1680727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.296+0000 7fc17affd700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc168070370 0x7fc1680727d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:54.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.297+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 <== osd.7 v2:172.21.15.170:6816/2208670688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc168072ea0 con 0x7fc168070370 2023-08-31T02:01:54.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.311+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 --> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc17c0b1400 con 0x7fc168070370 2023-08-31T02:01:54.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc163fff700 1 -- 172.21.15.84:0/598081304 <== osd.7 v2:172.21.15.170:6816/2208670688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc16c009d50 con 0x7fc168070370 2023-08-31T02:01:54.305 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-08-31T02:01:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T02:01:54.305 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-08-31T02:01:54.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc168070370 msgr2=0x7fc1680727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.170:6816/2208670688,v1:172.21.15.170:6817/2208670688] conn(0x7fc168070370 0x7fc1680727d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc16806a0e0 msgr2=0x7fc16806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7fc16806a0e0 0x7fc16806c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc170004750 tx=0x7fc170006e30 comp rx=0 tx=0).stop 2023-08-31T02:01:54.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c140490 msgr2=0x7fc17c140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 --2- 172.21.15.84:0/598081304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c140490 0x7fc17c140940 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc174011000 tx=0x7fc174003a00 comp rx=0 tx=0).stop 2023-08-31T02:01:54.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc17bfff700 1 -- 172.21.15.84:0/598081304 reap_dead start 2023-08-31T02:01:54.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 shutdown_connections 2023-08-31T02:01:54.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 >> 172.21.15.84:0/598081304 conn(0x7fc17c0cbb60 msgr2=0x7fc17c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:54.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.312+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 shutdown_connections 2023-08-31T02:01:54.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.313+0000 7fc181e96700 1 -- 172.21.15.84:0/598081304 wait complete. 2023-08-31T02:01:54.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-31T02:01:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.446+0000 7f611567a700 1 -- 172.21.15.84:0/3194194853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 msgr2=0x7f61100708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.446+0000 7f611567a700 1 --2- 172.21.15.84:0/3194194853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 0x7f61100708a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6100005fd0 tx=0x7f6100009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:54.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.447+0000 7f611567a700 1 -- 172.21.15.84:0/3194194853 shutdown_connections 2023-08-31T02:01:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.447+0000 7f611567a700 1 --2- 172.21.15.84:0/3194194853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61100b0d00 0x7f6110070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.447+0000 7f611567a700 1 --2- 172.21.15.84:0/3194194853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 0x7f61100708a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.447+0000 7f611567a700 1 -- 172.21.15.84:0/3194194853 >> 172.21.15.84:0/3194194853 conn(0x7f61100cde90 msgr2=0x7f61100ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.447+0000 7f611567a700 1 -- 172.21.15.84:0/3194194853 shutdown_connections 2023-08-31T02:01:54.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.447+0000 7f611567a700 1 -- 172.21.15.84:0/3194194853 wait complete. 2023-08-31T02:01:54.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.448+0000 7f611567a700 1 Processor -- start 2023-08-31T02:01:54.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.448+0000 7f611567a700 1 -- start start 2023-08-31T02:01:54.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f611567a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61100b0d00 0x7f61101e4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f611567a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 0x7f61100c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f611567a700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6110158210 0x7f61100c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f611567a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61101e53a0 con 0x7f61100c9990 2023-08-31T02:01:54.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f611567a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110159850 con 0x7f61100b0d00 2023-08-31T02:01:54.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f611567a700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6110159b30 con 0x7f6110158210 2023-08-31T02:01:54.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 0x7f61100c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 0x7f61100c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54874/0 (socket says 172.21.15.84:54874) 2023-08-31T02:01:54.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 -- 172.21.15.84:0/420419564 learned_addr learned my addr 172.21.15.84:0/420419564 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:54.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610f7fe700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6110158210 0x7f61100c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610effd700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61100b0d00 0x7f61101e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 -- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6110158210 msgr2=0x7f61100c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6110158210 0x7f61100c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 -- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61100b0d00 msgr2=0x7f61101e4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61100b0d00 0x7f61101e4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 -- 172.21.15.84:0/420419564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000095f0 con 0x7f61100c9990 2023-08-31T02:01:54.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610effd700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61100b0d00 0x7f61101e4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:54.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610f7fe700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6110158210 0x7f61100c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:01:54.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f610e7fc700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 0x7f61100c3e20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6100004000 tx=0x7f610000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:54.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f60f77fe700 1 -- 172.21.15.84:0/420419564 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610001d070 con 0x7f61100c9990 2023-08-31T02:01:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f60f77fe700 1 -- 172.21.15.84:0/420419564 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6100003990 con 0x7f61100c9990 2023-08-31T02:01:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f60f77fe700 1 -- 172.21.15.84:0/420419564 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100003d60 con 0x7f61100c9990 2023-08-31T02:01:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6110159e10 con 0x7f61100c9990 2023-08-31T02:01:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.449+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61101f1d80 con 0x7f61100c9990 2023-08-31T02:01:54.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.450+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611015a330 con 0x7f61100c9990 2023-08-31T02:01:54.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.451+0000 7f60f77fe700 1 -- 172.21.15.84:0/420419564 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f610000f460 con 0x7f61100c9990 2023-08-31T02:01:54.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.452+0000 7f60f77fe700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f60fc06a0e0 0x7f60fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.452+0000 7f610effd700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f60fc06a0e0 0x7f60fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.452+0000 7f60f77fe700 1 -- 172.21.15.84:0/420419564 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6100089ca0 con 0x7f61100c9990 2023-08-31T02:01:54.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.452+0000 7f610effd700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f60fc06a0e0 0x7f60fc06c5a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6110159530 tx=0x7f6104009040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:54.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.458+0000 7f60f77fe700 1 -- 172.21.15.84:0/420419564 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f611015a330 con 0x7f61100c9990 2023-08-31T02:01:54.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.647+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f61100cd8b0 con 0x7f60fc06a0e0 2023-08-31T02:01:54.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.647+0000 7f60f77fe700 1 -- 172.21.15.84:0/420419564 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f61100cd8b0 con 0x7f60fc06a0e0 2023-08-31T02:01:54.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f60fc06a0e0 msgr2=0x7f60fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f60fc06a0e0 0x7f60fc06c5a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6110159530 tx=0x7f6104009040 comp rx=0 tx=0).stop 2023-08-31T02:01:54.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 msgr2=0x7f61100c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 0x7f61100c3e20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6100004000 tx=0x7f610000bf00 comp rx=0 tx=0).stop 2023-08-31T02:01:54.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 shutdown_connections 2023-08-31T02:01:54.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f60fc06a0e0 0x7f60fc06c5a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6110158210 0x7f61100c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61100b0d00 0x7f61101e4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 --2- 172.21.15.84:0/420419564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61100c9990 0x7f61100c3e20 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 >> 172.21.15.84:0/420419564 conn(0x7f61100cde90 msgr2=0x7f61100c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:54.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 shutdown_connections 2023-08-31T02:01:54.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.649+0000 7f611567a700 1 -- 172.21.15.84:0/420419564 wait complete. 2023-08-31T02:01:54.646 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 7 to deep-scrub 2023-08-31T02:01:54.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:01:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.783+0000 7f7122a81700 1 -- 172.21.15.84:0/1701030444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 msgr2=0x7f711c159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.783+0000 7f7122a81700 1 --2- 172.21.15.84:0/1701030444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 0x7f711c159610 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f711c0cdf50 tx=0x7f7110009c70 comp rx=0 tx=0).stop 2023-08-31T02:01:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.783+0000 7f7122a81700 1 -- 172.21.15.84:0/1701030444 shutdown_connections 2023-08-31T02:01:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.783+0000 7f7122a81700 1 --2- 172.21.15.84:0/1701030444 >> v2:172.21.15.170:3300/0 conn(0x7f711c0b2a30 0x7f711c0b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.783+0000 7f7122a81700 1 --2- 172.21.15.84:0/1701030444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 0x7f711c159610 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.783+0000 7f7122a81700 1 --2- 172.21.15.84:0/1701030444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f711c0c7d20 0x7f711c0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.783+0000 7f7122a81700 1 -- 172.21.15.84:0/1701030444 >> 172.21.15.84:0/1701030444 conn(0x7f711c0caa20 msgr2=0x7f711c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.784+0000 7f7122a81700 1 -- 172.21.15.84:0/1701030444 shutdown_connections 2023-08-31T02:01:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.784+0000 7f7122a81700 1 -- 172.21.15.84:0/1701030444 wait complete. 2023-08-31T02:01:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.785+0000 7f7122a81700 1 Processor -- start 2023-08-31T02:01:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.785+0000 7f7122a81700 1 -- start start 2023-08-31T02:01:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f7122a81700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f711c0b2a30 0x7f711c150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f7122a81700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c0c7d20 0x7f711c0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f7122a81700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 0x7f711c0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f7122a81700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0c3d70 con 0x7f711c159230 2023-08-31T02:01:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f7122a81700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0ae4b0 con 0x7f711c0c7d20 2023-08-31T02:01:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f7122a81700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0ae790 con 0x7f711c0b2a30 2023-08-31T02:01:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f712101e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 0x7f711c0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f712101e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 0x7f711c0c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54890/0 (socket says 172.21.15.84:54890) 2023-08-31T02:01:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f712101e700 1 -- 172.21.15.84:0/2311128883 learned_addr learned my addr 172.21.15.84:0/2311128883 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:01:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f712081d700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f711c0b2a30 0x7f711c150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.786+0000 7f711bfff700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c0c7d20 0x7f711c0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f712101e700 1 -- 172.21.15.84:0/2311128883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f711c0b2a30 msgr2=0x7f711c150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f712101e700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f711c0b2a30 0x7f711c150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f712101e700 1 -- 172.21.15.84:0/2311128883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c0c7d20 msgr2=0x7f711c0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f712101e700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c0c7d20 0x7f711c0c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f712101e700 1 -- 172.21.15.84:0/2311128883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100095f0 con 0x7f711c159230 2023-08-31T02:01:54.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f712101e700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 0x7f711c0c4540 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7114007d70 tx=0x7f711400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:54.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f71197fa700 1 -- 172.21.15.84:0/2311128883 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400ad40 con 0x7f711c159230 2023-08-31T02:01:54.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f71197fa700 1 -- 172.21.15.84:0/2311128883 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7114012420 con 0x7f711c159230 2023-08-31T02:01:54.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c0aea70 con 0x7f711c159230 2023-08-31T02:01:54.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f71197fa700 1 -- 172.21.15.84:0/2311128883 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114012830 con 0x7f711c159230 2023-08-31T02:01:54.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.787+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c0af270 con 0x7f711c159230 2023-08-31T02:01:54.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.788+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c04e7c0 con 0x7f711c159230 2023-08-31T02:01:54.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.788+0000 7f71197fa700 1 -- 172.21.15.84:0/2311128883 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7114012990 con 0x7f711c159230 2023-08-31T02:01:54.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.789+0000 7f71197fa700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a0e0 0x7f710006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:01:54.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.789+0000 7f71197fa700 1 -- 172.21.15.84:0/2311128883 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7114088db0 con 0x7f711c159230 2023-08-31T02:01:54.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.789+0000 7f712081d700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a0e0 0x7f710006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:01:54.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.789+0000 7f712081d700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a0e0 0x7f710006c5a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f71100098e0 tx=0x7f7110011040 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:01:54.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.793+0000 7f71197fa700 1 -- 172.21.15.84:0/2311128883 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7114054750 con 0x7f711c159230 2023-08-31T02:01:54.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.977+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f711c0cbfa0 con 0x7f710006a0e0 2023-08-31T02:01:54.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.980+0000 7f71197fa700 1 -- 172.21.15.84:0/2311128883 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50865 (secure 0 0 0) 0x7f71100041f0 con 0x7f710006a0e0 2023-08-31T02:01:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:01:54.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a0e0 msgr2=0x7f710006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a0e0 0x7f710006c5a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f71100098e0 tx=0x7f7110011040 comp rx=0 tx=0).stop 2023-08-31T02:01:54.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 msgr2=0x7f711c0c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:01:54.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 0x7f711c0c4540 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7114007d70 tx=0x7f711400a340 comp rx=0 tx=0).stop 2023-08-31T02:01:54.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 shutdown_connections 2023-08-31T02:01:54.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f710006a0e0 0x7f710006c5a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711c159230 0x7f711c0c4540 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f711c0b2a30 0x7f711c150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 --2- 172.21.15.84:0/2311128883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c0c7d20 0x7f711c0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:01:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 >> 172.21.15.84:0/2311128883 conn(0x7f711c0caa20 msgr2=0x7f711c1584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:01:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 shutdown_connections 2023-08-31T02:01:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:01:54.982+0000 7f7122a81700 1 -- 172.21.15.84:0/2311128883 wait complete. 2023-08-31T02:01:54.978 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:01:54.986 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-08-31T02:01:53.073405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221472,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753248,"statfs":{"total":773094113280,"available":772867325952,"internally_reserved":0,"allocated":5414912,"data_stored":3012136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6419,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-52,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001411"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-31T02:01:46.859985+0000","last_change":"2023-08-31T01:59:47.013163+0000","last_active":"2023-08-31T02:01:46.859985+0000","last_peered":"2023-08-31T02:01:46.859985+0000","last_clean":"2023-08-31T02:01:46.859985+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:46.859985+0000","last_undegraded":"2023-08-31T02:01:46.859985+0000","last_fullsized":"2023-08-31T02:01:46.859985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T01:59:45.501742+0000","last_clean_scrub_stamp":"2023-08-31T01:59:45.501742+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T13:23:11.632268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.34000000000000002,"15min":0.34499999999999997},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48699999999999999,"5min":1.004,"15min":1.004},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58299999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.378}]},{"osd":2,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.35199999999999998,"15min":0.35499999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.501,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39700000000000002,"15min":0.40400000000000003},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.495,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.28000000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.875,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.309},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.76500000000000001,"15min":0.83099999999999996},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57899999999999996,"5min":11.74,"15min":11.74},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.873,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78100000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.436,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.504}]},{"osd":6,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.879,"5min":1.127,"15min":1.127},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.98399999999999999,"15min":1.05},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88800000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.98499999999999999,"15min":1.0489999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84199999999999997,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.98699999999999999,"15min":1.0529999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":11.628,"15min":11.628},"last":0.47999999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1122304,"data_stored":819293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55500000000000005,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":1.085,"15min":1.085},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79300000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.46400000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.72599999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74199999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.46400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.79000000000000004,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81799999999999995,"5min":1.26,"15min":1.26},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57199999999999995,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.84199999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1122304,"data_stored":819293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.433,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23499999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.42599999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.501,"5min":0.746,"15min":0.746},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.50600000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.40600000000000003,"15min":0.41099999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.47799999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.627},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.73199999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":1.22,"15min":1.22},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.63},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82799999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65900000000000003,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0900000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.433},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.504}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.36799999999999999}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.34499999999999997,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.41899999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.55700000000000005,"15min":0.59799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.44500000000000001,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47499999999999998,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.39300000000000002,"15min":0.40200000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.40300000000000002,"5min":1.103,"15min":1.103},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.57199999999999995,"15min":0.61199999999999999},"min":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.42999999999999999,"5min":5.827,"15min":5.827},"last":0.31},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.48499999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.79700000000000004,"15min":0.83399999999999996},"min":{"1min":0.45500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.876,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.81699999999999995,"15min":0.85599999999999998},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84399999999999997,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82499999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.79200000000000004,"15min":0.82999999999999996},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":5.71,"15min":5.71},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.82699999999999996,"15min":0.872},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.745,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.82099999999999995,"15min":0.85999999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90600000000000003,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.83799999999999997,"15min":0.875},"min":{"1min":0.46400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93799999999999994,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.41999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.61299999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":5.7690000000000001,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.222}]},{"osd":1,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":9.4199999999999999,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.308},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.37}]},{"osd":4,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.0830000000000002,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9779999999999998,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.1109999999999998,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Aug 31 02:00:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":5.9359999999999999,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.58299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63500000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.622},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67800000000000005,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.629,"15min":0.65400000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.57899999999999996,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.502}]},{"osd":2,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.74299999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.88,"5min":1.96,"15min":1.96},"last":0.88},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":1.014,"15min":1.014},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.92200000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52500000000000002,"15min":0.51500000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85899999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.82199999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82699999999999996,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.67700000000000005,"15min":0.70699999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:00:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70399999999999996,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.84499999999999997,"15min":0.89800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.70099999999999996,"15min":0.72699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67900000000000005,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86199999999999999,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":0.75900000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.48899999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.442,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.437,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81599999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:01:54.990 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-31T01:59:45.501742+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=1, tm_min=59, tm_sec=45, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=2, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T02:01:54.991 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-31T02:01:58.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:01:58.157 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:14.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T02:02:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.137+0000 7f80691ea700 1 -- 172.21.15.84:0/3443054709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f804c004d90 msgr2=0x7f804c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.137+0000 7f80691ea700 1 --2- 172.21.15.84:0/3443054709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f804c004d90 0x7f804c005210 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f805c00c680 tx=0x7f804c005880 comp rx=0 tx=0).stop 2023-08-31T02:02:15.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.137+0000 7f806359e700 1 -- 172.21.15.84:0/3443054709 reap_dead start 2023-08-31T02:02:15.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.137+0000 7f80691ea700 1 -- 172.21.15.84:0/3443054709 shutdown_connections 2023-08-31T02:02:15.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.137+0000 7f80691ea700 1 -- 172.21.15.84:0/3443054709 >> 172.21.15.84:0/3443054709 conn(0x7f80640699a0 msgr2=0x7f8064069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:02:15.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.137+0000 7f80691ea700 1 -- 172.21.15.84:0/3443054709 shutdown_connections 2023-08-31T02:02:15.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.137+0000 7f80691ea700 1 -- 172.21.15.84:0/3443054709 wait complete. 2023-08-31T02:02:15.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.139+0000 7f80691ea700 1 Processor -- start 2023-08-31T02:02:15.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.139+0000 7f80691ea700 1 -- start start 2023-08-31T02:02:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f80691ea700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80640c68a0 0x7f806414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f80691ea700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80640c85c0 0x7f806414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f80691ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640c6c80 0x7f806414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f80691ea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806414c620 con 0x7f80640c6c80 2023-08-31T02:02:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f80691ea700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c9010 con 0x7f80640c68a0 2023-08-31T02:02:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f80691ea700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c8a50 con 0x7f80640c85c0 2023-08-31T02:02:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640c6c80 0x7f806414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640c6c80 0x7f806414bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54910/0 (socket says 172.21.15.84:54910) 2023-08-31T02:02:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 -- 172.21.15.84:0/1248507594 learned_addr learned my addr 172.21.15.84:0/1248507594 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:02:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f8062d9d700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80640c68a0 0x7f806414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806259c700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80640c85c0 0x7f806414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 -- 172.21.15.84:0/1248507594 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80640c85c0 msgr2=0x7f806414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80640c85c0 0x7f806414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 -- 172.21.15.84:0/1248507594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80640c68a0 msgr2=0x7f806414dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80640c68a0 0x7f806414dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 -- 172.21.15.84:0/1248507594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640c8d30 con 0x7f80640c6c80 2023-08-31T02:02:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.140+0000 7f806359e700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640c6c80 0x7f806414bb90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f804c00bac0 tx=0x7f805c001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:02:15.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.141+0000 7f804b7fe700 1 -- 172.21.15.84:0/1248507594 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0062d0 con 0x7f80640c6c80 2023-08-31T02:02:15.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.141+0000 7f804b7fe700 1 -- 172.21.15.84:0/1248507594 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f805c020070 con 0x7f80640c6c80 2023-08-31T02:02:15.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.141+0000 7f804b7fe700 1 -- 172.21.15.84:0/1248507594 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0067a0 con 0x7f80640c6c80 2023-08-31T02:02:15.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.141+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806414c240 con 0x7f80640c6c80 2023-08-31T02:02:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.141+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80640ae390 con 0x7f80640c6c80 2023-08-31T02:02:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.142+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806414c760 con 0x7f80640c6c80 2023-08-31T02:02:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.142+0000 7f804b7fe700 1 -- 172.21.15.84:0/1248507594 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f805c006900 con 0x7f80640c6c80 2023-08-31T02:02:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.142+0000 7f804b7fe700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f805006a110 0x7f805006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.143+0000 7f804b7fe700 1 -- 172.21.15.84:0/1248507594 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f805c08a2d0 con 0x7f80640c6c80 2023-08-31T02:02:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.143+0000 7f8062d9d700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f805006a110 0x7f805006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.143+0000 7f8062d9d700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f805006a110 0x7f805006c5d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f80580059d0 tx=0x7f80580058e0 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:02:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.147+0000 7f804b7fe700 1 -- 172.21.15.84:0/1248507594 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f805c055d00 con 0x7f80640c6c80 2023-08-31T02:02:15.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.333+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 --> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80640b1230 con 0x7f805006a110 2023-08-31T02:02:15.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.335+0000 7f804b7fe700 1 -- 172.21.15.84:0/1248507594 <== mgr.4194 v2:172.21.15.84:6832/3916096091 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50465 (secure 0 0 0) 0x7f80640b1230 con 0x7f805006a110 2023-08-31T02:02:15.327 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:02:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f805006a110 msgr2=0x7f805006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f805006a110 0x7f805006c5d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f80580059d0 tx=0x7f80580058e0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640c6c80 msgr2=0x7f806414bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640c6c80 0x7f806414bb90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f804c00bac0 tx=0x7f805c001b90 comp rx=0 tx=0).stop 2023-08-31T02:02:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 shutdown_connections 2023-08-31T02:02:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f805006a110 0x7f805006c5d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640c6c80 0x7f806414bb90 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80640c68a0 0x7f806414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 --2- 172.21.15.84:0/1248507594 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80640c85c0 0x7f806414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 >> 172.21.15.84:0/1248507594 conn(0x7f80640699a0 msgr2=0x7f806406e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:02:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 shutdown_connections 2023-08-31T02:02:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.337+0000 7f80691ea700 1 -- 172.21.15.84:0/1248507594 wait complete. 2023-08-31T02:02:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-08-31T02:02:15.341 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-08-31T02:02:15.078090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221456,"kb_used_data":5288,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753264,"statfs":{"total":773094113280,"available":772867342336,"internally_reserved":0,"allocated":5414912,"data_stored":3012136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002743"},"pg_stats":[{"pgid":"1.0","version":"45'119","reported_seq":197,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-31T02:01:55.625345+0000","last_change":"2023-08-31T02:01:55.625431+0000","last_active":"2023-08-31T02:01:55.625345+0000","last_peered":"2023-08-31T02:01:55.625345+0000","last_clean":"2023-08-31T02:01:55.625345+0000","last_became_active":"2023-08-31T01:59:47.012136+0000","last_became_peered":"2023-08-31T01:59:47.012136+0000","last_unstale":"2023-08-31T02:01:55.625345+0000","last_undegraded":"2023-08-31T02:01:55.625345+0000","last_fullsized":"2023-08-31T02:01:55.625345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2023-08-31T02:01:55.625246+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2023-08-31T02:01:55.625246+0000","last_clean_scrub_stamp":"2023-08-31T02:01:55.625246+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:07:49.069815+0000","scrub_duration":0.0050735390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.34000000000000002,"15min":0.34499999999999997},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48699999999999999,"5min":1.004,"15min":1.004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58299999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.498}]},{"osd":2,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.35199999999999998,"15min":0.35499999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.501,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39700000000000002,"15min":0.40400000000000003},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.495,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.28000000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.875,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.76500000000000001,"15min":0.83099999999999996},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57899999999999996,"5min":11.74,"15min":11.74},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.873,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78100000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.436,"5min":0.376,"15min":0.376},"max":{"1min":0.93700000000000006,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.879,"5min":1.127,"15min":1.127},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.98399999999999999,"15min":1.05},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88800000000000001,"5min":11.707000000000001,"15min":11.707000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Aug 31 02:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.98499999999999999,"15min":1.0489999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84199999999999997,"5min":11.659000000000001,"15min":11.659000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.98699999999999999,"15min":1.0529999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":11.628,"15min":11.628},"last":0.73999999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1122304,"data_stored":819293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55500000000000005,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":1.085,"15min":1.085},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79300000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.46400000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.72599999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74199999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.46400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.79000000000000004,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81799999999999995,"5min":1.26,"15min":1.26},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Aug 31 02:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57199999999999995,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65000000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1122304,"data_stored":819293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.433,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23499999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.42599999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.501,"5min":0.746,"15min":0.746},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.50600000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.378,"5min":0.40600000000000003,"15min":0.41099999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.47799999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.627},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.73199999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":1.22,"15min":1.22},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.63},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82799999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65900000000000003,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0900000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.433,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.40999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.66600000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.59799999999999998,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":5.0640000000000001,"5min":5.0640000000000001,"15min":5.0640000000000001},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.437,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79000000000000004,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.624,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.438},{"interface":"front","average":{"1min":0.624,"5min":0.628,"15min":0.628},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.66500000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.627}]}]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.34499999999999997,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.41899999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.312,"5min":0.55700000000000005,"15min":0.59799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.44500000000000001,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47499999999999998,"5min":5.7400000000000002,"15min":5.7400000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.39300000000000002,"15min":0.40200000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.40300000000000002,"5min":1.103,"15min":1.103},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.57199999999999995,"15min":0.61199999999999999},"min":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.42999999999999999,"5min":5.827,"15min":5.827},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.48499999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.79700000000000004,"15min":0.83399999999999996},"min":{"1min":0.45500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.876,"5min":5.6799999999999997,"15min":5.6799999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.81699999999999995,"15min":0.85599999999999998},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84399999999999997,"5min":5.8879999999999999,"15min":5.8879999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82499999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.79200000000000004,"15min":0.82999999999999996},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":5.71,"15min":5.71},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.82699999999999996,"15min":0.872},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.745,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.628},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.82099999999999995,"15min":0.85999999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90600000000000003,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Aug 31 02:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.83799999999999997,"15min":0.875},"min":{"1min":0.46400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93799999999999994,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.41999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.57599999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.42099999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.59099999999999997,"15min":0.63200000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.45600000000000002,"5min":5.7690000000000001,"15min":5.7690000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.69199999999999995,"15min":0.75600000000000001},"min":{"1min":0.24099999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.40200000000000002,"5min":9.4199999999999999,"15min":9.4199999999999999},"last":0.495},{"interface":"front","average":{"1min":0.318,"5min":0.78500000000000003,"15min":0.86299999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.42699999999999999,"5min":11.484,"15min":11.484},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.624,"15min":0.66600000000000004},"min":{"1min":0.29399999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.441,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.749,"15min":0.81299999999999994},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.438,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.80900000000000005,"15min":0.84799999999999998},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72299999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.745,"15min":0.77100000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78300000000000003,"5min":5.0830000000000002,"15min":5.0830000000000002},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.62},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.82699999999999996,"15min":0.86199999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82399999999999995,"5min":5.9779999999999998,"15min":5.9779999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78200000000000003,"5min":5.1109999999999998,"15min":5.1109999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.746,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Aug 31 02:01:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79200000000000004,"5min":5.9359999999999999,"15min":5.9359999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":0.745}]}]},{"osd":4,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63500000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67800000000000005,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.629,"15min":0.65400000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.57899999999999996,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.629},{"interface":"front","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.74299999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.88,"5min":1.96,"15min":1.96},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":1.014,"15min":1.014},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.92200000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52500000000000002,"15min":0.51500000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85899999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Aug 31 02:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.503}]}]},{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":228925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82699999999999996,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.67700000000000005,"15min":0.70699999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Aug 31 02:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.64300000000000002,"15min":0.66400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67300000000000004,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.628,"15min":0.64500000000000002},"min":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70699999999999996,"5min":2.956,"15min":2.956},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70399999999999996,"5min":3.8460000000000001,"15min":3.8460000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.84499999999999997,"15min":0.89800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.628}]},{"osd":3,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.70099999999999996,"15min":0.72699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67900000000000005,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86199999999999999,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.371,"5min":0.316,"15min":0.316},"max":{"1min":0.75900000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.48899999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.442,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.443}]},{"osd":7,"last update":"Thu Aug 31 02:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.437,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81599999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T02:02:15.343 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-31T02:02:15.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.473+0000 7f150dc39700 1 -- 172.21.15.84:0/574598079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14f0004d90 msgr2=0x7f14f0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.473+0000 7f150dc39700 1 --2- 172.21.15.84:0/574598079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14f0004d90 0x7f14f0005210 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f150000e350 tx=0x7f14f0005880 comp rx=0 tx=0).stop 2023-08-31T02:02:15.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.473+0000 7f1507fff700 1 -- 172.21.15.84:0/574598079 reap_dead start 2023-08-31T02:02:15.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.473+0000 7f150dc39700 1 -- 172.21.15.84:0/574598079 shutdown_connections 2023-08-31T02:02:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.473+0000 7f150dc39700 1 -- 172.21.15.84:0/574598079 >> 172.21.15.84:0/574598079 conn(0x7f15080699a0 msgr2=0x7f1508069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:02:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.473+0000 7f150dc39700 1 -- 172.21.15.84:0/574598079 shutdown_connections 2023-08-31T02:02:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.473+0000 7f150dc39700 1 -- 172.21.15.84:0/574598079 wait complete. 2023-08-31T02:02:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.474+0000 7f150dc39700 1 Processor -- start 2023-08-31T02:02:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f150dc39700 1 -- start start 2023-08-31T02:02:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f150dc39700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f0004d90 0x7f150814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f150dc39700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f150815b480 0x7f15080c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f150dc39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15081eee70 0x7f15080c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f150dc39700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080c5ab0 con 0x7f15081eee70 2023-08-31T02:02:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f150dc39700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080c3630 con 0x7f150815b480 2023-08-31T02:02:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f150dc39700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15080c2d00 con 0x7f14f0004d90 2023-08-31T02:02:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f1507fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15081eee70 0x7f15080c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f1507fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15081eee70 0x7f15080c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54928/0 (socket says 172.21.15.84:54928) 2023-08-31T02:02:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.475+0000 7f1507fff700 1 -- 172.21.15.84:0/127536773 learned_addr learned my addr 172.21.15.84:0/127536773 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:02:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f15077fe700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f0004d90 0x7f150814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f1506ffd700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f150815b480 0x7f15080c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f1507fff700 1 -- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f0004d90 msgr2=0x7f150814b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f1507fff700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f0004d90 0x7f150814b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f1507fff700 1 -- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f150815b480 msgr2=0x7f15080c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f1507fff700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f150815b480 0x7f15080c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f1507fff700 1 -- 172.21.15.84:0/127536773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080cb870 con 0x7f15081eee70 2023-08-31T02:02:15.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f15077fe700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f0004d90 0x7f150814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:02:15.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f1506ffd700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f150815b480 0x7f15080c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:02:15.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f1507fff700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15081eee70 0x7f15080c6e40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1500009040 tx=0x7f15000093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:02:15.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f14effff700 1 -- 172.21.15.84:0/127536773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500018070 con 0x7f15081eee70 2023-08-31T02:02:15.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f14effff700 1 -- 172.21.15.84:0/127536773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1500019040 con 0x7f15081eee70 2023-08-31T02:02:15.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15080c2fe0 con 0x7f15081eee70 2023-08-31T02:02:15.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f14effff700 1 -- 172.21.15.84:0/127536773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500007760 con 0x7f15081eee70 2023-08-31T02:02:15.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.476+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150814bb50 con 0x7f15081eee70 2023-08-31T02:02:15.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.477+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15080c37c0 con 0x7f15081eee70 2023-08-31T02:02:15.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.477+0000 7f14effff700 1 -- 172.21.15.84:0/127536773 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f15000078c0 con 0x7f15081eee70 2023-08-31T02:02:15.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.478+0000 7f14effff700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14f406a0e0 0x7f14f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.478+0000 7f14effff700 1 -- 172.21.15.84:0/127536773 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f15000894b0 con 0x7f15081eee70 2023-08-31T02:02:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.478+0000 7f15077fe700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14f406a0e0 0x7f14f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.478+0000 7f15077fe700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14f406a0e0 0x7f14f406c5a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f14fc000ff0 tx=0x7f14fc001640 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:02:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.482+0000 7f14effff700 1 -- 172.21.15.84:0/127536773 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1500054e60 con 0x7f15081eee70 2023-08-31T02:02:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.673+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f150814bce0 con 0x7f15081eee70 2023-08-31T02:02:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.679+0000 7f14effff700 1 -- 172.21.15.84:0/127536773 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1500054e60 con 0x7f15081eee70 2023-08-31T02:02:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.679+0000 7f14effff700 1 -- 172.21.15.84:0/127536773 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v33)=0 v33) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1500058480 con 0x7f15081eee70 2023-08-31T02:02:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14f406a0e0 msgr2=0x7f14f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14f406a0e0 0x7f14f406c5a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f14fc000ff0 tx=0x7f14fc001640 comp rx=0 tx=0).stop 2023-08-31T02:02:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15081eee70 msgr2=0x7f15080c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15081eee70 0x7f15080c6e40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1500009040 tx=0x7f15000093b0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 shutdown_connections 2023-08-31T02:02:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f14f406a0e0 0x7f14f406c5a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15081eee70 0x7f15080c6e40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f0004d90 0x7f150814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 --2- 172.21.15.84:0/127536773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f150815b480 0x7f15080c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 >> 172.21.15.84:0/127536773 conn(0x7f15080699a0 msgr2=0x7f15080ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:02:15.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 shutdown_connections 2023-08-31T02:02:15.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.682+0000 7f150dc39700 1 -- 172.21.15.84:0/127536773 wait complete. 2023-08-31T02:02:15.686 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T02:02:15.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T02:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.817+0000 7f4f39cd1700 1 -- 172.21.15.84:0/434752770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340b12c0 msgr2=0x7f4f34159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.817+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/434752770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340b12c0 0x7f4f34159a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009f60 tx=0x7f4f2c009f90 comp rx=0 tx=0).stop 2023-08-31T02:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.817+0000 7f4f39cd1700 1 -- 172.21.15.84:0/434752770 shutdown_connections 2023-08-31T02:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.817+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/434752770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340af3d0 0x7f4f3415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.817+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/434752770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340b12c0 0x7f4f34159a00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.817+0000 7f4f39cd1700 1 -- 172.21.15.84:0/434752770 >> 172.21.15.84:0/434752770 conn(0x7f4f3406fca0 msgr2=0x7f4f340cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.817+0000 7f4f39cd1700 1 -- 172.21.15.84:0/434752770 shutdown_connections 2023-08-31T02:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.817+0000 7f4f39cd1700 1 -- 172.21.15.84:0/434752770 wait complete. 2023-08-31T02:02:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.818+0000 7f4f39cd1700 1 Processor -- start 2023-08-31T02:02:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.819+0000 7f4f39cd1700 1 -- start start 2023-08-31T02:02:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.819+0000 7f4f39cd1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340af3d0 0x7f4f34151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.819+0000 7f4f39cd1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f340b12c0 0x7f4f34148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.819+0000 7f4f39cd1700 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340ce570 0x7f4f341584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.819+0000 7f4f39cd1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34148970 con 0x7f4f340b12c0 2023-08-31T02:02:15.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.819+0000 7f4f39cd1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34148eb0 con 0x7f4f340af3d0 2023-08-31T02:02:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.819+0000 7f4f39cd1700 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3406d3d0 con 0x7f4f340ce570 2023-08-31T02:02:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f340b12c0 0x7f4f34148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f340b12c0 0x7f4f34148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54940/0 (socket says 172.21.15.84:54940) 2023-08-31T02:02:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 -- 172.21.15.84:0/1594267383 learned_addr learned my addr 172.21.15.84:0/1594267383 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-08-31T02:02:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f33fff700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340ce570 0x7f4f341584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f337fe700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340af3d0 0x7f4f34151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 -- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340ce570 msgr2=0x7f4f341584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340ce570 0x7f4f341584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 -- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340af3d0 msgr2=0x7f4f34151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:15.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340af3d0 0x7f4f34151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:15.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 -- 172.21.15.84:0/1594267383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28009520 con 0x7f4f340b12c0 2023-08-31T02:02:15.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f337fe700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340af3d0 0x7f4f34151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T02:02:15.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f32ffd700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f340b12c0 0x7f4f34148430 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c500 tx=0x7f4f2400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f1bfff700 1 -- 172.21.15.84:0/1594267383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24011790 con 0x7f4f340b12c0 2023-08-31T02:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c009c40 con 0x7f4f340b12c0 2023-08-31T02:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f1bfff700 1 -- 172.21.15.84:0/1594267383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4f240118f0 con 0x7f4f340b12c0 2023-08-31T02:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f1bfff700 1 -- 172.21.15.84:0/1594267383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24011d00 con 0x7f4f340b12c0 2023-08-31T02:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.820+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f340cfca0 con 0x7f4f340b12c0 2023-08-31T02:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.821+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f34150ce0 con 0x7f4f340b12c0 2023-08-31T02:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.822+0000 7f4f1bfff700 1 -- 172.21.15.84:0/1594267383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f2401c460 con 0x7f4f340b12c0 2023-08-31T02:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.822+0000 7f4f1bfff700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f2006a0e0 0x7f4f2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T02:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.822+0000 7f4f1bfff700 1 -- 172.21.15.84:0/1594267383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4f240881f0 con 0x7f4f340b12c0 2023-08-31T02:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.822+0000 7f4f337fe700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f2006a0e0 0x7f4f2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T02:02:15.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.823+0000 7f4f337fe700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f2006a0e0 0x7f4f2006c5a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4f3414c420 tx=0x7f4f28009260 comp rx=0 tx=0).ready entity=mgr.4194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T02:02:15.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:15.826+0000 7f4f1bfff700 1 -- 172.21.15.84:0/1594267383 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4f34150ce0 con 0x7f4f340b12c0 2023-08-31T02:02:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.056+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f34150ce0 con 0x7f4f340b12c0 2023-08-31T02:02:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.057+0000 7f4f1bfff700 1 -- 172.21.15.84:0/1594267383 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f4f34150ce0 con 0x7f4f340b12c0 2023-08-31T02:02:16.049 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-08-31T02:02:16.049 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5009,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3211732680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3211732680},{"type":"v1","addr":"172.21.15.170:6834","nonce":3211732680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5012,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2965794759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2965794759},{"type":"v1","addr":"172.21.15.170:6835","nonce":2965794759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2457559549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2457559549},{"type":"v1","addr":"172.21.15.84:6837","nonce":2457559549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/949151852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":949151852},{"type":"v1","addr":"172.21.15.84:6836","nonce":949151852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-08-31T02:02:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f2006a0e0 msgr2=0x7f4f2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f2006a0e0 0x7f4f2006c5a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4f3414c420 tx=0x7f4f28009260 comp rx=0 tx=0).stop 2023-08-31T02:02:16.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f340b12c0 msgr2=0x7f4f34148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T02:02:16.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f340b12c0 0x7f4f34148430 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c500 tx=0x7f4f2400c8c0 comp rx=0 tx=0).stop 2023-08-31T02:02:16.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 shutdown_connections 2023-08-31T02:02:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:6832/3916096091,v1:172.21.15.84:6833/3916096091] conn(0x7f4f2006a0e0 0x7f4f2006c5a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340ce570 0x7f4f341584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340af3d0 0x7f4f34151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 --2- 172.21.15.84:0/1594267383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f340b12c0 0x7f4f34148430 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T02:02:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.058+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 >> 172.21.15.84:0/1594267383 conn(0x7f4f3406fca0 msgr2=0x7f4f34153630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T02:02:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.059+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 shutdown_connections 2023-08-31T02:02:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-08-31T02:02:16.059+0000 7f4f39cd1700 1 -- 172.21.15.84:0/1594267383 wait complete. 2023-08-31T02:02:16.057 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2023-08-31T02:02:16.062 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-31T02:02:16.062 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-31T02:02:16.063 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T02:02:16.063 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.072 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T02:02:16.072 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T02:02:16.073 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.121 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T02:02:16.122 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T02:02:16.122 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.133 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T02:02:16.133 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T02:02:16.134 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.184 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T02:02:16.185 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-31T02:02:16.186 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-31T02:02:16.186 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.223 INFO:tasks.ceph.osd.0:Stopped 2023-08-31T02:02:16.223 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-31T02:02:16.224 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.298 INFO:tasks.ceph.osd.1:Stopped 2023-08-31T02:02:16.299 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-31T02:02:16.299 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.376 INFO:tasks.ceph.osd.2:Stopped 2023-08-31T02:02:16.376 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-31T02:02:16.377 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.456 INFO:tasks.ceph.osd.3:Stopped 2023-08-31T02:02:16.457 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-31T02:02:16.457 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.499 INFO:tasks.ceph.osd.4:Stopped 2023-08-31T02:02:16.500 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-31T02:02:16.500 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.535 INFO:tasks.ceph.osd.5:Stopped 2023-08-31T02:02:16.536 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-31T02:02:16.536 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.613 INFO:tasks.ceph.osd.6:Stopped 2023-08-31T02:02:16.613 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-31T02:02:16.613 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.696 INFO:tasks.ceph.osd.7:Stopped 2023-08-31T02:02:16.697 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-31T02:02:16.697 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-31T02:02:16.698 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.722 INFO:tasks.ceph.mgr.y:Stopped 2023-08-31T02:02:16.722 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-31T02:02:16.723 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.747 INFO:tasks.ceph.mgr.x:Stopped 2023-08-31T02:02:16.748 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-31T02:02:16.749 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-31T02:02:16.749 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.773 INFO:tasks.ceph.mon.a:Stopped 2023-08-31T02:02:16.774 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-31T02:02:16.774 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.799 INFO:tasks.ceph.mon.b:Stopped 2023-08-31T02:02:16.800 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-31T02:02:16.800 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T02:02:16.852 INFO:tasks.ceph.mon.c:Stopped 2023-08-31T02:02:16.852 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-31T02:02:16.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-31T02:02:16.884 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:02:16.886 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-31T02:02:17.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:02:17.136 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-31T02:02:17.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:02:17.268 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-31T02:02:17.342 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:02:17.342 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-31T02:02:17.422 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:02:17.423 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-31T02:02:17.654 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:02:17.655 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-31T02:02:17.761 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:02:17.761 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-31T02:02:17.867 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:02:17.867 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-31T02:02:17.942 INFO:tasks.ceph:Archiving mon data... 2023-08-31T02:02:17.944 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/data/mon.a.tgz 2023-08-31T02:02:17.944 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-08-31T02:02:17.962 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.VWyA9DSYxZ 2023-08-31T02:02:17.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VWyA9DSYxZ 2023-08-31T02:02:18.091 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.VWyA9DSYxZ 2023-08-31T02:02:18.177 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.VWyA9DSYxZ is 309KB 2023-08-31T02:02:18.272 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.VWyA9DSYxZ 2023-08-31T02:02:18.288 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/data/mon.b.tgz 2023-08-31T02:02:18.288 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2023-08-31T02:02:18.307 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.LV2WJaACZR 2023-08-31T02:02:18.307 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LV2WJaACZR 2023-08-31T02:02:18.470 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.LV2WJaACZR 2023-08-31T02:02:18.556 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.LV2WJaACZR is 409KB 2023-08-31T02:02:18.652 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.LV2WJaACZR 2023-08-31T02:02:18.669 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/data/mon.c.tgz 2023-08-31T02:02:18.669 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2023-08-31T02:02:18.724 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.yp5IilSGgc 2023-08-31T02:02:18.725 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.yp5IilSGgc 2023-08-31T02:02:18.862 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.yp5IilSGgc 2023-08-31T02:02:18.948 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.yp5IilSGgc is 409KB 2023-08-31T02:02:19.044 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.yp5IilSGgc 2023-08-31T02:02:19.061 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-31T02:02:19.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-31T02:02:19.064 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-31T02:02:19.126 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-31T02:02:19.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-31T02:02:19.135 DEBUG:teuthology.orchestra.run.smithi170:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-31T02:02:19.176 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-31T02:02:19.198 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-31T02:02:19.204 INFO:tasks.ceph:Archiving crash dumps... 2023-08-31T02:02:19.206 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/remote/smithi084/crash 2023-08-31T02:02:19.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-31T02:02:19.251 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/remote/smithi170/crash 2023-08-31T02:02:19.252 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-31T02:02:19.278 INFO:tasks.ceph:Shutting down logrotate 2023-08-31T02:02:19.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:19.296 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:19.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:19.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:19.427 INFO:tasks.ceph:Compressing logs... 2023-08-31T02:02:19.428 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-31T02:02:19.443 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-31T02:02:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112383.log 2023-08-31T02:02:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112522.log 2023-08-31T02:02:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113547.log 2023-08-31T02:02:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123266.log 2023-08-31T02:02:19.480 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112383.log.gz 2023-08-31T02:02:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113547.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112522.log.gz 2023-08-31T02:02:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103638.log 2023-08-31T02:02:19.481 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.113547.log.gz 2023-08-31T02:02:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124423.log 2023-08-31T02:02:19.482 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123266.log.gz 2023-08-31T02:02:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113442.log 2023-08-31T02:02:19.482 INFO:teuthology.orchestra.run.smithi084.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.103638.log.gz 2023-08-31T02:02:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111268.log 2023-08-31T02:02:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113442.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124423.log.gz 2023-08-31T02:02:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125159.log 2023-08-31T02:02:19.483 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113442.log.gz 2023-08-31T02:02:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118318.log 2023-08-31T02:02:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111586.log 2023-08-31T02:02:19.484 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125159.log.gz 2023-08-31T02:02:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112107.log 2023-08-31T02:02:19.485 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118318.log.gz 2023-08-31T02:02:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116090.log 2023-08-31T02:02:19.485 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111586.log.gz 2023-08-31T02:02:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121632.log 2023-08-31T02:02:19.486 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112107.log.gz 2023-08-31T02:02:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121679.log 2023-08-31T02:02:19.487 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116090.log.gz 2023-08-31T02:02:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118364.log 2023-08-31T02:02:19.487 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5%/var/log/ceph/ceph-client.admin.121679.log: -- replaced with /var/log/ceph/ceph-client.admin.121632.log.gz 2023-08-31T02:02:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119555.log 2023-08-31T02:02:19.488 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3%/var/log/ceph/ceph-client.admin.118364.log: -- replaced with /var/log/ceph/ceph-client.admin.121679.log.gz 2023-08-31T02:02:19.488 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123857.log 2023-08-31T02:02:19.488 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.111268.log.gz 2023-08-31T02:02:19.489 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118364.log.gz 2023-08-31T02:02:19.489 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117459.log 2023-08-31T02:02:19.489 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119555.log.gz 2023-08-31T02:02:19.489 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122948.log 2023-08-31T02:02:19.490 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.123857.log.gz 2023-08-31T02:02:19.490 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103160.log 2023-08-31T02:02:19.490 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117459.log.gz 2023-08-31T02:02:19.491 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119923.log 2023-08-31T02:02:19.491 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.122948.log.gz 2023-08-31T02:02:19.491 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110575.log 2023-08-31T02:02:19.491 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103160.log.gz 2023-08-31T02:02:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109809.log 2023-08-31T02:02:19.492 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119923.log.gz 2023-08-31T02:02:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124699.log 2023-08-31T02:02:19.492 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.110575.log.gz 2023-08-31T02:02:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117567.log 2023-08-31T02:02:19.493 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109809.log.gz 2023-08-31T02:02:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124699.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-31T02:02:19.493 INFO:teuthology.orchestra.run.smithi084.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.124699.log.gz 2023-08-31T02:02:19.494 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113557.log 2023-08-31T02:02:19.494 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117567.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109948.log 2023-08-31T02:02:19.494 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117567.log.gz 2023-08-31T02:02:19.495 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118180.log 2023-08-31T02:02:19.495 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109948.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113557.log.gz 2023-08-31T02:02:19.495 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116953.log 2023-08-31T02:02:19.495 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109948.log.gz 2023-08-31T02:02:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104279.log 2023-08-31T02:02:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118180.log: /var/log/ceph/ceph-client.admin.116953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116493.log 2023-08-31T02:02:19.496 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118180.log.gz 2023-08-31T02:02:19.497 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116953.log.gz 2023-08-31T02:02:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121771.log 2023-08-31T02:02:19.497 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104279.log.gz 2023-08-31T02:02:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119693.log 2023-08-31T02:02:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116493.log: /var/log/ceph/ceph-client.admin.121771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121157.log 2023-08-31T02:02:19.498 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116493.log.gz 2023-08-31T02:02:19.498 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121771.log.gz 2023-08-31T02:02:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119224.log 2023-08-31T02:02:19.499 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119693.log.gz 2023-08-31T02:02:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114362.log 2023-08-31T02:02:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121157.log: /var/log/ceph/ceph-client.admin.119224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112153.log 2023-08-31T02:02:19.500 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121157.log.gz 2023-08-31T02:02:19.500 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119224.log.gz 2023-08-31T02:02:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121249.log 2023-08-31T02:02:19.500 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114362.log.gz 2023-08-31T02:02:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-31T02:02:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112153.log: /var/log/ceph/ceph-client.admin.121249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123921.log 2023-08-31T02:02:19.501 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112153.log.gz 2023-08-31T02:02:19.511 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-31T02:02:19.512 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-31T02:02:19.512 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103128.log 2023-08-31T02:02:19.512 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.109493.log 2023-08-31T02:02:19.513 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.103128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103266.log 2023-08-31T02:02:19.513 INFO:teuthology.orchestra.run.smithi170.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.103128.log.gz 2023-08-31T02:02:19.513 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.1.109493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103357.log 2023-08-31T02:02:19.514 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-31T02:02:19.514 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.103266.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-31T02:02:19.514 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.103357.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.103266.log.gz 2023-08-31T02:02:19.515 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-31T02:02:19.515 INFO:teuthology.orchestra.run.smithi170.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.1.109493.log.gz 2023-08-31T02:02:19.515 INFO:teuthology.orchestra.run.smithi170.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.103357.log.gz 2023-08-31T02:02:19.515 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-31T02:02:19.516 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103454.log 2023-08-31T02:02:19.516 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-31T02:02:19.516 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.103454.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.103454.log.gz 2023-08-31T02:02:19.517 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110100.log 2023-08-31T02:02:19.517 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103220.log 2023-08-31T02:02:19.517 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.3.110100.log: /var/log/ceph/ceph-client.admin.103220.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-31T02:02:19.517 INFO:teuthology.orchestra.run.smithi170.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.103220.log.gz 2023-08-31T02:02:19.518 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103403.log 2023-08-31T02:02:19.518 INFO:teuthology.orchestra.run.smithi170.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.3.110100.log.gz 2023-08-31T02:02:19.518 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-31T02:02:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.103403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110980.log 2023-08-31T02:02:19.519 INFO:teuthology.orchestra.run.smithi170.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.103403.log.gz 2023-08-31T02:02:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-31T02:02:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.1.110980.log: /var/log/ceph/ceph-mon.c.log: 87.8% -- replaced with /var/log/ceph/ceph-client.1.110980.log.gz 2023-08-31T02:02:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103174.log 2023-08-31T02:02:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.103174.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.103174.log.gz 2023-08-31T02:02:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-31T02:02:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.7.log: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-31T02:02:19.521 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103311.log 2023-08-31T02:02:19.521 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.103311.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.103311.log.gz 2023-08-31T02:02:19.521 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-31T02:02:19.523 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-31T02:02:19.523 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.b.log: 90.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-31T02:02:19.538 INFO:teuthology.orchestra.run.smithi170.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-31T02:02:19.592 INFO:teuthology.orchestra.run.smithi170.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-31T02:02:19.598 INFO:teuthology.orchestra.run.smithi170.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-31T02:02:19.600 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121249.log.gz 2023-08-31T02:02:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120337.log 2023-08-31T02:02:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117137.log 2023-08-31T02:02:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123921.log: /var/log/ceph/ceph-client.admin.120337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121391.log 2023-08-31T02:02:19.601 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.123921.log.gz 2023-08-31T02:02:19.602 INFO:teuthology.orchestra.run.smithi084.stderr: 85.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-31T02:02:19.602 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120337.log.gz 2023-08-31T02:02:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122994.log 2023-08-31T02:02:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121391.log: gzip -5 --verbose 87.4%-- /var/log/ceph/ceph-client.admin.118092.log 2023-08-31T02:02:19.603 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117137.log.gz 2023-08-31T02:02:19.603 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121391.log.gz 2023-08-31T02:02:19.603 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122856.log 2023-08-31T02:02:19.604 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122994.log.gz 2023-08-31T02:02:19.604 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123765.log 2023-08-31T02:02:19.604 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120107.log 2023-08-31T02:02:19.605 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118092.log.gz 2023-08-31T02:02:19.605 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.122856.log.gz 2023-08-31T02:02:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103450.log 2023-08-31T02:02:19.605 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123765.log.gz 2023-08-31T02:02:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103192.log 2023-08-31T02:02:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114454.log 2023-08-31T02:02:19.607 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120107.log.gz 2023-08-31T02:02:19.607 INFO:teuthology.orchestra.run.smithi084.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.103450.log.gz 2023-08-31T02:02:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125113.log 2023-08-31T02:02:19.608 INFO:teuthology.orchestra.run.smithi084.stderr: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.103192.log.gz 2023-08-31T02:02:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113174.log 2023-08-31T02:02:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114454.log: /var/log/ceph/ceph-client.admin.125113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118954.log 2023-08-31T02:02:19.609 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114454.log.gz 2023-08-31T02:02:19.609 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.125113.log.gz 2023-08-31T02:02:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109763.log 2023-08-31T02:02:19.610 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113174.log.gz 2023-08-31T02:02:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112821.log 2023-08-31T02:02:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118954.log: /var/log/ceph/ceph-client.admin.109763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111724.log 2023-08-31T02:02:19.612 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118954.log.gz 2023-08-31T02:02:19.612 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109763.log.gz 2023-08-31T02:02:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110529.log 2023-08-31T02:02:19.613 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112821.log.gz 2023-08-31T02:02:19.614 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113181.log 2023-08-31T02:02:19.614 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111724.log.gz 2023-08-31T02:02:19.615 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120880.log 2023-08-31T02:02:19.615 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110529.log.gz 2023-08-31T02:02:19.616 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109569.log 2023-08-31T02:02:19.617 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5%/var/log/ceph/ceph-client.admin.120880.log: -- replaced with /var/log/ceph/ceph-client.admin.113181.log.gz 2023-08-31T02:02:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103015.log 2023-08-31T02:02:19.618 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120880.log.gz 2023-08-31T02:02:19.618 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109902.log 2023-08-31T02:02:19.619 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.109569.log.gz 2023-08-31T02:02:19.619 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103128.log 2023-08-31T02:02:19.619 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103015.log.gz 2023-08-31T02:02:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121295.log 2023-08-31T02:02:19.620 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109902.log.gz 2023-08-31T02:02:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112809.log 2023-08-31T02:02:19.621 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103128.log.gz 2023-08-31T02:02:19.621 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124106.log 2023-08-31T02:02:19.621 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112809.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121295.log.gz 2023-08-31T02:02:19.622 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103402.log 2023-08-31T02:02:19.622 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.112809.log.gz 2023-08-31T02:02:19.622 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118686.log 2023-08-31T02:02:19.623 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124106.log.gz 2023-08-31T02:02:19.623 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124837.log 2023-08-31T02:02:19.623 INFO:teuthology.orchestra.run.smithi084.stderr: 86.2%/var/log/ceph/ceph-client.admin.118686.log: -- replaced with /var/log/ceph/ceph-client.admin.103402.log.gz 2023-08-31T02:02:19.623 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115245.log 2023-08-31T02:02:19.624 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118686.log.gz 2023-08-31T02:02:19.624 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117367.log 2023-08-31T02:02:19.625 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.124837.log.gz 2023-08-31T02:02:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.115245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114709.log 2023-08-31T02:02:19.626 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117367.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-31T02:02:19.626 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117367.log.gz 2023-08-31T02:02:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114709.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.115245.log.gz 2023-08-31T02:02:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117183.log 2023-08-31T02:02:19.628 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114709.log.gz 2023-08-31T02:02:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111678.log 2023-08-31T02:02:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114316.log 2023-08-31T02:02:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117183.log: /var/log/ceph/ceph-client.admin.111678.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117183.log.gz 2023-08-31T02:02:19.630 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120015.log 2023-08-31T02:02:19.630 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111678.log.gz 2023-08-31T02:02:19.630 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125021.log 2023-08-31T02:02:19.631 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113554.log 2023-08-31T02:02:19.631 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114316.log.gz 2023-08-31T02:02:19.631 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120015.log: /var/log/ceph/ceph-client.admin.125021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122501.log 2023-08-31T02:02:19.632 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120015.log.gz 2023-08-31T02:02:19.632 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125021.log.gz 2023-08-31T02:02:19.632 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112614.log 2023-08-31T02:02:19.632 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113554.log.gz 2023-08-31T02:02:19.633 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120521.log 2023-08-31T02:02:19.633 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.122501.log: /var/log/ceph/ceph-client.admin.112614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112814.log 2023-08-31T02:02:19.633 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112614.log.gz 2023-08-31T02:02:19.633 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112816.log 2023-08-31T02:02:19.634 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120521.log.gz 2023-08-31T02:02:19.634 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112814.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112814.log.gz 2023-08-31T02:02:19.634 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112816.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112816.log.gz 2023-08-31T02:02:19.635 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115383.log 2023-08-31T02:02:19.635 INFO:teuthology.orchestra.run.smithi084.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.122501.log.gz 2023-08-31T02:02:19.635 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116354.log 2023-08-31T02:02:19.636 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.115383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120659.log 2023-08-31T02:02:19.636 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115383.log.gz 2023-08-31T02:02:19.636 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116354.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-31T02:02:19.636 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116354.log.gz 2023-08-31T02:02:19.637 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120153.log 2023-08-31T02:02:19.637 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119877.log 2023-08-31T02:02:19.637 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120659.log.gz 2023-08-31T02:02:19.638 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.120153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110088.log 2023-08-31T02:02:19.638 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8%/var/log/ceph/ceph-client.admin.119877.log: -- replaced with /var/log/ceph/ceph-client.admin.120153.log.gz 2023-08-31T02:02:19.638 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125317.log 2023-08-31T02:02:19.639 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119877.log.gz 2023-08-31T02:02:19.639 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123220.log 2023-08-31T02:02:19.639 INFO:teuthology.orchestra.run.smithi084.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-08-31T02:02:19.640 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125317.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110088.log.gz 2023-08-31T02:02:19.640 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121539.log 2023-08-31T02:02:19.640 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125317.log.gz 2023-08-31T02:02:19.640 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123174.log 2023-08-31T02:02:19.641 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123220.log.gz 2023-08-31T02:02:19.641 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118862.log 2023-08-31T02:02:19.641 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121539.log.gz 2023-08-31T02:02:19.641 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103074.log 2023-08-31T02:02:19.642 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- 87.6%/var/log/ceph/ceph-client.admin.124975.log 2023-08-31T02:02:19.642 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123174.log.gz 2023-08-31T02:02:19.642 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118862.log: /var/log/ceph/ceph-client.admin.103074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103550.log 2023-08-31T02:02:19.642 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118862.log.gz 2023-08-31T02:02:19.643 INFO:teuthology.orchestra.run.smithi084.stderr: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.103074.log.gz 2023-08-31T02:02:19.643 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122902.log 2023-08-31T02:02:19.643 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124975.log.gz 2023-08-31T02:02:19.643 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113764.log 2023-08-31T02:02:19.644 INFO:teuthology.orchestra.run.smithi084.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.103550.log.gz 2023-08-31T02:02:19.644 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113185.log 2023-08-31T02:02:19.644 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122902.log: /var/log/ceph/ceph-client.admin.113764.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-31T02:02:19.644 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122902.log.gz 2023-08-31T02:02:19.645 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113185.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113764.log.gz 2023-08-31T02:02:19.645 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109678.log 2023-08-31T02:02:19.645 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113185.log.gz 2023-08-31T02:02:19.645 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114178.log 2023-08-31T02:02:19.646 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118908.log 2023-08-31T02:02:19.646 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109678.log.gz 2023-08-31T02:02:19.646 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116861.log 2023-08-31T02:02:19.647 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118908.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114178.log.gz 2023-08-31T02:02:19.647 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119601.log 2023-08-31T02:02:19.647 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118908.log.gz 2023-08-31T02:02:19.647 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116861.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116861.log.gz 2023-08-31T02:02:19.648 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119601.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119601.log.gz 2023-08-31T02:02:19.648 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113187.log 2023-08-31T02:02:19.648 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120613.log 2023-08-31T02:02:19.648 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121111.log 2023-08-31T02:02:19.649 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113187.log.gz 2023-08-31T02:02:19.649 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112199.log 2023-08-31T02:02:19.649 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120613.log.gz 2023-08-31T02:02:19.649 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103652.log 2023-08-31T02:02:19.650 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112199.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121111.log.gz 2023-08-31T02:02:19.650 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120199.log 2023-08-31T02:02:19.650 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112199.log.gz 2023-08-31T02:02:19.651 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112818.log 2023-08-31T02:02:19.651 INFO:teuthology.orchestra.run.smithi084.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.103652.log.gz 2023-08-31T02:02:19.651 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120199.log: /var/log/ceph/ceph-client.admin.112818.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120199.log.gz 2023-08-31T02:02:19.651 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112818.log.gz 2023-08-31T02:02:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124607.log 2023-08-31T02:02:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119739.log 2023-08-31T02:02:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116036.log 2023-08-31T02:02:19.653 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124607.log.gz 2023-08-31T02:02:19.653 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119509.log 2023-08-31T02:02:19.653 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- 87.6%/var/log/ceph/ceph-client.admin.121585.log 2023-08-31T02:02:19.653 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.119739.log.gz 2023-08-31T02:02:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116036.log: /var/log/ceph/ceph-client.admin.119509.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116036.log.gz 2023-08-31T02:02:19.654 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.119509.log.gz 2023-08-31T02:02:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121585.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121585.log.gz 2023-08-31T02:02:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116677.log 2023-08-31T02:02:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124561.log 2023-08-31T02:02:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117321.log 2023-08-31T02:02:19.656 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116677.log: /var/log/ceph/ceph-client.admin.124561.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116677.log.gz 2023-08-31T02:02:19.656 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124561.log.gz/var/log/ceph/ceph-client.admin.117321.log: 2023-08-31T02:02:19.657 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117321.log.gz 2023-08-31T02:02:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125205.log 2023-08-31T02:02:19.658 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111632.log 2023-08-31T02:02:19.658 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116400.log 2023-08-31T02:02:19.659 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.125205.log.gz 2023-08-31T02:02:19.659 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111632.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111632.log.gz 2023-08-31T02:02:19.659 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116400.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116400.log.gz 2023-08-31T02:02:19.660 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110299.log 2023-08-31T02:02:19.660 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103780.log 2023-08-31T02:02:19.660 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110391.log 2023-08-31T02:02:19.660 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110299.log.gz 2023-08-31T02:02:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122184.log 2023-08-31T02:02:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110391.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.103780.log.gz 2023-08-31T02:02:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123443.log 2023-08-31T02:02:19.662 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110391.log.gz 2023-08-31T02:02:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122184.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122184.log.gz 2023-08-31T02:02:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123443.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123443.log.gz 2023-08-31T02:02:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103597.log 2023-08-31T02:02:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119785.log 2023-08-31T02:02:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103412.log 2023-08-31T02:02:19.663 INFO:teuthology.orchestra.run.smithi084.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.103597.log.gz 2023-08-31T02:02:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119785.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119785.log.gz 2023-08-31T02:02:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103412.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.103412.log.gz 2023-08-31T02:02:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123627.log 2023-08-31T02:02:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103517.log 2023-08-31T02:02:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123627.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-31T02:02:19.665 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123627.log.gz 2023-08-31T02:02:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112817.log 2023-08-31T02:02:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.c.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.103517.log.gz 2023-08-31T02:02:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118816.log 2023-08-31T02:02:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112817.log: /var/log/ceph/ceph-client.admin.118816.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112817.log.gz 2023-08-31T02:02:19.667 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118816.log.gz 2023-08-31T02:02:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123489.log 2023-08-31T02:02:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113189.log 2023-08-31T02:02:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118502.log 2023-08-31T02:02:19.668 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6%/var/log/ceph/ceph-client.admin.113189.log: -- replaced with /var/log/ceph/ceph-client.admin.123489.log.gz 2023-08-31T02:02:19.668 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.113189.log.gz 2023-08-31T02:02:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118502.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.118502.log.gz-5 2023-08-31T02:02:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:--verbose -- /var/log/ceph/ceph-client.admin.124060.log 2023-08-31T02:02:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111881.log 2023-08-31T02:02:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124060.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124060.log.gz 2023-08-31T02:02:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111881.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111881.log.gz 2023-08-31T02:02:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117413.log 2023-08-31T02:02:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103224.log 2023-08-31T02:02:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117413.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.117413.log.gz 2023-08-31T02:02:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.119086.log 2023-08-31T02:02:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103224.log: 76.2% -- replaced with /var/log/ceph/ceph-client.admin.103224.log.gz 2023-08-31T02:02:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117275.log 2023-08-31T02:02:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119086.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119086.log.gz 2023-08-31T02:02:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117275.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117275.log.gz 2023-08-31T02:02:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111494.log 2023-08-31T02:02:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103096.log 2023-08-31T02:02:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111494.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.96796.log 2023-08-31T02:02:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103096.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111494.log.gz 2023-08-31T02:02:19.673 INFO:teuthology.orchestra.run.smithi084.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.103096.log.gz 2023-08-31T02:02:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.tmp-client.admin.96796.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.96796.log.gz 2023-08-31T02:02:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117091.log 2023-08-31T02:02:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121863.log 2023-08-31T02:02:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117091.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.117091.log.gz/var/log/ceph/ceph-client.admin.121863.log: 2023-08-31T02:02:19.675 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121863.log.gz 2023-08-31T02:02:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120061.log 2023-08-31T02:02:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116447.log 2023-08-31T02:02:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120061.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120061.log.gz 2023-08-31T02:02:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116447.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116447.log.gz 2023-08-31T02:02:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117751.log 2023-08-31T02:02:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112337.log 2023-08-31T02:02:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123397.log 2023-08-31T02:02:19.677 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7%/var/log/ceph/ceph-client.admin.112337.log: -- replaced with /var/log/ceph/ceph-client.admin.117751.log.gz 2023-08-31T02:02:19.677 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112337.log.gz 2023-08-31T02:02:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123397.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.123397.log.gz 2023-08-31T02:02:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120834.log 2023-08-31T02:02:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125273.log 2023-08-31T02:02:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123128.log 2023-08-31T02:02:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125273.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120834.log.gz 2023-08-31T02:02:19.679 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.125273.log.gz 2023-08-31T02:02:19.680 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123128.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123128.log.gz 2023-08-31T02:02:19.680 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124745.log 2023-08-31T02:02:19.680 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116907.log 2023-08-31T02:02:19.680 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124745.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124745.log.gz 2023-08-31T02:02:19.681 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116907.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116907.log.gz 2023-08-31T02:02:19.681 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118770.log 2023-08-31T02:02:19.681 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103868.log 2023-08-31T02:02:19.681 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-08-31T02:02:19.682 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118770.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-31T02:02:19.682 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111927.log 2023-08-31T02:02:19.682 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.118770.log.gz 2023-08-31T02:02:19.682 INFO:teuthology.orchestra.run.smithi084.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.103868.log.gz 2023-08-31T02:02:19.683 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124653.log 2023-08-31T02:02:19.683 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111927.log: 87.7%/var/log/ceph/ceph-client.admin.124653.log: -- replaced with /var/log/ceph/ceph-client.admin.111927.log.gz 2023-08-31T02:02:19.683 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124653.log.gz 2023-08-31T02:02:19.683 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116631.log 2023-08-31T02:02:19.684 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8%gzip -5 --verbose -- replaced with /var/log/ceph/ceph.audit.log.gz-- 2023-08-31T02:02:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119178.log 2023-08-31T02:02:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113856.log 2023-08-31T02:02:19.684 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116631.log.gz 2023-08-31T02:02:19.685 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117659.log 2023-08-31T02:02:19.685 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113856.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119178.log.gz 2023-08-31T02:02:19.685 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118456.log 2023-08-31T02:02:19.685 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113856.log.gz 2023-08-31T02:02:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116723.log 2023-08-31T02:02:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119831.log 2023-08-31T02:02:19.686 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117659.log.gz 2023-08-31T02:02:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118456.log: /var/log/ceph/ceph-client.admin.116723.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118456.log.gz 2023-08-31T02:02:19.687 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116723.log.gz 2023-08-31T02:02:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119831.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119831.log.gz 2023-08-31T02:02:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120567.log 2023-08-31T02:02:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117613.log 2023-08-31T02:02:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119132.log 2023-08-31T02:02:19.689 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.120567.log.gz 2023-08-31T02:02:19.689 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123040.log 2023-08-31T02:02:19.689 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose 87.6%-- /var/log/ceph/ceph-client.admin.117229.log -- replaced with /var/log/ceph/ceph-client.admin.117613.log.gz 2023-08-31T02:02:19.689 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-08-31T02:02:19.690 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119132.log: /var/log/ceph/ceph-client.admin.123040.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119132.log.gz 2023-08-31T02:02:19.690 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123040.log.gz 2023-08-31T02:02:19.690 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117229.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117229.log.gz 2023-08-31T02:02:19.691 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112476.log 2023-08-31T02:02:19.691 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111789.log 2023-08-31T02:02:19.691 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117705.log 2023-08-31T02:02:19.692 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112476.log.gz 2023-08-31T02:02:19.692 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118640.log 2023-08-31T02:02:19.692 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.123312.log 2023-08-31T02:02:19.692 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111789.log.gz 2023-08-31T02:02:19.693 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117705.log: /var/log/ceph/ceph-client.admin.118640.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117705.log.gz 2023-08-31T02:02:19.693 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118640.log.gz 2023-08-31T02:02:19.693 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123312.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123312.log.gz 2023-08-31T02:02:19.693 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121909.log 2023-08-31T02:02:19.694 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110483.log 2023-08-31T02:02:19.694 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113549.log 2023-08-31T02:02:19.694 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.121909.log.gz 2023-08-31T02:02:19.695 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116769.log 2023-08-31T02:02:19.695 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 87.6%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.110483.log.gz/var/log/ceph/ceph-client.admin.117908.log 2023-08-31T02:02:19.695 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-08-31T02:02:19.695 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113549.log: /var/log/ceph/ceph-client.admin.116769.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.113549.log.gz 2023-08-31T02:02:19.696 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116769.log.gz 2023-08-31T02:02:19.696 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117908.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117908.log.gz 2023-08-31T02:02:19.696 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121976.log 2023-08-31T02:02:19.697 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118226.log 2023-08-31T02:02:19.697 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116216.log 2023-08-31T02:02:19.697 INFO:teuthology.orchestra.run.smithi084.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.121976.log.gz 2023-08-31T02:02:19.697 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103674.log 2023-08-31T02:02:19.698 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118226.log.gz 2023-08-31T02:02:19.698 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103999.log 2023-08-31T02:02:19.698 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116216.log: /var/log/ceph/ceph-client.admin.103674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123535.log 2023-08-31T02:02:19.699 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116216.log.gz 2023-08-31T02:02:19.699 INFO:teuthology.orchestra.run.smithi084.stderr: 86.5%/var/log/ceph/ceph-client.admin.103999.log: -- replaced with /var/log/ceph/ceph-client.admin.103674.log.gz 2023-08-31T02:02:19.699 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.103999.log.gz 2023-08-31T02:02:19.700 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123535.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123535.log.gz 2023-08-31T02:02:19.700 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110437.log 2023-08-31T02:02:19.700 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111973.log 2023-08-31T02:02:19.700 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121019.log 2023-08-31T02:02:19.701 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110437.log.gz 2023-08-31T02:02:19.701 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111973.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111973.log.gz 2023-08-31T02:02:19.701 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121019.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.121019.log.gz 2023-08-31T02:02:19.701 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121725.log 2023-08-31T02:02:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119316.log 2023-08-31T02:02:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110203.log 2023-08-31T02:02:19.702 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.121725.log.gz 2023-08-31T02:02:19.703 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118000.log 2023-08-31T02:02:19.703 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.119316.log.gz 2023-08-31T02:02:19.703 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123673.log 2023-08-31T02:02:19.703 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110203.log.gz 2023-08-31T02:02:19.704 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118000.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118000.log.gz 2023-08-31T02:02:19.704 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123673.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123673.log.gz 2023-08-31T02:02:19.704 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116308.log 2023-08-31T02:02:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120749.log 2023-08-31T02:02:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116308.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-31T02:02:19.705 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116308.log.gz 2023-08-31T02:02:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120749.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120749.log.gz 2023-08-31T02:02:19.706 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110040.log 2023-08-31T02:02:19.706 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124014.log 2023-08-31T02:02:19.706 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114086.log 2023-08-31T02:02:19.706 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110040.log.gz 2023-08-31T02:02:19.707 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113441.log 2023-08-31T02:02:19.707 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124014.log.gz 2023-08-31T02:02:19.707 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122022.log 2023-08-31T02:02:19.708 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114086.log.gz 2023-08-31T02:02:19.708 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113441.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113441.log.gz 2023-08-31T02:02:19.708 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122022.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122022.log.gz 2023-08-31T02:02:19.709 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123811.log 2023-08-31T02:02:19.709 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112812.log 2023-08-31T02:02:19.709 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124331.log 2023-08-31T02:02:19.709 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123811.log.gz 2023-08-31T02:02:19.710 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112812.log: /var/log/ceph/ceph-client.admin.124331.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112812.log.gz 2023-08-31T02:02:19.710 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124331.log.gz 2023-08-31T02:02:19.710 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109473.log 2023-08-31T02:02:19.711 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111540.log 2023-08-31T02:02:19.711 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119021.log 2023-08-31T02:02:19.711 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109473.log.gz 2023-08-31T02:02:19.711 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111540.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111540.log.gz 2023-08-31T02:02:19.712 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119021.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119021.log.gz 2023-08-31T02:02:19.712 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125363.log 2023-08-31T02:02:19.712 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111835.log 2023-08-31T02:02:19.712 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125363.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125363.log.gz 2023-08-31T02:02:19.713 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111835.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111835.log.gz 2023-08-31T02:02:19.713 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116585.log 2023-08-31T02:02:19.713 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103637.log 2023-08-31T02:02:19.714 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118410.log 2023-08-31T02:02:19.714 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116585.log.gz 2023-08-31T02:02:19.714 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121065.log 2023-08-31T02:02:19.714 INFO:teuthology.orchestra.run.smithi084.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.103637.log.gz 2023-08-31T02:02:19.715 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118410.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118410.log.gz 2023-08-31T02:02:19.715 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.115898.log 2023-08-31T02:02:19.715 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.121065.log.gz 2023-08-31T02:02:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124791.log 2023-08-31T02:02:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.2.115898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104396.log 2023-08-31T02:02:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124791.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124791.log.gz 2023-08-31T02:02:19.717 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104396.log: 91.5% -- replaced with /var/log/ceph/ceph-client.2.115898.log.gz 2023-08-31T02:02:19.717 INFO:teuthology.orchestra.run.smithi084.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.104396.log.gz 2023-08-31T02:02:19.717 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119404.log 2023-08-31T02:02:19.717 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113186.log 2023-08-31T02:02:19.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112291.log 2023-08-31T02:02:19.718 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119404.log.gz 2023-08-31T02:02:19.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112568.log 2023-08-31T02:02:19.719 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.113186.log.gz 2023-08-31T02:02:19.719 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124469.log 2023-08-31T02:02:19.719 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112291.log.gz 2023-08-31T02:02:19.720 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110345.log 2023-08-31T02:02:19.720 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112568.log.gz 2023-08-31T02:02:19.720 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124469.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124469.log.gz 2023-08-31T02:02:19.720 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120429.log 2023-08-31T02:02:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118594.log 2023-08-31T02:02:19.721 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110345.log.gz 2023-08-31T02:02:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120429.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120429.log.gz 2023-08-31T02:02:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118594.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118594.log.gz 2023-08-31T02:02:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119450.log 2023-08-31T02:02:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110157.log 2023-08-31T02:02:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116262.log 2023-08-31T02:02:19.722 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119450.log.gz 2023-08-31T02:02:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121343.log 2023-08-31T02:02:19.723 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110157.log.gz 2023-08-31T02:02:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116999.log 2023-08-31T02:02:19.723 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116262.log.gz 2023-08-31T02:02:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121343.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.121343.log.gz 2023-08-31T02:02:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113948.log 2023-08-31T02:02:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122068.log 2023-08-31T02:02:19.725 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116999.log.gz 2023-08-31T02:02:19.725 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113948.log: /var/log/ceph/ceph-client.admin.122068.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113948.log.gz 2023-08-31T02:02:19.725 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122068.log.gz 2023-08-31T02:02:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123719.log 2023-08-31T02:02:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103293.log 2023-08-31T02:02:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114132.log 2023-08-31T02:02:19.727 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123719.log.gz 2023-08-31T02:02:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119647.log 2023-08-31T02:02:19.727 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.103293.log.gz 2023-08-31T02:02:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114132.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114132.log.gz 2023-08-31T02:02:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119647.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119647.log.gz 2023-08-31T02:02:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122679.log 2023-08-31T02:02:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110621.log 2023-08-31T02:02:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114567.log 2023-08-31T02:02:19.729 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122679.log.gz 2023-08-31T02:02:19.730 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110621.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.110621.log.gz 2023-08-31T02:02:19.730 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112815.log 2023-08-31T02:02:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112430.log 2023-08-31T02:02:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112815.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.112815.log.gz 2023-08-31T02:02:19.731 INFO:teuthology.orchestra.run.smithi084.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.114567.log.gz 2023-08-31T02:02:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110691.log 2023-08-31T02:02:19.732 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112430.log.gz 2023-08-31T02:02:19.732 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118046.log 2023-08-31T02:02:19.732 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112245.log 2023-08-31T02:02:19.733 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118046.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110691.log.gz 2023-08-31T02:02:19.733 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118046.log.gz 2023-08-31T02:02:19.733 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112245.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112245.log.gz 2023-08-31T02:02:19.733 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120383.log 2023-08-31T02:02:19.734 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117045.log 2023-08-31T02:02:19.734 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120383.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120383.log.gz 2023-08-31T02:02:19.734 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117045.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117045.log.gz 2023-08-31T02:02:19.735 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124285.log 2023-08-31T02:02:19.735 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120926.log 2023-08-31T02:02:19.735 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124285.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124285.log.gz 2023-08-31T02:02:19.736 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120926.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120926.log.gz 2023-08-31T02:02:19.736 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125067.log 2023-08-31T02:02:19.736 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114500.log 2023-08-31T02:02:19.737 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125067.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.125067.log.gz 2023-08-31T02:02:19.737 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114500.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114500.log.gz 2023-08-31T02:02:19.737 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124883.log 2023-08-31T02:02:19.737 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117862.log 2023-08-31T02:02:19.738 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124883.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124883.log.gz/var/log/ceph/ceph-client.admin.117862.log: 2023-08-31T02:02:19.738 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117862.log.gz 2023-08-31T02:02:19.738 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113440.log 2023-08-31T02:02:19.739 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120291.log 2023-08-31T02:02:19.739 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121491.log 2023-08-31T02:02:19.739 INFO:teuthology.orchestra.run.smithi084.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.113440.log.gz 2023-08-31T02:02:19.740 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123968.log 2023-08-31T02:02:19.740 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.120291.log.gz 2023-08-31T02:02:19.740 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121491.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121491.log.gz 2023-08-31T02:02:19.740 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123968.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123968.log.gz 2023-08-31T02:02:19.741 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114408.log 2023-08-31T02:02:19.741 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118548.log 2023-08-31T02:02:19.741 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109994.log 2023-08-31T02:02:19.742 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114408.log.gz 2023-08-31T02:02:19.742 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118548.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118548.log.gz 2023-08-31T02:02:19.742 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118272.log 2023-08-31T02:02:19.743 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113810.log 2023-08-31T02:02:19.743 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109994.log.gz 2023-08-31T02:02:19.743 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.118272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116815.log 2023-08-31T02:02:19.743 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118272.log.gz 2023-08-31T02:02:19.744 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121817.log 2023-08-31T02:02:19.744 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.113810.log.gz 2023-08-31T02:02:19.744 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110251.log 2023-08-31T02:02:19.745 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116815.log.gz 2023-08-31T02:02:19.745 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117797.log 2023-08-31T02:02:19.745 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.121817.log.gz 2023-08-31T02:02:19.745 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113553.log 2023-08-31T02:02:19.746 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.110251.log.gz 2023-08-31T02:02:19.746 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117797.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117797.log.gz 2023-08-31T02:02:19.746 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113553.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113553.log.gz 2023-08-31T02:02:19.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122114.log 2023-08-31T02:02:19.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121203.log 2023-08-31T02:02:19.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122114.log: /var/log/ceph/ceph-client.admin.121203.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.122114.log.gz 2023-08-31T02:02:19.748 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121203.log.gz 2023-08-31T02:02:19.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114224.log 2023-08-31T02:02:19.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117954.log 2023-08-31T02:02:19.748 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114224.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114224.log.gz 2023-08-31T02:02:19.749 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.117954.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117954.log.gz 2023-08-31T02:02:19.749 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-31T02:02:19.749 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124515.log 2023-08-31T02:02:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.124515.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124515.log.gz 2023-08-31T02:02:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109856.log 2023-08-31T02:02:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113994.log 2023-08-31T02:02:19.750 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109856.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109856.log.gz 2023-08-31T02:02:19.751 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113994.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113994.log.gz 2023-08-31T02:02:19.751 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114270.log 2023-08-31T02:02:19.751 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120475.log 2023-08-31T02:02:19.751 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114270.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114270.log.gz 2023-08-31T02:02:19.752 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120475.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.120475.log.gz 2023-08-31T02:02:19.752 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103665.log 2023-08-31T02:02:19.752 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121445.log 2023-08-31T02:02:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103665.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.103665.log.gz 2023-08-31T02:02:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121445.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121445.log.gz 2023-08-31T02:02:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112019.log 2023-08-31T02:02:19.753 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120973.log 2023-08-31T02:02:19.754 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112019.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112019.log.gz 2023-08-31T02:02:19.754 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120973.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120973.log.gz 2023-08-31T02:02:19.754 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124377.log 2023-08-31T02:02:19.754 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-31T02:02:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124377.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124377.log.gz 2023-08-31T02:02:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113172.log 2023-08-31T02:02:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113172.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113172.log.gz 2023-08-31T02:02:19.755 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113184.log 2023-08-31T02:02:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113184.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.113184.log.gz 2023-08-31T02:02:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123581.log 2023-08-31T02:02:19.759 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.123581.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123581.log.gz 2023-08-31T02:02:19.760 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119270.log 2023-08-31T02:02:19.760 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119270.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119270.log.gz 2023-08-31T02:02:19.760 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116539.log 2023-08-31T02:02:19.760 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.116539.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116539.log.gz 2023-08-31T02:02:19.761 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124929.log 2023-08-31T02:02:19.761 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124929.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124929.log.gz 2023-08-31T02:02:19.761 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113902.log 2023-08-31T02:02:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113902.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113902.log.gz 2023-08-31T02:02:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114040.log 2023-08-31T02:02:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114040.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114040.log.gz 2023-08-31T02:02:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119969.log 2023-08-31T02:02:19.763 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.119969.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119969.log.gz 2023-08-31T02:02:19.763 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120245.log 2023-08-31T02:02:19.763 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.120245.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120245.log.gz 2023-08-31T02:02:19.763 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-31T02:02:19.791 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-31T02:02:20.069 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-31T02:02:20.113 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-31T02:02:20.124 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-31T02:02:20.154 INFO:teuthology.orchestra.run.smithi170.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-31T02:02:20.160 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-31T02:02:20.187 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-31T02:02:20.188 INFO:teuthology.orchestra.run.smithi170.stderr: 2023-08-31T02:02:20.189 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m0.700s 2023-08-31T02:02:20.189 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m2.729s 2023-08-31T02:02:20.189 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m0.114s 2023-08-31T02:02:20.203 INFO:teuthology.orchestra.run.smithi084.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-31T02:02:20.227 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-31T02:02:20.229 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-08-31T02:02:20.229 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m0.772s 2023-08-31T02:02:20.230 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m2.931s 2023-08-31T02:02:20.230 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.248s 2023-08-31T02:02:20.230 INFO:tasks.ceph:Archiving logs... 2023-08-31T02:02:20.231 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/remote/smithi084/log 2023-08-31T02:02:20.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-31T02:02:20.928 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/remote/smithi170/log 2023-08-31T02:02:20.929 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-31T02:02:21.359 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-31T02:02:21.368 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-31T02:02:21.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-31T02:02:21.372 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-31T02:02:21.454 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-31T02:02:21.463 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-31T02:02:21.463 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T02:02:21.466 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T02:02:21.483 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-08-31T02:02:21.485 INFO:teuthology.orchestra.run.smithi170.stderr:bash: ntpq: command not found 2023-08-31T02:02:21.488 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T02:02:21.489 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-08-31T02:02:21.489 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 +1296us[+1297us] +/- 87ms 2023-08-31T02:02:21.489 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv02.front.sepia.ceph.com 3 6 377 12 -718us[ -717us] +/- 53ms 2023-08-31T02:02:21.489 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -106us[ -105us] +/- 70ms 2023-08-31T02:02:21.490 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T02:02:21.491 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T02:02:21.491 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2023-08-31T02:02:21.491 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 +1300us[+1300us] +/- 87ms 2023-08-31T02:02:21.492 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -707us[ -703us] +/- 53ms 2023-08-31T02:02:21.492 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -90us[ -86us] +/- 70ms 2023-08-31T02:02:21.492 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T02:02:21.493 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-31T02:02:21.502 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-31T02:02:21.503 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-31T02:02:21.526 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-31T02:02:21.634 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-31T02:02:21.734 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T02:02:21.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:02:21.768 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T02:02:21.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:02:21.802 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-31T02:02:21.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-31T02:02:21.867 INFO:teuthology.task.internal:Duration was 886.824880 seconds 2023-08-31T02:02:21.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-31T02:02:21.904 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-31T02:02:21.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-31T02:02:21.907 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-31T02:02:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T02:02:21.955 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T02:02:22.282 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-31T02:02:22.283 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2023-08-31T02:02:22.283 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-31T02:02:22.304 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2023-08-31T02:02:22.305 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-31T02:02:22.327 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-31T02:02:22.328 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-31T02:02:22.346 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-31T02:02:22.410 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-31T02:02:22.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-31T02:02:22.429 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-31T02:02:22.527 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-31T02:02:22.537 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-31T02:02:22.538 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-31T02:02:22.565 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-31T02:02:22.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-31T02:02:22.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-31T02:02:22.608 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-31T02:02:22.631 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2023-08-31T02:02:22.657 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2023-08-31T02:02:22.671 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-31T02:02:22.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:02:22.701 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-31T02:02:22.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T02:02:22.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-31T02:02:22.739 INFO:teuthology.task.internal:Transferring archived files... 2023-08-31T02:02:22.740 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/remote/smithi084 2023-08-31T02:02:22.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-31T02:02:22.780 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123/remote/smithi170 2023-08-31T02:02:22.780 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-31T02:02:22.818 INFO:teuthology.task.internal:Removing archive directory... 2023-08-31T02:02:22.818 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-31T02:02:22.821 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-31T02:02:22.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-31T02:02:22.880 INFO:teuthology.task.internal:Not uploading archives. 2023-08-31T02:02:22.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-31T02:02:22.902 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-31T02:02:22.903 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-31T02:02:22.905 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-31T02:02:22.919 INFO:teuthology.orchestra.run.smithi084.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 02:02 /home/ubuntu/cephtest 2023-08-31T02:02:22.924 INFO:teuthology.orchestra.run.smithi170.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 02:02 /home/ubuntu/cephtest 2023-08-31T02:02:22.925 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-31T02:02:22.935 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-31T02:02:23.004 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T02:02:23.032 DEBUG:teuthology.nuke:shortname: smithi084 2023-08-31T02:02:23.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T02:02:23.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 01:42:15.129205', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-31T02:02:23.059 DEBUG:teuthology.nuke:shortname: smithi170 2023-08-31T02:02:23.059 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T02:02:23.078 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385123', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 01:42:15.127768', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-31T02:02:23.110 INFO:teuthology.orchestra.console.smithi084:Power off 2023-08-31T02:02:23.111 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T02:02:23.139 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-08-31T02:02:23.140 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:02:23.155 INFO:teuthology.orchestra.console.smithi170:Power off 2023-08-31T02:02:23.155 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T02:02:23.172 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-08-31T02:02:23.177 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-08-31T02:02:23.178 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:02:23.201 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-08-31T02:02:27.175 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:02:27.202 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:02:27.285 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-08-31T02:02:27.312 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-08-31T02:02:31.290 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:02:31.313 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:02:31.399 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-08-31T02:02:31.422 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-08-31T02:02:31.501 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-08-31T02:02:31.524 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-08-31T02:02:31.628 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} duration: 886.8248796463013 failure_reason: 'Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a8f9dbaa19dd4fe69711f2d79e74dabe status: fail success: false 2023-08-31T02:02:31.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:02:31.705 INFO:teuthology.run:FAIL